Jul 31 14:39:46 user nova-compute[72239]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Jul 31 14:39:49 user nova-compute[72239]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=72239) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=72239) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=72239) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 31 14:39:49 user nova-compute[72239]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:39:49 user nova-compute[72239]: INFO nova.virt.driver [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] Loading compute driver 'libvirt.LibvirtDriver'
Jul 31 14:39:49 user nova-compute[72239]: INFO nova.compute.provider_config [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] Acquiring lock "singleton_lock" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] Acquired lock "singleton_lock" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] Releasing lock "singleton_lock" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] Full set of CONF: {{(pid=72239) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] ******************************************************************************** {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] Configuration options gathered from: {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] ================================================================================ {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] allow_resize_to_same_host      = True {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] arq_binding_timeout            = 300 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] backdoor_port                  = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] backdoor_socket                = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] block_device_allocate_retries  = 300 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] block_device_allocate_retries_interval = 5 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cert                           = self.pem {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] compute_monitors               = [] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] config_dir                     = [] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] config_drive_format            = iso9660 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] config_source                  = [] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] console_host                   = user {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] control_exchange               = nova {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cpu_allocation_ratio           = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] daemon                         = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] debug                          = True {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] default_access_ip_network_name = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] default_availability_zone      = nova {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] default_ephemeral_format       = ext4 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] default_schedule_zone          = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] disk_allocation_ratio          = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] enable_new_services            = True {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] enabled_apis                   = ['osapi_compute'] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] enabled_ssl_apis               = [] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] flat_injected                  = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] force_config_drive             = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] force_raw_images               = True {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] graceful_shutdown_timeout      = 5 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] heal_instance_info_cache_interval = 60 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] host                           = user {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] instance_build_timeout         = 0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] instance_delete_interval       = 300 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] instance_format                = [instance: %(uuid)s]  {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] instance_name_template         = instance-%08x {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] instance_usage_audit           = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] instance_usage_audit_period    = month {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] internal_service_availability_zone = internal {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] key                            = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] live_migration_retry_count     = 30 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] log_config_append              = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] log_dir                        = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] log_file                       = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] log_options                    = True {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] log_rotate_interval            = 1 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] log_rotate_interval_type       = days {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] log_rotation_type              = none {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] long_rpc_timeout               = 1800 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] max_concurrent_builds          = 10 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] max_concurrent_live_migrations = 1 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] max_concurrent_snapshots       = 5 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] max_local_block_devices        = 3 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] max_logfile_count              = 30 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] max_logfile_size_mb            = 200 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] maximum_instance_delete_attempts = 5 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] metadata_listen                = 0.0.0.0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] metadata_listen_port           = 8775 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] metadata_workers               = 3 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] migrate_max_retries            = -1 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] mkisofs_cmd                    = genisoimage {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] my_ip                          = 10.0.0.210 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] network_allocate_retries       = 0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] osapi_compute_listen_port      = 8774 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] osapi_compute_unique_server_name_scope =  {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] osapi_compute_workers          = 3 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] password_length                = 12 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] periodic_enable                = True {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] periodic_fuzzy_delay           = 60 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] pointer_model                  = ps2mouse {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] preallocate_images             = none {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] publish_errors                 = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] pybasedir                      = /opt/stack/nova {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] ram_allocation_ratio           = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] rate_limit_burst               = 0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] rate_limit_except_level        = CRITICAL {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] rate_limit_interval            = 0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] reboot_timeout                 = 0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] reclaim_instance_interval      = 0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] record                         = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] reimage_timeout_per_gb         = 60 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] report_interval                = 10 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] rescue_timeout                 = 0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] reserved_host_cpus             = 0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] reserved_host_disk_mb          = 0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] reserved_host_memory_mb        = 512 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] reserved_huge_pages            = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] resize_confirm_window          = 0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] resize_fs_using_block_device   = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] resume_guests_state_on_host_boot = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] rpc_response_timeout           = 60 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] run_external_periodic_tasks    = True {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] running_deleted_instance_action = reap {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] running_deleted_instance_poll_interval = 1800 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] running_deleted_instance_timeout = 0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] scheduler_instance_sync_interval = 120 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] service_down_time              = 60 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] servicegroup_driver            = db {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] shelved_offload_time           = 0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] shelved_poll_interval          = 3600 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] shutdown_timeout               = 0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] source_is_ipv6                 = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] ssl_only                       = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] state_path                     = /opt/stack/data/nova {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] sync_power_state_interval      = 600 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] sync_power_state_pool_size     = 1000 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] syslog_log_facility            = LOG_USER {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] tempdir                        = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] timeout_nbd                    = 10 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] transport_url                  = **** {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] update_resources_interval      = 0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] use_cow_images                 = True {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] use_eventlog                   = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] use_journal                    = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] use_json                       = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] use_rootwrap_daemon            = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] use_stderr                     = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] use_syslog                     = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vcpu_pin_set                   = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vif_plugging_is_fatal          = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vif_plugging_timeout           = 0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] virt_mkfs                      = [] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] volume_usage_poll_interval     = 0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] watch_log_file                 = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] web                            = /usr/share/spice-html5 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_concurrency.disable_process_locking = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api.auth_strategy              = keystone {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api.compute_link_prefix        = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api.dhcp_domain                = novalocal {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api.enable_instance_password   = True {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api.glance_link_prefix         = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api.instance_list_per_project_cells = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api.list_records_by_skipping_down_cells = True {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api.local_metadata_per_cell    = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api.max_limit                  = 1000 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api.metadata_cache_expiration  = 15 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api.neutron_default_tenant_id  = default {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api.use_forwarded_for          = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api.use_neutron_default_nets   = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api.vendordata_dynamic_targets = [] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api.vendordata_jsonfile_path   = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cache.backend                  = dogpile.cache.memcached {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cache.backend_argument         = **** {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cache.config_prefix            = cache.oslo {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cache.dead_timeout             = 60.0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cache.debug_cache_backend      = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cache.enable_retry_client      = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cache.enable_socket_keepalive  = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cache.enabled                  = True {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cache.expiration_time          = 600 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cache.hashclient_retry_attempts = 2 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cache.memcache_dead_retry      = 300 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cache.memcache_password        =  {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cache.memcache_pool_maxsize    = 10 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cache.memcache_sasl_enabled    = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cache.memcache_username        =  {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cache.proxies                  = [] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cache.retry_attempts           = 2 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cache.retry_delay              = 0.0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cache.socket_keepalive_count   = 1 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cache.socket_keepalive_idle    = 1 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cache.socket_keepalive_interval = 1 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cache.tls_allowed_ciphers      = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cache.tls_cafile               = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cache.tls_certfile             = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cache.tls_enabled              = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cache.tls_keyfile              = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cinder.auth_section            = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cinder.auth_type               = password {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cinder.cafile                  = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cinder.certfile                = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cinder.collect_timing          = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cinder.cross_az_attach         = True {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cinder.debug                   = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cinder.endpoint_template       = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cinder.http_retries            = 3 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cinder.insecure                = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cinder.keyfile                 = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cinder.os_region_name          = RegionOne {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cinder.split_loggers           = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cinder.timeout                 = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] compute.cpu_dedicated_set      = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] compute.cpu_shared_set         = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] compute.image_type_exclude_list = [] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] compute.max_concurrent_disk_ops = 0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] compute.max_disk_devices_to_attach = -1 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] compute.resource_provider_association_refresh = 300 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] compute.shutdown_retry_interval = 10 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] conductor.workers              = 3 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] console.allowed_origins        = [] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] console.ssl_ciphers            = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] console.ssl_minimum_version    = default {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] consoleauth.token_ttl          = 600 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cyborg.cafile                  = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cyborg.certfile                = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cyborg.collect_timing          = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cyborg.connect_retries         = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cyborg.connect_retry_delay     = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cyborg.endpoint_override       = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cyborg.insecure                = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cyborg.keyfile                 = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cyborg.max_version             = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cyborg.min_version             = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cyborg.region_name             = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cyborg.service_name            = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cyborg.service_type            = accelerator {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cyborg.split_loggers           = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cyborg.status_code_retries     = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cyborg.status_code_retry_delay = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cyborg.timeout                 = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] cyborg.version                 = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] database.backend               = sqlalchemy {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] database.connection            = **** {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] database.connection_debug      = 0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] database.connection_parameters =  {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] database.connection_recycle_time = 3600 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] database.connection_trace      = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] database.db_inc_retry_interval = True {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] database.db_max_retries        = 20 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] database.db_max_retry_interval = 10 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] database.db_retry_interval     = 1 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] database.max_overflow          = 50 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] database.max_pool_size         = 5 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] database.max_retries           = 10 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] database.mysql_enable_ndb      = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] database.mysql_wsrep_sync_wait = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] database.pool_timeout          = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] database.retry_interval        = 10 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] database.slave_connection      = **** {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] database.sqlite_synchronous    = True {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api_database.backend           = sqlalchemy {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api_database.connection        = **** {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api_database.connection_debug  = 0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api_database.connection_parameters =  {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api_database.connection_recycle_time = 3600 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api_database.connection_trace  = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api_database.db_inc_retry_interval = True {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api_database.db_max_retries    = 20 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api_database.db_max_retry_interval = 10 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api_database.db_retry_interval = 1 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api_database.max_overflow      = 50 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api_database.max_pool_size     = 5 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api_database.max_retries       = 10 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api_database.mysql_enable_ndb  = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api_database.pool_timeout      = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api_database.retry_interval    = 10 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api_database.slave_connection  = **** {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] api_database.sqlite_synchronous = True {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] devices.enabled_mdev_types     = [] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] ephemeral_storage_encryption.enabled = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] glance.api_servers             = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] glance.cafile                  = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] glance.certfile                = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] glance.collect_timing          = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] glance.connect_retries         = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] glance.connect_retry_delay     = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] glance.debug                   = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] glance.default_trusted_certificate_ids = [] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] glance.enable_certificate_validation = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] glance.enable_rbd_download     = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] glance.endpoint_override       = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] glance.insecure                = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] glance.keyfile                 = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] glance.max_version             = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] glance.min_version             = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] glance.num_retries             = 3 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] glance.rbd_ceph_conf           =  {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] glance.rbd_connect_timeout     = 5 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] glance.rbd_pool                =  {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] glance.rbd_user                =  {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] glance.region_name             = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] glance.service_name            = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] glance.service_type            = image {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] glance.split_loggers           = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] glance.status_code_retries     = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] glance.status_code_retry_delay = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] glance.timeout                 = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] glance.verify_glance_signatures = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] glance.version                 = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] guestfs.debug                  = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] hyperv.config_drive_cdrom      = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] hyperv.config_drive_inject_password = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] hyperv.enable_instance_metrics_collection = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] hyperv.enable_remotefx         = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] hyperv.instances_path_share    =  {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] hyperv.iscsi_initiator_list    = [] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] hyperv.limit_cpu_features      = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] hyperv.power_state_check_timeframe = 60 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] hyperv.use_multipath_io        = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] hyperv.volume_attach_retry_count = 10 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] hyperv.vswitch_name            = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] mks.enabled                    = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] image_cache.manager_interval   = 2400 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] image_cache.precache_concurrency = 1 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] image_cache.remove_unused_base_images = True {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] image_cache.subdirectory_name  = _base {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] ironic.api_max_retries         = 60 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] ironic.api_retry_interval      = 2 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] ironic.auth_section            = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] ironic.auth_type               = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] ironic.cafile                  = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] ironic.certfile                = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] ironic.collect_timing          = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] ironic.connect_retries         = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] ironic.connect_retry_delay     = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] ironic.endpoint_override       = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] ironic.insecure                = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] ironic.keyfile                 = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] ironic.max_version             = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] ironic.min_version             = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] ironic.partition_key           = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] ironic.peer_list               = [] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] ironic.region_name             = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] ironic.serial_console_state_timeout = 10 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] ironic.service_name            = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] ironic.service_type            = baremetal {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] ironic.split_loggers           = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] ironic.status_code_retries     = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] ironic.status_code_retry_delay = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] ironic.timeout                 = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] ironic.version                 = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] key_manager.fixed_key          = **** {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] barbican.barbican_api_version  = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] barbican.barbican_endpoint     = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] barbican.barbican_endpoint_type = public {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] barbican.barbican_region_name  = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] barbican.cafile                = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] barbican.certfile              = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] barbican.collect_timing        = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] barbican.insecure              = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] barbican.keyfile               = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] barbican.number_of_retries     = 60 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] barbican.retry_delay           = 1 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] barbican.send_service_user_token = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] barbican.split_loggers         = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] barbican.timeout               = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] barbican.verify_ssl            = True {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] barbican.verify_ssl_path       = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] barbican_service_user.auth_section = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] barbican_service_user.auth_type = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] barbican_service_user.cafile   = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] barbican_service_user.certfile = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] barbican_service_user.collect_timing = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] barbican_service_user.insecure = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] barbican_service_user.keyfile  = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] barbican_service_user.split_loggers = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] barbican_service_user.timeout  = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vault.approle_role_id          = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vault.approle_secret_id        = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vault.cafile                   = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vault.certfile                 = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vault.collect_timing           = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vault.insecure                 = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vault.keyfile                  = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vault.kv_mountpoint            = secret {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vault.kv_version               = 2 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vault.namespace                = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vault.root_token_id            = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vault.split_loggers            = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vault.ssl_ca_crt_file          = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vault.timeout                  = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vault.use_ssl                  = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] keystone.cafile                = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] keystone.certfile              = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] keystone.collect_timing        = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] keystone.connect_retries       = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] keystone.connect_retry_delay   = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] keystone.endpoint_override     = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] keystone.insecure              = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] keystone.keyfile               = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] keystone.max_version           = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] keystone.min_version           = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] keystone.region_name           = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] keystone.service_name          = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] keystone.service_type          = identity {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] keystone.split_loggers         = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] keystone.status_code_retries   = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] keystone.status_code_retry_delay = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] keystone.timeout               = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] keystone.version               = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.connection_uri         =  {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.cpu_mode               = custom {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: WARNING oslo_config.cfg [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.cpu_power_governor_high = performance {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.cpu_power_governor_low = powersave {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.cpu_power_management   = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.device_detach_attempts = 8 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.device_detach_timeout  = 20 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.disk_cachemodes        = [] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.disk_prefix            = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.enabled_perf_events    = [] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.file_backed_memory     = 0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.gid_maps               = [] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.hw_disk_discard        = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.hw_machine_type        = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.images_rbd_glance_store_name =  {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.images_rbd_pool        = rbd {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.images_type            = default {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.images_volume_group    = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.inject_key             = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.inject_partition       = -2 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.inject_password        = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.iscsi_iface            = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.iser_use_multipath     = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.live_migration_bandwidth = 0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.live_migration_downtime = 500 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.live_migration_inbound_addr = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.live_migration_permit_post_copy = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.live_migration_scheme  = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.live_migration_timeout_action = abort {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.live_migration_tunnelled = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: WARNING oslo_config.cfg [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Jul 31 14:39:49 user nova-compute[72239]: live_migration_uri is deprecated for removal in favor of two other options that
Jul 31 14:39:49 user nova-compute[72239]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Jul 31 14:39:49 user nova-compute[72239]: and ``live_migration_inbound_addr`` respectively.
Jul 31 14:39:49 user nova-compute[72239]: ).  Its value may be silently ignored in the future.
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.live_migration_with_native_tls = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.max_queues             = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.nfs_mount_options      = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.num_memory_encrypted_guests = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.num_pcie_ports         = 0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.pmem_namespaces        = [] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.quobyte_client_cfg     = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.rbd_secret_uuid        = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.rbd_user               = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.remote_filesystem_transport = ssh {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.rescue_image_id        = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.rescue_kernel_id       = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.rescue_ramdisk_id      = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.rx_queue_size          = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.smbfs_mount_options    =  {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.snapshot_compression   = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.snapshot_image_format  = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.sparse_logical_volumes = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.swtpm_enabled          = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.swtpm_group            = tss {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.swtpm_user             = tss {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.sysinfo_serial         = unique {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.tb_cache_size          = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.tx_queue_size          = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.uid_maps               = [] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.use_virtio_for_bridges = True {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.virt_type              = kvm {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.volume_clear           = zero {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.volume_clear_size      = 0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.volume_use_multipath   = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.vzstorage_cache_path   = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.vzstorage_mount_user   = stack {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] neutron.auth_section           = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] neutron.auth_type              = password {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] neutron.cafile                 = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] neutron.certfile               = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] neutron.collect_timing         = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] neutron.connect_retries        = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] neutron.connect_retry_delay    = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] neutron.default_floating_pool  = public {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] neutron.endpoint_override      = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] neutron.extension_sync_interval = 600 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] neutron.http_retries           = 3 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] neutron.insecure               = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] neutron.keyfile                = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] neutron.max_version            = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] neutron.min_version            = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] neutron.ovs_bridge             = br-int {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] neutron.physnets               = [] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] neutron.region_name            = RegionOne {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] neutron.service_metadata_proxy = True {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] neutron.service_name           = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] neutron.service_type           = network {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] neutron.split_loggers          = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] neutron.status_code_retries    = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] neutron.status_code_retry_delay = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] neutron.timeout                = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] neutron.version                = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] notifications.bdms_in_notifications = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] notifications.default_level    = INFO {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] notifications.notification_format = unversioned {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] notifications.notify_on_state_change = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] pci.alias                      = [] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] pci.device_spec                = [] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] pci.report_in_placement        = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] placement.auth_section         = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] placement.auth_type            = password {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] placement.cafile               = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] placement.certfile             = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] placement.collect_timing       = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] placement.connect_retries      = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] placement.connect_retry_delay  = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] placement.default_domain_id    = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] placement.default_domain_name  = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] placement.domain_id            = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] placement.domain_name          = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] placement.endpoint_override    = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] placement.insecure             = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] placement.keyfile              = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] placement.max_version          = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] placement.min_version          = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] placement.password             = **** {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] placement.project_domain_id    = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] placement.project_domain_name  = Default {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] placement.project_id           = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] placement.project_name         = service {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] placement.region_name          = RegionOne {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] placement.service_name         = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] placement.service_type         = placement {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] placement.split_loggers        = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] placement.status_code_retries  = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] placement.status_code_retry_delay = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] placement.system_scope         = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] placement.timeout              = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] placement.trust_id             = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] placement.user_domain_id       = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] placement.user_domain_name     = Default {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] placement.user_id              = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] placement.username             = placement {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] placement.version              = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] quota.cores                    = 20 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] quota.count_usage_from_placement = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] quota.injected_file_content_bytes = 10240 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] quota.injected_file_path_length = 255 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] quota.injected_files           = 5 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] quota.instances                = 10 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] quota.key_pairs                = 100 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] quota.metadata_items           = 128 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] quota.ram                      = 51200 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] quota.recheck_quota            = True {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] quota.server_group_members     = 10 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] quota.server_groups            = 10 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] rdp.enabled                    = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] scheduler.image_metadata_prefilter = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] scheduler.max_attempts         = 3 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] scheduler.max_placement_results = 1000 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] scheduler.query_placement_for_availability_zone = True {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] scheduler.query_placement_for_image_type_support = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] scheduler.workers              = 3 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] filter_scheduler.host_subset_size = 1 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] filter_scheduler.isolated_hosts = [] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] filter_scheduler.isolated_images = [] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] filter_scheduler.pci_in_placement = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] filter_scheduler.track_instance_changes = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] metrics.required               = True {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] metrics.weight_multiplier      = 1.0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] metrics.weight_setting         = [] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] serial_console.enabled         = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] serial_console.port_range      = 10000:20000 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] serial_console.serialproxy_port = 6083 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] service_user.auth_section      = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] service_user.auth_type         = password {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] service_user.cafile            = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] service_user.certfile          = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] service_user.collect_timing    = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] service_user.insecure          = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] service_user.keyfile           = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] service_user.send_service_user_token = True {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] service_user.split_loggers     = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] service_user.timeout           = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] spice.agent_enabled            = True {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] spice.enabled                  = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] spice.html5proxy_port          = 6082 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] spice.image_compression        = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] spice.jpeg_compression         = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] spice.playback_compression     = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] spice.server_listen            = 127.0.0.1 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] spice.streaming_mode           = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] spice.zlib_compression         = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] upgrade_levels.baseapi         = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] upgrade_levels.cert            = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] upgrade_levels.compute         = auto {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] upgrade_levels.conductor       = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] upgrade_levels.scheduler       = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vendordata_dynamic_auth.auth_section = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vendordata_dynamic_auth.auth_type = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vendordata_dynamic_auth.cafile = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vendordata_dynamic_auth.certfile = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vendordata_dynamic_auth.insecure = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vendordata_dynamic_auth.keyfile = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vendordata_dynamic_auth.timeout = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vmware.api_retry_count         = 10 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vmware.ca_file                 = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vmware.cache_prefix            = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vmware.cluster_name            = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vmware.connection_pool_size    = 10 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vmware.console_delay_seconds   = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vmware.datastore_regex         = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vmware.host_ip                 = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vmware.host_password           = **** {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vmware.host_port               = 443 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vmware.host_username           = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vmware.insecure                = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vmware.integration_bridge      = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vmware.maximum_objects         = 100 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vmware.pbm_default_policy      = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vmware.pbm_enabled             = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vmware.pbm_wsdl_location       = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vmware.serial_port_proxy_uri   = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vmware.serial_port_service_uri = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vmware.task_poll_interval      = 0.5 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vmware.use_linked_clone        = True {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vmware.vnc_keymap              = en-us {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vmware.vnc_port                = 5900 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vmware.vnc_port_total          = 10000 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vnc.auth_schemes               = ['none'] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vnc.enabled                    = True {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vnc.novncproxy_port            = 6080 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vnc.server_listen              = 0.0.0.0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vnc.vencrypt_ca_certs          = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vnc.vencrypt_client_cert       = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vnc.vencrypt_client_key        = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] workarounds.disable_rootwrap   = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] workarounds.enable_numa_live_migration = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] workarounds.libvirt_disable_apic = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] wsgi.client_socket_timeout     = 900 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] wsgi.default_pool_size         = 1000 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] wsgi.keep_alive                = True {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] wsgi.max_header_line           = 16384 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] wsgi.ssl_ca_file               = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] wsgi.ssl_cert_file             = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] wsgi.ssl_key_file              = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] wsgi.tcp_keepidle              = 600 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] zvm.ca_file                    = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] zvm.cloud_connector_url        = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] zvm.reachable_timeout          = 300 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_policy.enforce_new_defaults = True {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_policy.enforce_scope      = True {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_policy.policy_default_rule = default {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_policy.policy_file        = policy.yaml {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] profiler.connection_string     = messaging:// {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] profiler.enabled               = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] profiler.es_doc_type           = notification {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] profiler.es_scroll_size        = 10000 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] profiler.es_scroll_time        = 2m {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] profiler.filter_error_trace    = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] profiler.hmac_keys             = **** {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] profiler.sentinel_service_name = mymaster {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] profiler.socket_timeout        = 0.1 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] profiler.trace_requests        = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] profiler.trace_sqlalchemy      = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] profiler_jaeger.process_tags   = {} {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] profiler_jaeger.service_name_prefix = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] profiler_otlp.service_name_prefix = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] remote_debug.host              = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] remote_debug.port              = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_messaging_rabbit.ssl      = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_messaging_notifications.retry = -1 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_limit.auth_section        = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_limit.auth_type           = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_limit.cafile              = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_limit.certfile            = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_limit.collect_timing      = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_limit.connect_retries     = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_limit.connect_retry_delay = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_limit.endpoint_id         = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_limit.endpoint_override   = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_limit.insecure            = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_limit.keyfile             = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_limit.max_version         = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_limit.min_version         = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_limit.region_name         = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_limit.service_name        = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_limit.service_type        = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_limit.split_loggers       = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_limit.status_code_retries = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_limit.status_code_retry_delay = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_limit.timeout             = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_limit.valid_interfaces    = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_limit.version             = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_reports.file_event_handler = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] oslo_reports.log_dir           = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vif_plug_ovs_privileged.group  = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] vif_plug_ovs_privileged.user   = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] os_vif_linux_bridge.flat_interface = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] os_vif_ovs.isolate_vif         = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] os_vif_ovs.per_port_bridge     = False {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] os_brick.lock_path             = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] privsep_osbrick.capabilities   = [21] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] privsep_osbrick.group          = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] privsep_osbrick.helper_command = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] privsep_osbrick.user           = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] nova_sys_admin.group           = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] nova_sys_admin.helper_command  = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] nova_sys_admin.user            = None {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 31 14:39:49 user nova-compute[72239]: DEBUG oslo_service.service [None req-edd8a930-1037-4f0d-8ac8-0c56e0261af8 None None] ******************************************************************************** {{(pid=72239) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Jul 31 14:39:49 user nova-compute[72239]: INFO nova.service [-] Starting compute node (version 0.0.0)
Jul 31 14:39:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Starting native event thread {{(pid=72239) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Jul 31 14:39:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Starting green dispatch thread {{(pid=72239) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Jul 31 14:39:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Starting connection event dispatch thread {{(pid=72239) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Jul 31 14:39:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Connecting to libvirt: qemu:///system {{(pid=72239) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Jul 31 14:39:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f4122abf7c0> {{(pid=72239) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Jul 31 14:39:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f4122abf7c0> {{(pid=72239) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Jul 31 14:39:50 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Connection event '1' reason 'None'
Jul 31 14:39:50 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Jul 31 14:39:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.mount [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Initialising _HostMountState generation 0 {{(pid=72239) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Jul 31 14:39:57 user nova-compute[72239]: INFO nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Libvirt host capabilities <capabilities>
Jul 31 14:39:57 user nova-compute[72239]:   <host>
Jul 31 14:39:57 user nova-compute[72239]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Jul 31 14:39:57 user nova-compute[72239]:     <cpu>
Jul 31 14:39:57 user nova-compute[72239]:       <arch>x86_64</arch>
Jul 31 14:39:57 user nova-compute[72239]:       <model>IvyBridge-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <vendor>Intel</vendor>
Jul 31 14:39:57 user nova-compute[72239]:       <microcode version='1070'/>
Jul 31 14:39:57 user nova-compute[72239]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Jul 31 14:39:57 user nova-compute[72239]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature name='ss'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature name='vmx'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature name='pcid'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature name='osxsave'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature name='hypervisor'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature name='arat'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature name='tsc_adjust'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature name='md-clear'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature name='stibp'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature name='arch-capabilities'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature name='ssbd'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature name='invtsc'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature name='rsba'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature name='skip-l1dfl-vmentry'/>
Jul 31 14:39:57 user nova-compute[72239]:       <pages unit='KiB' size='4'/>
Jul 31 14:39:57 user nova-compute[72239]:       <pages unit='KiB' size='2048'/>
Jul 31 14:39:57 user nova-compute[72239]:     </cpu>
Jul 31 14:39:57 user nova-compute[72239]:     <power_management>
Jul 31 14:39:57 user nova-compute[72239]:       <suspend_mem/>
Jul 31 14:39:57 user nova-compute[72239]:       <suspend_disk/>
Jul 31 14:39:57 user nova-compute[72239]:       <suspend_hybrid/>
Jul 31 14:39:57 user nova-compute[72239]:     </power_management>
Jul 31 14:39:57 user nova-compute[72239]:     <iommu support='no'/>
Jul 31 14:39:57 user nova-compute[72239]:     <migration_features>
Jul 31 14:39:57 user nova-compute[72239]:       <live/>
Jul 31 14:39:57 user nova-compute[72239]:       <uri_transports>
Jul 31 14:39:57 user nova-compute[72239]:         <uri_transport>tcp</uri_transport>
Jul 31 14:39:57 user nova-compute[72239]:         <uri_transport>rdma</uri_transport>
Jul 31 14:39:57 user nova-compute[72239]:       </uri_transports>
Jul 31 14:39:57 user nova-compute[72239]:     </migration_features>
Jul 31 14:39:57 user nova-compute[72239]:     <topology>
Jul 31 14:39:57 user nova-compute[72239]:       <cells num='2'>
Jul 31 14:39:57 user nova-compute[72239]:         <cell id='0'>
Jul 31 14:39:57 user nova-compute[72239]:           <memory unit='KiB'>8140616</memory>
Jul 31 14:39:57 user nova-compute[72239]:           <pages unit='KiB' size='4'>2035154</pages>
Jul 31 14:39:57 user nova-compute[72239]:           <pages unit='KiB' size='2048'>0</pages>
Jul 31 14:39:57 user nova-compute[72239]:           <distances>
Jul 31 14:39:57 user nova-compute[72239]:             <sibling id='0' value='10'/>
Jul 31 14:39:57 user nova-compute[72239]:             <sibling id='1' value='20'/>
Jul 31 14:39:57 user nova-compute[72239]:           </distances>
Jul 31 14:39:57 user nova-compute[72239]:           <cpus num='6'>
Jul 31 14:39:57 user nova-compute[72239]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Jul 31 14:39:57 user nova-compute[72239]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Jul 31 14:39:57 user nova-compute[72239]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Jul 31 14:39:57 user nova-compute[72239]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Jul 31 14:39:57 user nova-compute[72239]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Jul 31 14:39:57 user nova-compute[72239]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Jul 31 14:39:57 user nova-compute[72239]:           </cpus>
Jul 31 14:39:57 user nova-compute[72239]:         </cell>
Jul 31 14:39:57 user nova-compute[72239]:         <cell id='1'>
Jul 31 14:39:57 user nova-compute[72239]:           <memory unit='KiB'>8255068</memory>
Jul 31 14:39:57 user nova-compute[72239]:           <pages unit='KiB' size='4'>2063767</pages>
Jul 31 14:39:57 user nova-compute[72239]:           <pages unit='KiB' size='2048'>0</pages>
Jul 31 14:39:57 user nova-compute[72239]:           <distances>
Jul 31 14:39:57 user nova-compute[72239]:             <sibling id='0' value='20'/>
Jul 31 14:39:57 user nova-compute[72239]:             <sibling id='1' value='10'/>
Jul 31 14:39:57 user nova-compute[72239]:           </distances>
Jul 31 14:39:57 user nova-compute[72239]:           <cpus num='6'>
Jul 31 14:39:57 user nova-compute[72239]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Jul 31 14:39:57 user nova-compute[72239]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Jul 31 14:39:57 user nova-compute[72239]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Jul 31 14:39:57 user nova-compute[72239]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Jul 31 14:39:57 user nova-compute[72239]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Jul 31 14:39:57 user nova-compute[72239]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Jul 31 14:39:57 user nova-compute[72239]:           </cpus>
Jul 31 14:39:57 user nova-compute[72239]:         </cell>
Jul 31 14:39:57 user nova-compute[72239]:       </cells>
Jul 31 14:39:57 user nova-compute[72239]:     </topology>
Jul 31 14:39:57 user nova-compute[72239]:     <cache>
Jul 31 14:39:57 user nova-compute[72239]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Jul 31 14:39:57 user nova-compute[72239]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Jul 31 14:39:57 user nova-compute[72239]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Jul 31 14:39:57 user nova-compute[72239]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Jul 31 14:39:57 user nova-compute[72239]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Jul 31 14:39:57 user nova-compute[72239]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Jul 31 14:39:57 user nova-compute[72239]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Jul 31 14:39:57 user nova-compute[72239]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Jul 31 14:39:57 user nova-compute[72239]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Jul 31 14:39:57 user nova-compute[72239]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Jul 31 14:39:57 user nova-compute[72239]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Jul 31 14:39:57 user nova-compute[72239]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Jul 31 14:39:57 user nova-compute[72239]:     </cache>
Jul 31 14:39:57 user nova-compute[72239]:     <secmodel>
Jul 31 14:39:57 user nova-compute[72239]:       <model>apparmor</model>
Jul 31 14:39:57 user nova-compute[72239]:       <doi>0</doi>
Jul 31 14:39:57 user nova-compute[72239]:     </secmodel>
Jul 31 14:39:57 user nova-compute[72239]:     <secmodel>
Jul 31 14:39:57 user nova-compute[72239]:       <model>dac</model>
Jul 31 14:39:57 user nova-compute[72239]:       <doi>0</doi>
Jul 31 14:39:57 user nova-compute[72239]:       <baselabel type='kvm'>+64055:+108</baselabel>
Jul 31 14:39:57 user nova-compute[72239]:       <baselabel type='qemu'>+64055:+108</baselabel>
Jul 31 14:39:57 user nova-compute[72239]:     </secmodel>
Jul 31 14:39:57 user nova-compute[72239]:   </host>
Jul 31 14:39:57 user nova-compute[72239]:   <guest>
Jul 31 14:39:57 user nova-compute[72239]:     <os_type>hvm</os_type>
Jul 31 14:39:57 user nova-compute[72239]:     <arch name='alpha'>
Jul 31 14:39:57 user nova-compute[72239]:       <wordsize>64</wordsize>
Jul 31 14:39:57 user nova-compute[72239]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='4'>clipper</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <domain type='qemu'/>
Jul 31 14:39:57 user nova-compute[72239]:     </arch>
Jul 31 14:39:57 user nova-compute[72239]:     <features>
Jul 31 14:39:57 user nova-compute[72239]:       <cpuselection/>
Jul 31 14:39:57 user nova-compute[72239]:       <deviceboot/>
Jul 31 14:39:57 user nova-compute[72239]:       <disksnapshot default='on' toggle='no'/>
Jul 31 14:39:57 user nova-compute[72239]:     </features>
Jul 31 14:39:57 user nova-compute[72239]:   </guest>
Jul 31 14:39:57 user nova-compute[72239]:   <guest>
Jul 31 14:39:57 user nova-compute[72239]:     <os_type>hvm</os_type>
Jul 31 14:39:57 user nova-compute[72239]:     <arch name='armv6l'>
Jul 31 14:39:57 user nova-compute[72239]:       <wordsize>32</wordsize>
Jul 31 14:39:57 user nova-compute[72239]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>integratorcp</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>borzoi</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>spitz</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>nuri</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>musca-b1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>versatileab</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>kzm</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>musca-a</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>smdkc210</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>sx1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>z2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>tosa</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='4'>sabrelite</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>realview-eb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>n810</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>n800</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>versatilepb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>terrier</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>mainstone</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='4'>midway</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>musicpal</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>microbit</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>cubieboard</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>verdex</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>netduino2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='4'>raspi2b</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>cheetah</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='4'>highbank</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>akita</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>connex</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>collie</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>raspi0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <domain type='qemu'/>
Jul 31 14:39:57 user nova-compute[72239]:     </arch>
Jul 31 14:39:57 user nova-compute[72239]:     <features>
Jul 31 14:39:57 user nova-compute[72239]:       <cpuselection/>
Jul 31 14:39:57 user nova-compute[72239]:       <deviceboot/>
Jul 31 14:39:57 user nova-compute[72239]:       <disksnapshot default='on' toggle='no'/>
Jul 31 14:39:57 user nova-compute[72239]:     </features>
Jul 31 14:39:57 user nova-compute[72239]:   </guest>
Jul 31 14:39:57 user nova-compute[72239]:   <guest>
Jul 31 14:39:57 user nova-compute[72239]:     <os_type>hvm</os_type>
Jul 31 14:39:57 user nova-compute[72239]:     <arch name='armv7l'>
Jul 31 14:39:57 user nova-compute[72239]:       <wordsize>32</wordsize>
Jul 31 14:39:57 user nova-compute[72239]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>integratorcp</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>borzoi</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>spitz</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>nuri</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>musca-b1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>versatileab</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>kzm</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>musca-a</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>smdkc210</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>sx1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>z2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>tosa</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='4'>sabrelite</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>realview-eb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>n810</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>n800</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>versatilepb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>terrier</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>mainstone</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='4'>midway</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>musicpal</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>microbit</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>cubieboard</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>verdex</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>netduino2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='4'>raspi2b</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>cheetah</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='4'>highbank</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>akita</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>connex</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>collie</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>raspi0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <domain type='qemu'/>
Jul 31 14:39:57 user nova-compute[72239]:     </arch>
Jul 31 14:39:57 user nova-compute[72239]:     <features>
Jul 31 14:39:57 user nova-compute[72239]:       <cpuselection/>
Jul 31 14:39:57 user nova-compute[72239]:       <deviceboot/>
Jul 31 14:39:57 user nova-compute[72239]:       <disksnapshot default='on' toggle='no'/>
Jul 31 14:39:57 user nova-compute[72239]:     </features>
Jul 31 14:39:57 user nova-compute[72239]:   </guest>
Jul 31 14:39:57 user nova-compute[72239]:   <guest>
Jul 31 14:39:57 user nova-compute[72239]:     <os_type>hvm</os_type>
Jul 31 14:39:57 user nova-compute[72239]:     <arch name='aarch64'>
Jul 31 14:39:57 user nova-compute[72239]:       <wordsize>64</wordsize>
Jul 31 14:39:57 user nova-compute[72239]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>integratorcp</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>borzoi</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>spitz</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>nuri</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>musca-b1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>versatileab</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>kzm</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>musca-a</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>smdkc210</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>sx1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>z2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>tosa</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='4'>sabrelite</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>realview-eb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='512'>sbsa-ref</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>n810</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>n800</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>versatilepb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>terrier</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>mainstone</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='4'>midway</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>musicpal</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>microbit</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='4'>raspi3ap</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>cubieboard</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>verdex</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>netduino2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='4'>raspi3b</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='4'>raspi2b</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>cheetah</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='4'>highbank</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>akita</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>connex</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>collie</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>raspi0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <domain type='qemu'/>
Jul 31 14:39:57 user nova-compute[72239]:     </arch>
Jul 31 14:39:57 user nova-compute[72239]:     <features>
Jul 31 14:39:57 user nova-compute[72239]:       <acpi default='on' toggle='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:       <cpuselection/>
Jul 31 14:39:57 user nova-compute[72239]:       <deviceboot/>
Jul 31 14:39:57 user nova-compute[72239]:       <disksnapshot default='on' toggle='no'/>
Jul 31 14:39:57 user nova-compute[72239]:     </features>
Jul 31 14:39:57 user nova-compute[72239]:   </guest>
Jul 31 14:39:57 user nova-compute[72239]:   <guest>
Jul 31 14:39:57 user nova-compute[72239]:     <os_type>hvm</os_type>
Jul 31 14:39:57 user nova-compute[72239]:     <arch name='cris'>
Jul 31 14:39:57 user nova-compute[72239]:       <wordsize>32</wordsize>
Jul 31 14:39:57 user nova-compute[72239]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>axis-dev88</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <domain type='qemu'/>
Jul 31 14:39:57 user nova-compute[72239]:     </arch>
Jul 31 14:39:57 user nova-compute[72239]:     <features>
Jul 31 14:39:57 user nova-compute[72239]:       <cpuselection/>
Jul 31 14:39:57 user nova-compute[72239]:       <deviceboot/>
Jul 31 14:39:57 user nova-compute[72239]:       <disksnapshot default='on' toggle='no'/>
Jul 31 14:39:57 user nova-compute[72239]:     </features>
Jul 31 14:39:57 user nova-compute[72239]:   </guest>
Jul 31 14:39:57 user nova-compute[72239]:   <guest>
Jul 31 14:39:57 user nova-compute[72239]:     <os_type>hvm</os_type>
Jul 31 14:39:57 user nova-compute[72239]:     <arch name='i686'>
Jul 31 14:39:57 user nova-compute[72239]:       <wordsize>32</wordsize>
Jul 31 14:39:57 user nova-compute[72239]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>x-remote</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>isapc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>microvm</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <domain type='qemu'/>
Jul 31 14:39:57 user nova-compute[72239]:       <domain type='kvm'/>
Jul 31 14:39:57 user nova-compute[72239]:     </arch>
Jul 31 14:39:57 user nova-compute[72239]:     <features>
Jul 31 14:39:57 user nova-compute[72239]:       <pae/>
Jul 31 14:39:57 user nova-compute[72239]:       <nonpae/>
Jul 31 14:39:57 user nova-compute[72239]:       <acpi default='on' toggle='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:       <apic default='on' toggle='no'/>
Jul 31 14:39:57 user nova-compute[72239]:       <cpuselection/>
Jul 31 14:39:57 user nova-compute[72239]:       <deviceboot/>
Jul 31 14:39:57 user nova-compute[72239]:       <disksnapshot default='on' toggle='no'/>
Jul 31 14:39:57 user nova-compute[72239]:     </features>
Jul 31 14:39:57 user nova-compute[72239]:   </guest>
Jul 31 14:39:57 user nova-compute[72239]:   <guest>
Jul 31 14:39:57 user nova-compute[72239]:     <os_type>hvm</os_type>
Jul 31 14:39:57 user nova-compute[72239]:     <arch name='m68k'>
Jul 31 14:39:57 user nova-compute[72239]:       <wordsize>32</wordsize>
Jul 31 14:39:57 user nova-compute[72239]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>mcf5208evb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>an5206</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>virt-6.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>q800</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>virt-6.2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>next-cube</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>virt-6.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <domain type='qemu'/>
Jul 31 14:39:57 user nova-compute[72239]:     </arch>
Jul 31 14:39:57 user nova-compute[72239]:     <features>
Jul 31 14:39:57 user nova-compute[72239]:       <cpuselection/>
Jul 31 14:39:57 user nova-compute[72239]:       <deviceboot/>
Jul 31 14:39:57 user nova-compute[72239]:       <disksnapshot default='on' toggle='no'/>
Jul 31 14:39:57 user nova-compute[72239]:     </features>
Jul 31 14:39:57 user nova-compute[72239]:   </guest>
Jul 31 14:39:57 user nova-compute[72239]:   <guest>
Jul 31 14:39:57 user nova-compute[72239]:     <os_type>hvm</os_type>
Jul 31 14:39:57 user nova-compute[72239]:     <arch name='microblaze'>
Jul 31 14:39:57 user nova-compute[72239]:       <wordsize>32</wordsize>
Jul 31 14:39:57 user nova-compute[72239]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <domain type='qemu'/>
Jul 31 14:39:57 user nova-compute[72239]:     </arch>
Jul 31 14:39:57 user nova-compute[72239]:     <features>
Jul 31 14:39:57 user nova-compute[72239]:       <cpuselection/>
Jul 31 14:39:57 user nova-compute[72239]:       <deviceboot/>
Jul 31 14:39:57 user nova-compute[72239]:       <disksnapshot default='on' toggle='no'/>
Jul 31 14:39:57 user nova-compute[72239]:     </features>
Jul 31 14:39:57 user nova-compute[72239]:   </guest>
Jul 31 14:39:57 user nova-compute[72239]:   <guest>
Jul 31 14:39:57 user nova-compute[72239]:     <os_type>hvm</os_type>
Jul 31 14:39:57 user nova-compute[72239]:     <arch name='microblazeel'>
Jul 31 14:39:57 user nova-compute[72239]:       <wordsize>32</wordsize>
Jul 31 14:39:57 user nova-compute[72239]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <domain type='qemu'/>
Jul 31 14:39:57 user nova-compute[72239]:     </arch>
Jul 31 14:39:57 user nova-compute[72239]:     <features>
Jul 31 14:39:57 user nova-compute[72239]:       <cpuselection/>
Jul 31 14:39:57 user nova-compute[72239]:       <deviceboot/>
Jul 31 14:39:57 user nova-compute[72239]:       <disksnapshot default='on' toggle='no'/>
Jul 31 14:39:57 user nova-compute[72239]:     </features>
Jul 31 14:39:57 user nova-compute[72239]:   </guest>
Jul 31 14:39:57 user nova-compute[72239]:   <guest>
Jul 31 14:39:57 user nova-compute[72239]:     <os_type>hvm</os_type>
Jul 31 14:39:57 user nova-compute[72239]:     <arch name='mips'>
Jul 31 14:39:57 user nova-compute[72239]:       <wordsize>32</wordsize>
Jul 31 14:39:57 user nova-compute[72239]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='16'>malta</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>mipssim</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <domain type='qemu'/>
Jul 31 14:39:57 user nova-compute[72239]:     </arch>
Jul 31 14:39:57 user nova-compute[72239]:     <features>
Jul 31 14:39:57 user nova-compute[72239]:       <cpuselection/>
Jul 31 14:39:57 user nova-compute[72239]:       <deviceboot/>
Jul 31 14:39:57 user nova-compute[72239]:       <disksnapshot default='on' toggle='no'/>
Jul 31 14:39:57 user nova-compute[72239]:     </features>
Jul 31 14:39:57 user nova-compute[72239]:   </guest>
Jul 31 14:39:57 user nova-compute[72239]:   <guest>
Jul 31 14:39:57 user nova-compute[72239]:     <os_type>hvm</os_type>
Jul 31 14:39:57 user nova-compute[72239]:     <arch name='mipsel'>
Jul 31 14:39:57 user nova-compute[72239]:       <wordsize>32</wordsize>
Jul 31 14:39:57 user nova-compute[72239]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='16'>malta</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>mipssim</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <domain type='qemu'/>
Jul 31 14:39:57 user nova-compute[72239]:     </arch>
Jul 31 14:39:57 user nova-compute[72239]:     <features>
Jul 31 14:39:57 user nova-compute[72239]:       <cpuselection/>
Jul 31 14:39:57 user nova-compute[72239]:       <deviceboot/>
Jul 31 14:39:57 user nova-compute[72239]:       <disksnapshot default='on' toggle='no'/>
Jul 31 14:39:57 user nova-compute[72239]:     </features>
Jul 31 14:39:57 user nova-compute[72239]:   </guest>
Jul 31 14:39:57 user nova-compute[72239]:   <guest>
Jul 31 14:39:57 user nova-compute[72239]:     <os_type>hvm</os_type>
Jul 31 14:39:57 user nova-compute[72239]:     <arch name='mips64'>
Jul 31 14:39:57 user nova-compute[72239]:       <wordsize>64</wordsize>
Jul 31 14:39:57 user nova-compute[72239]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='16'>malta</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>mipssim</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>pica61</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>magnum</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <domain type='qemu'/>
Jul 31 14:39:57 user nova-compute[72239]:     </arch>
Jul 31 14:39:57 user nova-compute[72239]:     <features>
Jul 31 14:39:57 user nova-compute[72239]:       <cpuselection/>
Jul 31 14:39:57 user nova-compute[72239]:       <deviceboot/>
Jul 31 14:39:57 user nova-compute[72239]:       <disksnapshot default='on' toggle='no'/>
Jul 31 14:39:57 user nova-compute[72239]:     </features>
Jul 31 14:39:57 user nova-compute[72239]:   </guest>
Jul 31 14:39:57 user nova-compute[72239]:   <guest>
Jul 31 14:39:57 user nova-compute[72239]:     <os_type>hvm</os_type>
Jul 31 14:39:57 user nova-compute[72239]:     <arch name='mips64el'>
Jul 31 14:39:57 user nova-compute[72239]:       <wordsize>64</wordsize>
Jul 31 14:39:57 user nova-compute[72239]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='16'>malta</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='16'>loongson3-virt</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>mipssim</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>pica61</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>magnum</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='16'>boston</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>fuloong2e</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <domain type='qemu'/>
Jul 31 14:39:57 user nova-compute[72239]:     </arch>
Jul 31 14:39:57 user nova-compute[72239]:     <features>
Jul 31 14:39:57 user nova-compute[72239]:       <cpuselection/>
Jul 31 14:39:57 user nova-compute[72239]:       <deviceboot/>
Jul 31 14:39:57 user nova-compute[72239]:       <disksnapshot default='on' toggle='no'/>
Jul 31 14:39:57 user nova-compute[72239]:     </features>
Jul 31 14:39:57 user nova-compute[72239]:   </guest>
Jul 31 14:39:57 user nova-compute[72239]:   <guest>
Jul 31 14:39:57 user nova-compute[72239]:     <os_type>hvm</os_type>
Jul 31 14:39:57 user nova-compute[72239]:     <arch name='ppc'>
Jul 31 14:39:57 user nova-compute[72239]:       <wordsize>32</wordsize>
Jul 31 14:39:57 user nova-compute[72239]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>g3beige</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>mac99</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='32'>ppce500</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>pegasos2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>sam460ex</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>bamboo</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>40p</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>ref405ep</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>taihu</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <domain type='qemu'/>
Jul 31 14:39:57 user nova-compute[72239]:     </arch>
Jul 31 14:39:57 user nova-compute[72239]:     <features>
Jul 31 14:39:57 user nova-compute[72239]:       <cpuselection/>
Jul 31 14:39:57 user nova-compute[72239]:       <deviceboot/>
Jul 31 14:39:57 user nova-compute[72239]:       <disksnapshot default='on' toggle='no'/>
Jul 31 14:39:57 user nova-compute[72239]:     </features>
Jul 31 14:39:57 user nova-compute[72239]:   </guest>
Jul 31 14:39:57 user nova-compute[72239]:   <guest>
Jul 31 14:39:57 user nova-compute[72239]:     <os_type>hvm</os_type>
Jul 31 14:39:57 user nova-compute[72239]:     <arch name='ppc64'>
Jul 31 14:39:57 user nova-compute[72239]:       <wordsize>64</wordsize>
Jul 31 14:39:57 user nova-compute[72239]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2048'>powernv9</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>taihu</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2048'>powernv10</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='32'>ppce500</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>40p</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>pegasos2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>bamboo</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>g3beige</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>mac99</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>sam460ex</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>ref405ep</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2048'>powernv8</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <domain type='qemu'/>
Jul 31 14:39:57 user nova-compute[72239]:     </arch>
Jul 31 14:39:57 user nova-compute[72239]:     <features>
Jul 31 14:39:57 user nova-compute[72239]:       <cpuselection/>
Jul 31 14:39:57 user nova-compute[72239]:       <deviceboot/>
Jul 31 14:39:57 user nova-compute[72239]:       <disksnapshot default='on' toggle='no'/>
Jul 31 14:39:57 user nova-compute[72239]:     </features>
Jul 31 14:39:57 user nova-compute[72239]:   </guest>
Jul 31 14:39:57 user nova-compute[72239]:   <guest>
Jul 31 14:39:57 user nova-compute[72239]:     <os_type>hvm</os_type>
Jul 31 14:39:57 user nova-compute[72239]:     <arch name='ppc64le'>
Jul 31 14:39:57 user nova-compute[72239]:       <wordsize>64</wordsize>
Jul 31 14:39:57 user nova-compute[72239]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2048'>powernv9</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>taihu</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2048'>powernv10</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='32'>ppce500</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>40p</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>pegasos2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>bamboo</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>g3beige</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>mac99</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>sam460ex</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>ref405ep</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2048'>powernv8</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <domain type='qemu'/>
Jul 31 14:39:57 user nova-compute[72239]:     </arch>
Jul 31 14:39:57 user nova-compute[72239]:     <features>
Jul 31 14:39:57 user nova-compute[72239]:       <cpuselection/>
Jul 31 14:39:57 user nova-compute[72239]:       <deviceboot/>
Jul 31 14:39:57 user nova-compute[72239]:       <disksnapshot default='on' toggle='no'/>
Jul 31 14:39:57 user nova-compute[72239]:     </features>
Jul 31 14:39:57 user nova-compute[72239]:   </guest>
Jul 31 14:39:57 user nova-compute[72239]:   <guest>
Jul 31 14:39:57 user nova-compute[72239]:     <os_type>hvm</os_type>
Jul 31 14:39:57 user nova-compute[72239]:     <arch name='riscv32'>
Jul 31 14:39:57 user nova-compute[72239]:       <wordsize>32</wordsize>
Jul 31 14:39:57 user nova-compute[72239]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='8'>spike</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>opentitan</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='5'>sifive_u</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>sifive_e</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='8'>virt</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <domain type='qemu'/>
Jul 31 14:39:57 user nova-compute[72239]:     </arch>
Jul 31 14:39:57 user nova-compute[72239]:     <features>
Jul 31 14:39:57 user nova-compute[72239]:       <cpuselection/>
Jul 31 14:39:57 user nova-compute[72239]:       <deviceboot/>
Jul 31 14:39:57 user nova-compute[72239]:       <disksnapshot default='on' toggle='no'/>
Jul 31 14:39:57 user nova-compute[72239]:     </features>
Jul 31 14:39:57 user nova-compute[72239]:   </guest>
Jul 31 14:39:57 user nova-compute[72239]:   <guest>
Jul 31 14:39:57 user nova-compute[72239]:     <os_type>hvm</os_type>
Jul 31 14:39:57 user nova-compute[72239]:     <arch name='riscv64'>
Jul 31 14:39:57 user nova-compute[72239]:       <wordsize>64</wordsize>
Jul 31 14:39:57 user nova-compute[72239]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='8'>spike</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='5'>sifive_u</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>shakti_c</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>sifive_e</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='8'>virt</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <domain type='qemu'/>
Jul 31 14:39:57 user nova-compute[72239]:     </arch>
Jul 31 14:39:57 user nova-compute[72239]:     <features>
Jul 31 14:39:57 user nova-compute[72239]:       <cpuselection/>
Jul 31 14:39:57 user nova-compute[72239]:       <deviceboot/>
Jul 31 14:39:57 user nova-compute[72239]:       <disksnapshot default='on' toggle='no'/>
Jul 31 14:39:57 user nova-compute[72239]:     </features>
Jul 31 14:39:57 user nova-compute[72239]:   </guest>
Jul 31 14:39:57 user nova-compute[72239]:   <guest>
Jul 31 14:39:57 user nova-compute[72239]:     <os_type>hvm</os_type>
Jul 31 14:39:57 user nova-compute[72239]:     <arch name='s390x'>
Jul 31 14:39:57 user nova-compute[72239]:       <wordsize>64</wordsize>
Jul 31 14:39:57 user nova-compute[72239]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <domain type='qemu'/>
Jul 31 14:39:57 user nova-compute[72239]:     </arch>
Jul 31 14:39:57 user nova-compute[72239]:     <features>
Jul 31 14:39:57 user nova-compute[72239]:       <cpuselection/>
Jul 31 14:39:57 user nova-compute[72239]:       <deviceboot/>
Jul 31 14:39:57 user nova-compute[72239]:       <disksnapshot default='on' toggle='no'/>
Jul 31 14:39:57 user nova-compute[72239]:     </features>
Jul 31 14:39:57 user nova-compute[72239]:   </guest>
Jul 31 14:39:57 user nova-compute[72239]:   <guest>
Jul 31 14:39:57 user nova-compute[72239]:     <os_type>hvm</os_type>
Jul 31 14:39:57 user nova-compute[72239]:     <arch name='sh4'>
Jul 31 14:39:57 user nova-compute[72239]:       <wordsize>32</wordsize>
Jul 31 14:39:57 user nova-compute[72239]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>shix</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>r2d</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <domain type='qemu'/>
Jul 31 14:39:57 user nova-compute[72239]:     </arch>
Jul 31 14:39:57 user nova-compute[72239]:     <features>
Jul 31 14:39:57 user nova-compute[72239]:       <cpuselection/>
Jul 31 14:39:57 user nova-compute[72239]:       <deviceboot/>
Jul 31 14:39:57 user nova-compute[72239]:       <disksnapshot default='on' toggle='no'/>
Jul 31 14:39:57 user nova-compute[72239]:     </features>
Jul 31 14:39:57 user nova-compute[72239]:   </guest>
Jul 31 14:39:57 user nova-compute[72239]:   <guest>
Jul 31 14:39:57 user nova-compute[72239]:     <os_type>hvm</os_type>
Jul 31 14:39:57 user nova-compute[72239]:     <arch name='sh4eb'>
Jul 31 14:39:57 user nova-compute[72239]:       <wordsize>64</wordsize>
Jul 31 14:39:57 user nova-compute[72239]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>shix</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>r2d</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <domain type='qemu'/>
Jul 31 14:39:57 user nova-compute[72239]:     </arch>
Jul 31 14:39:57 user nova-compute[72239]:     <features>
Jul 31 14:39:57 user nova-compute[72239]:       <cpuselection/>
Jul 31 14:39:57 user nova-compute[72239]:       <deviceboot/>
Jul 31 14:39:57 user nova-compute[72239]:       <disksnapshot default='on' toggle='no'/>
Jul 31 14:39:57 user nova-compute[72239]:     </features>
Jul 31 14:39:57 user nova-compute[72239]:   </guest>
Jul 31 14:39:57 user nova-compute[72239]:   <guest>
Jul 31 14:39:57 user nova-compute[72239]:     <os_type>hvm</os_type>
Jul 31 14:39:57 user nova-compute[72239]:     <arch name='sparc'>
Jul 31 14:39:57 user nova-compute[72239]:       <wordsize>32</wordsize>
Jul 31 14:39:57 user nova-compute[72239]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>SS-5</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='4'>SS-20</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>LX</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>SPARCClassic</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>leon3_generic</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>SPARCbook</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>SS-4</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='4'>SS-600MP</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='4'>SS-10</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>Voyager</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <domain type='qemu'/>
Jul 31 14:39:57 user nova-compute[72239]:     </arch>
Jul 31 14:39:57 user nova-compute[72239]:     <features>
Jul 31 14:39:57 user nova-compute[72239]:       <cpuselection/>
Jul 31 14:39:57 user nova-compute[72239]:       <deviceboot/>
Jul 31 14:39:57 user nova-compute[72239]:       <disksnapshot default='on' toggle='no'/>
Jul 31 14:39:57 user nova-compute[72239]:     </features>
Jul 31 14:39:57 user nova-compute[72239]:   </guest>
Jul 31 14:39:57 user nova-compute[72239]:   <guest>
Jul 31 14:39:57 user nova-compute[72239]:     <os_type>hvm</os_type>
Jul 31 14:39:57 user nova-compute[72239]:     <arch name='sparc64'>
Jul 31 14:39:57 user nova-compute[72239]:       <wordsize>64</wordsize>
Jul 31 14:39:57 user nova-compute[72239]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>sun4u</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>niagara</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>sun4v</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <domain type='qemu'/>
Jul 31 14:39:57 user nova-compute[72239]:     </arch>
Jul 31 14:39:57 user nova-compute[72239]:     <features>
Jul 31 14:39:57 user nova-compute[72239]:       <cpuselection/>
Jul 31 14:39:57 user nova-compute[72239]:       <deviceboot/>
Jul 31 14:39:57 user nova-compute[72239]:       <disksnapshot default='on' toggle='no'/>
Jul 31 14:39:57 user nova-compute[72239]:     </features>
Jul 31 14:39:57 user nova-compute[72239]:   </guest>
Jul 31 14:39:57 user nova-compute[72239]:   <guest>
Jul 31 14:39:57 user nova-compute[72239]:     <os_type>hvm</os_type>
Jul 31 14:39:57 user nova-compute[72239]:     <arch name='x86_64'>
Jul 31 14:39:57 user nova-compute[72239]:       <wordsize>64</wordsize>
Jul 31 14:39:57 user nova-compute[72239]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>x-remote</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='1'>isapc</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>microvm</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <domain type='qemu'/>
Jul 31 14:39:57 user nova-compute[72239]:       <domain type='kvm'/>
Jul 31 14:39:57 user nova-compute[72239]:     </arch>
Jul 31 14:39:57 user nova-compute[72239]:     <features>
Jul 31 14:39:57 user nova-compute[72239]:       <acpi default='on' toggle='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:       <apic default='on' toggle='no'/>
Jul 31 14:39:57 user nova-compute[72239]:       <cpuselection/>
Jul 31 14:39:57 user nova-compute[72239]:       <deviceboot/>
Jul 31 14:39:57 user nova-compute[72239]:       <disksnapshot default='on' toggle='no'/>
Jul 31 14:39:57 user nova-compute[72239]:     </features>
Jul 31 14:39:57 user nova-compute[72239]:   </guest>
Jul 31 14:39:57 user nova-compute[72239]:   <guest>
Jul 31 14:39:57 user nova-compute[72239]:     <os_type>hvm</os_type>
Jul 31 14:39:57 user nova-compute[72239]:     <arch name='xtensa'>
Jul 31 14:39:57 user nova-compute[72239]:       <wordsize>32</wordsize>
Jul 31 14:39:57 user nova-compute[72239]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='4'>sim</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='32'>kc705</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='32'>ml605</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='32'>ml605-nommu</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='32'>virt</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='32'>lx60-nommu</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='32'>lx200</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='32'>lx200-nommu</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='32'>lx60</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='32'>kc705-nommu</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <domain type='qemu'/>
Jul 31 14:39:57 user nova-compute[72239]:     </arch>
Jul 31 14:39:57 user nova-compute[72239]:     <features>
Jul 31 14:39:57 user nova-compute[72239]:       <cpuselection/>
Jul 31 14:39:57 user nova-compute[72239]:       <deviceboot/>
Jul 31 14:39:57 user nova-compute[72239]:       <disksnapshot default='on' toggle='no'/>
Jul 31 14:39:57 user nova-compute[72239]:     </features>
Jul 31 14:39:57 user nova-compute[72239]:   </guest>
Jul 31 14:39:57 user nova-compute[72239]:   <guest>
Jul 31 14:39:57 user nova-compute[72239]:     <os_type>hvm</os_type>
Jul 31 14:39:57 user nova-compute[72239]:     <arch name='xtensaeb'>
Jul 31 14:39:57 user nova-compute[72239]:       <wordsize>32</wordsize>
Jul 31 14:39:57 user nova-compute[72239]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='4'>sim</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='32'>kc705</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='32'>ml605</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='32'>ml605-nommu</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='32'>virt</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='32'>lx60-nommu</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='32'>lx200</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='32'>lx200-nommu</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='32'>lx60</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <machine maxCpus='32'>kc705-nommu</machine>
Jul 31 14:39:57 user nova-compute[72239]:       <domain type='qemu'/>
Jul 31 14:39:57 user nova-compute[72239]:     </arch>
Jul 31 14:39:57 user nova-compute[72239]:     <features>
Jul 31 14:39:57 user nova-compute[72239]:       <cpuselection/>
Jul 31 14:39:57 user nova-compute[72239]:       <deviceboot/>
Jul 31 14:39:57 user nova-compute[72239]:       <disksnapshot default='on' toggle='no'/>
Jul 31 14:39:57 user nova-compute[72239]:     </features>
Jul 31 14:39:57 user nova-compute[72239]:   </guest>
Jul 31 14:39:57 user nova-compute[72239]: </capabilities>
Jul 31 14:39:57 user nova-compute[72239]: 
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=72239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=72239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=72239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=72239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=72239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=72239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=72239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=72239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=72239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'ubuntu-q35', 'pc', 'q35'} {{(pid=72239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Jul 31 14:39:57 user nova-compute[72239]: <domainCapabilities>
Jul 31 14:39:57 user nova-compute[72239]:   <path>/usr/bin/qemu-system-i386</path>
Jul 31 14:39:57 user nova-compute[72239]:   <domain>kvm</domain>
Jul 31 14:39:57 user nova-compute[72239]:   <machine>pc-i440fx-jammy</machine>
Jul 31 14:39:57 user nova-compute[72239]:   <arch>i686</arch>
Jul 31 14:39:57 user nova-compute[72239]:   <vcpu max='255'/>
Jul 31 14:39:57 user nova-compute[72239]:   <iothreads supported='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:   <os supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:     <enum name='firmware'/>
Jul 31 14:39:57 user nova-compute[72239]:     <loader supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 31 14:39:57 user nova-compute[72239]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 31 14:39:57 user nova-compute[72239]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 31 14:39:57 user nova-compute[72239]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 31 14:39:57 user nova-compute[72239]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='type'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>rom</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>pflash</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='readonly'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>yes</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>no</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='secure'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>no</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </loader>
Jul 31 14:39:57 user nova-compute[72239]:   </os>
Jul 31 14:39:57 user nova-compute[72239]:   <cpu>
Jul 31 14:39:57 user nova-compute[72239]:     <mode name='host-passthrough' supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='hostPassthroughMigratable'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>off</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </mode>
Jul 31 14:39:57 user nova-compute[72239]:     <mode name='maximum' supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='maximumMigratable'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>on</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>off</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </mode>
Jul 31 14:39:57 user nova-compute[72239]:     <mode name='host-model' supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <vendor>Intel</vendor>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='ss'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='vmx'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='pcid'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='hypervisor'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='arat'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='tsc_adjust'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='umip'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='md-clear'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='stibp'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='arch-capabilities'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='ssbd'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='ibpb'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='ibrs'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='amd-stibp'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='amd-ssbd'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='disable' name='erms'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='disable' name='xsaveopt'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='disable' name='lm'/>
Jul 31 14:39:57 user nova-compute[72239]:     </mode>
Jul 31 14:39:57 user nova-compute[72239]:     <mode name='custom' supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>qemu64</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>qemu32</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>phenom</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>pentium3</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>pentium2</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>pentium</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>n270</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>kvm64</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>kvm32</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>coreduo</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>core2duo</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>athlon</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Westmere-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Westmere</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Snowridge</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Server</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Client</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>SandyBridge</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Penryn</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Opteron_G5</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Opteron_G4</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Opteron_G3</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Opteron_G2</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Opteron_G1</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Nehalem-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Nehalem</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>IvyBridge</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Icelake-Server</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Haswell-noTSX</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Haswell-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Haswell</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>EPYC-Rome</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>EPYC-Milan</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>EPYC-IBPB</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>EPYC</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Dhyana</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Cooperlake</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Conroe</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Cascadelake-Server</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Broadwell-noTSX</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Broadwell-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Broadwell</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>486</model>
Jul 31 14:39:57 user nova-compute[72239]:     </mode>
Jul 31 14:39:57 user nova-compute[72239]:   </cpu>
Jul 31 14:39:57 user nova-compute[72239]:   <memoryBacking supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:     <enum name='sourceType'>
Jul 31 14:39:57 user nova-compute[72239]:       <value>file</value>
Jul 31 14:39:57 user nova-compute[72239]:       <value>anonymous</value>
Jul 31 14:39:57 user nova-compute[72239]:       <value>memfd</value>
Jul 31 14:39:57 user nova-compute[72239]:     </enum>
Jul 31 14:39:57 user nova-compute[72239]:   </memoryBacking>
Jul 31 14:39:57 user nova-compute[72239]:   <devices>
Jul 31 14:39:57 user nova-compute[72239]:     <disk supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='diskDevice'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>disk</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>cdrom</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>floppy</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>lun</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='bus'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>ide</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>fdc</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>scsi</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>usb</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>sata</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='model'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio-transitional</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio-non-transitional</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </disk>
Jul 31 14:39:57 user nova-compute[72239]:     <graphics supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='type'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>sdl</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>vnc</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>spice</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>egl-headless</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </graphics>
Jul 31 14:39:57 user nova-compute[72239]:     <video supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='modelType'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>vga</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>cirrus</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>vmvga</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>qxl</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>none</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>bochs</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>ramfb</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </video>
Jul 31 14:39:57 user nova-compute[72239]:     <hostdev supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='mode'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>subsystem</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='startupPolicy'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>default</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>mandatory</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>requisite</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>optional</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='subsysType'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>usb</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>pci</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>scsi</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='capsType'/>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='pciBackend'/>
Jul 31 14:39:57 user nova-compute[72239]:     </hostdev>
Jul 31 14:39:57 user nova-compute[72239]:     <rng supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='model'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio-transitional</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio-non-transitional</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='backendModel'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>random</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>egd</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>builtin</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </rng>
Jul 31 14:39:57 user nova-compute[72239]:     <filesystem supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='driverType'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>path</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>handle</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtiofs</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </filesystem>
Jul 31 14:39:57 user nova-compute[72239]:     <tpm supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='model'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>tpm-tis</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>tpm-crb</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='backendModel'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>passthrough</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>emulator</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </tpm>
Jul 31 14:39:57 user nova-compute[72239]:   </devices>
Jul 31 14:39:57 user nova-compute[72239]:   <features>
Jul 31 14:39:57 user nova-compute[72239]:     <gic supported='no'/>
Jul 31 14:39:57 user nova-compute[72239]:     <vmcoreinfo supported='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:     <genid supported='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:     <backingStoreInput supported='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:     <backup supported='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:     <sev supported='no'/>
Jul 31 14:39:57 user nova-compute[72239]:   </features>
Jul 31 14:39:57 user nova-compute[72239]: </domainCapabilities>
Jul 31 14:39:57 user nova-compute[72239]:  {{(pid=72239) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Jul 31 14:39:57 user nova-compute[72239]: <domainCapabilities>
Jul 31 14:39:57 user nova-compute[72239]:   <path>/usr/bin/qemu-system-i386</path>
Jul 31 14:39:57 user nova-compute[72239]:   <domain>kvm</domain>
Jul 31 14:39:57 user nova-compute[72239]:   <machine>pc-q35-jammy</machine>
Jul 31 14:39:57 user nova-compute[72239]:   <arch>i686</arch>
Jul 31 14:39:57 user nova-compute[72239]:   <vcpu max='288'/>
Jul 31 14:39:57 user nova-compute[72239]:   <iothreads supported='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:   <os supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:     <enum name='firmware'/>
Jul 31 14:39:57 user nova-compute[72239]:     <loader supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 31 14:39:57 user nova-compute[72239]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 31 14:39:57 user nova-compute[72239]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 31 14:39:57 user nova-compute[72239]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 31 14:39:57 user nova-compute[72239]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='type'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>rom</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>pflash</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='readonly'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>yes</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>no</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='secure'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>no</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </loader>
Jul 31 14:39:57 user nova-compute[72239]:   </os>
Jul 31 14:39:57 user nova-compute[72239]:   <cpu>
Jul 31 14:39:57 user nova-compute[72239]:     <mode name='host-passthrough' supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='hostPassthroughMigratable'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>off</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </mode>
Jul 31 14:39:57 user nova-compute[72239]:     <mode name='maximum' supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='maximumMigratable'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>on</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>off</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </mode>
Jul 31 14:39:57 user nova-compute[72239]:     <mode name='host-model' supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <vendor>Intel</vendor>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='ss'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='vmx'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='pcid'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='hypervisor'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='arat'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='tsc_adjust'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='umip'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='md-clear'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='stibp'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='arch-capabilities'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='ssbd'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='ibpb'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='ibrs'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='amd-stibp'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='amd-ssbd'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='disable' name='erms'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='disable' name='xsaveopt'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='disable' name='lm'/>
Jul 31 14:39:57 user nova-compute[72239]:     </mode>
Jul 31 14:39:57 user nova-compute[72239]:     <mode name='custom' supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>qemu64</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>qemu32</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>phenom</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>pentium3</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>pentium2</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>pentium</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>n270</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>kvm64</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>kvm32</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>coreduo</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>core2duo</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>athlon</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Westmere-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Westmere</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Snowridge</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Server</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Client</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>SandyBridge</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Penryn</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Opteron_G5</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Opteron_G4</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Opteron_G3</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Opteron_G2</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Opteron_G1</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Nehalem-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Nehalem</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>IvyBridge</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Icelake-Server</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Haswell-noTSX</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Haswell-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Haswell</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>EPYC-Rome</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>EPYC-Milan</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>EPYC-IBPB</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>EPYC</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Dhyana</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Cooperlake</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Conroe</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Cascadelake-Server</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Broadwell-noTSX</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Broadwell-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Broadwell</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>486</model>
Jul 31 14:39:57 user nova-compute[72239]:     </mode>
Jul 31 14:39:57 user nova-compute[72239]:   </cpu>
Jul 31 14:39:57 user nova-compute[72239]:   <memoryBacking supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:     <enum name='sourceType'>
Jul 31 14:39:57 user nova-compute[72239]:       <value>file</value>
Jul 31 14:39:57 user nova-compute[72239]:       <value>anonymous</value>
Jul 31 14:39:57 user nova-compute[72239]:       <value>memfd</value>
Jul 31 14:39:57 user nova-compute[72239]:     </enum>
Jul 31 14:39:57 user nova-compute[72239]:   </memoryBacking>
Jul 31 14:39:57 user nova-compute[72239]:   <devices>
Jul 31 14:39:57 user nova-compute[72239]:     <disk supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='diskDevice'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>disk</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>cdrom</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>floppy</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>lun</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='bus'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>fdc</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>scsi</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>usb</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>sata</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='model'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio-transitional</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio-non-transitional</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </disk>
Jul 31 14:39:57 user nova-compute[72239]:     <graphics supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='type'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>sdl</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>vnc</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>spice</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>egl-headless</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </graphics>
Jul 31 14:39:57 user nova-compute[72239]:     <video supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='modelType'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>vga</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>cirrus</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>vmvga</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>qxl</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>none</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>bochs</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>ramfb</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </video>
Jul 31 14:39:57 user nova-compute[72239]:     <hostdev supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='mode'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>subsystem</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='startupPolicy'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>default</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>mandatory</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>requisite</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>optional</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='subsysType'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>usb</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>pci</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>scsi</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='capsType'/>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='pciBackend'/>
Jul 31 14:39:57 user nova-compute[72239]:     </hostdev>
Jul 31 14:39:57 user nova-compute[72239]:     <rng supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='model'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio-transitional</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio-non-transitional</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='backendModel'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>random</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>egd</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>builtin</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </rng>
Jul 31 14:39:57 user nova-compute[72239]:     <filesystem supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='driverType'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>path</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>handle</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtiofs</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </filesystem>
Jul 31 14:39:57 user nova-compute[72239]:     <tpm supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='model'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>tpm-tis</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>tpm-crb</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='backendModel'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>passthrough</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>emulator</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </tpm>
Jul 31 14:39:57 user nova-compute[72239]:   </devices>
Jul 31 14:39:57 user nova-compute[72239]:   <features>
Jul 31 14:39:57 user nova-compute[72239]:     <gic supported='no'/>
Jul 31 14:39:57 user nova-compute[72239]:     <vmcoreinfo supported='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:     <genid supported='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:     <backingStoreInput supported='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:     <backup supported='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:     <sev supported='no'/>
Jul 31 14:39:57 user nova-compute[72239]:   </features>
Jul 31 14:39:57 user nova-compute[72239]: </domainCapabilities>
Jul 31 14:39:57 user nova-compute[72239]:  {{(pid=72239) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Jul 31 14:39:57 user nova-compute[72239]: <domainCapabilities>
Jul 31 14:39:57 user nova-compute[72239]:   <path>/usr/bin/qemu-system-i386</path>
Jul 31 14:39:57 user nova-compute[72239]:   <domain>kvm</domain>
Jul 31 14:39:57 user nova-compute[72239]:   <machine>pc-i440fx-6.2</machine>
Jul 31 14:39:57 user nova-compute[72239]:   <arch>i686</arch>
Jul 31 14:39:57 user nova-compute[72239]:   <vcpu max='255'/>
Jul 31 14:39:57 user nova-compute[72239]:   <iothreads supported='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:   <os supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:     <enum name='firmware'/>
Jul 31 14:39:57 user nova-compute[72239]:     <loader supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 31 14:39:57 user nova-compute[72239]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 31 14:39:57 user nova-compute[72239]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 31 14:39:57 user nova-compute[72239]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 31 14:39:57 user nova-compute[72239]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='type'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>rom</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>pflash</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='readonly'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>yes</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>no</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='secure'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>no</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </loader>
Jul 31 14:39:57 user nova-compute[72239]:   </os>
Jul 31 14:39:57 user nova-compute[72239]:   <cpu>
Jul 31 14:39:57 user nova-compute[72239]:     <mode name='host-passthrough' supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='hostPassthroughMigratable'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>off</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </mode>
Jul 31 14:39:57 user nova-compute[72239]:     <mode name='maximum' supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='maximumMigratable'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>on</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>off</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </mode>
Jul 31 14:39:57 user nova-compute[72239]:     <mode name='host-model' supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <vendor>Intel</vendor>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='ss'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='vmx'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='pcid'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='hypervisor'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='arat'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='tsc_adjust'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='umip'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='md-clear'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='stibp'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='arch-capabilities'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='ssbd'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='ibpb'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='ibrs'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='amd-stibp'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='amd-ssbd'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='disable' name='erms'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='disable' name='xsaveopt'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='disable' name='lm'/>
Jul 31 14:39:57 user nova-compute[72239]:     </mode>
Jul 31 14:39:57 user nova-compute[72239]:     <mode name='custom' supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>qemu64</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>qemu32</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>phenom</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>pentium3</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>pentium2</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>pentium</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>n270</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>kvm64</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>kvm32</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>coreduo</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>core2duo</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>athlon</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Westmere-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Westmere</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Snowridge</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Server</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Client</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>SandyBridge</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Penryn</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Opteron_G5</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Opteron_G4</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Opteron_G3</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Opteron_G2</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Opteron_G1</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Nehalem-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Nehalem</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>IvyBridge</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Icelake-Server</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Haswell-noTSX</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Haswell-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Haswell</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>EPYC-Rome</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>EPYC-Milan</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>EPYC-IBPB</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>EPYC</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Dhyana</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Cooperlake</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Conroe</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Cascadelake-Server</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Broadwell-noTSX</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Broadwell-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Broadwell</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>486</model>
Jul 31 14:39:57 user nova-compute[72239]:     </mode>
Jul 31 14:39:57 user nova-compute[72239]:   </cpu>
Jul 31 14:39:57 user nova-compute[72239]:   <memoryBacking supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:     <enum name='sourceType'>
Jul 31 14:39:57 user nova-compute[72239]:       <value>file</value>
Jul 31 14:39:57 user nova-compute[72239]:       <value>anonymous</value>
Jul 31 14:39:57 user nova-compute[72239]:       <value>memfd</value>
Jul 31 14:39:57 user nova-compute[72239]:     </enum>
Jul 31 14:39:57 user nova-compute[72239]:   </memoryBacking>
Jul 31 14:39:57 user nova-compute[72239]:   <devices>
Jul 31 14:39:57 user nova-compute[72239]:     <disk supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='diskDevice'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>disk</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>cdrom</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>floppy</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>lun</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='bus'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>ide</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>fdc</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>scsi</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>usb</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>sata</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='model'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio-transitional</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio-non-transitional</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </disk>
Jul 31 14:39:57 user nova-compute[72239]:     <graphics supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='type'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>sdl</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>vnc</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>spice</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>egl-headless</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </graphics>
Jul 31 14:39:57 user nova-compute[72239]:     <video supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='modelType'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>vga</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>cirrus</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>vmvga</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>qxl</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>none</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>bochs</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>ramfb</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </video>
Jul 31 14:39:57 user nova-compute[72239]:     <hostdev supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='mode'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>subsystem</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='startupPolicy'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>default</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>mandatory</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>requisite</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>optional</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='subsysType'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>usb</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>pci</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>scsi</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='capsType'/>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='pciBackend'/>
Jul 31 14:39:57 user nova-compute[72239]:     </hostdev>
Jul 31 14:39:57 user nova-compute[72239]:     <rng supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='model'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio-transitional</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio-non-transitional</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='backendModel'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>random</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>egd</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>builtin</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </rng>
Jul 31 14:39:57 user nova-compute[72239]:     <filesystem supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='driverType'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>path</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>handle</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtiofs</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </filesystem>
Jul 31 14:39:57 user nova-compute[72239]:     <tpm supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='model'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>tpm-tis</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>tpm-crb</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='backendModel'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>passthrough</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>emulator</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </tpm>
Jul 31 14:39:57 user nova-compute[72239]:   </devices>
Jul 31 14:39:57 user nova-compute[72239]:   <features>
Jul 31 14:39:57 user nova-compute[72239]:     <gic supported='no'/>
Jul 31 14:39:57 user nova-compute[72239]:     <vmcoreinfo supported='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:     <genid supported='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:     <backingStoreInput supported='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:     <backup supported='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:     <sev supported='no'/>
Jul 31 14:39:57 user nova-compute[72239]:   </features>
Jul 31 14:39:57 user nova-compute[72239]: </domainCapabilities>
Jul 31 14:39:57 user nova-compute[72239]:  {{(pid=72239) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Jul 31 14:39:57 user nova-compute[72239]: <domainCapabilities>
Jul 31 14:39:57 user nova-compute[72239]:   <path>/usr/bin/qemu-system-i386</path>
Jul 31 14:39:57 user nova-compute[72239]:   <domain>kvm</domain>
Jul 31 14:39:57 user nova-compute[72239]:   <machine>pc-q35-6.2</machine>
Jul 31 14:39:57 user nova-compute[72239]:   <arch>i686</arch>
Jul 31 14:39:57 user nova-compute[72239]:   <vcpu max='288'/>
Jul 31 14:39:57 user nova-compute[72239]:   <iothreads supported='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:   <os supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:     <enum name='firmware'/>
Jul 31 14:39:57 user nova-compute[72239]:     <loader supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 31 14:39:57 user nova-compute[72239]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 31 14:39:57 user nova-compute[72239]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 31 14:39:57 user nova-compute[72239]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 31 14:39:57 user nova-compute[72239]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='type'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>rom</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>pflash</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='readonly'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>yes</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>no</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='secure'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>no</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </loader>
Jul 31 14:39:57 user nova-compute[72239]:   </os>
Jul 31 14:39:57 user nova-compute[72239]:   <cpu>
Jul 31 14:39:57 user nova-compute[72239]:     <mode name='host-passthrough' supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='hostPassthroughMigratable'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>off</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </mode>
Jul 31 14:39:57 user nova-compute[72239]:     <mode name='maximum' supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='maximumMigratable'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>on</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>off</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </mode>
Jul 31 14:39:57 user nova-compute[72239]:     <mode name='host-model' supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <vendor>Intel</vendor>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='ss'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='vmx'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='pcid'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='hypervisor'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='arat'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='tsc_adjust'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='umip'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='md-clear'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='stibp'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='arch-capabilities'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='ssbd'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='ibpb'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='ibrs'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='amd-stibp'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='amd-ssbd'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='disable' name='erms'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='disable' name='xsaveopt'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='disable' name='lm'/>
Jul 31 14:39:57 user nova-compute[72239]:     </mode>
Jul 31 14:39:57 user nova-compute[72239]:     <mode name='custom' supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>qemu64</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>qemu32</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>phenom</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>pentium3</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>pentium2</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>pentium</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>n270</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>kvm64</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>kvm32</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>coreduo</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>core2duo</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>athlon</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Westmere-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Westmere</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Snowridge</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Server</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Client</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>SandyBridge</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Penryn</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Opteron_G5</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Opteron_G4</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Opteron_G3</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Opteron_G2</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Opteron_G1</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Nehalem-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Nehalem</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>IvyBridge</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Icelake-Server</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Haswell-noTSX</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Haswell-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Haswell</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>EPYC-Rome</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>EPYC-Milan</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>EPYC-IBPB</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>EPYC</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Dhyana</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Cooperlake</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Conroe</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Cascadelake-Server</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Broadwell-noTSX</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Broadwell-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Broadwell</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>486</model>
Jul 31 14:39:57 user nova-compute[72239]:     </mode>
Jul 31 14:39:57 user nova-compute[72239]:   </cpu>
Jul 31 14:39:57 user nova-compute[72239]:   <memoryBacking supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:     <enum name='sourceType'>
Jul 31 14:39:57 user nova-compute[72239]:       <value>file</value>
Jul 31 14:39:57 user nova-compute[72239]:       <value>anonymous</value>
Jul 31 14:39:57 user nova-compute[72239]:       <value>memfd</value>
Jul 31 14:39:57 user nova-compute[72239]:     </enum>
Jul 31 14:39:57 user nova-compute[72239]:   </memoryBacking>
Jul 31 14:39:57 user nova-compute[72239]:   <devices>
Jul 31 14:39:57 user nova-compute[72239]:     <disk supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='diskDevice'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>disk</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>cdrom</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>floppy</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>lun</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='bus'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>fdc</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>scsi</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>usb</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>sata</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='model'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio-transitional</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio-non-transitional</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </disk>
Jul 31 14:39:57 user nova-compute[72239]:     <graphics supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='type'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>sdl</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>vnc</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>spice</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>egl-headless</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </graphics>
Jul 31 14:39:57 user nova-compute[72239]:     <video supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='modelType'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>vga</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>cirrus</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>vmvga</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>qxl</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>none</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>bochs</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>ramfb</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </video>
Jul 31 14:39:57 user nova-compute[72239]:     <hostdev supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='mode'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>subsystem</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='startupPolicy'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>default</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>mandatory</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>requisite</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>optional</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='subsysType'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>usb</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>pci</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>scsi</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='capsType'/>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='pciBackend'/>
Jul 31 14:39:57 user nova-compute[72239]:     </hostdev>
Jul 31 14:39:57 user nova-compute[72239]:     <rng supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='model'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio-transitional</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio-non-transitional</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='backendModel'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>random</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>egd</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>builtin</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </rng>
Jul 31 14:39:57 user nova-compute[72239]:     <filesystem supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='driverType'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>path</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>handle</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtiofs</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </filesystem>
Jul 31 14:39:57 user nova-compute[72239]:     <tpm supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='model'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>tpm-tis</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>tpm-crb</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='backendModel'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>passthrough</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>emulator</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </tpm>
Jul 31 14:39:57 user nova-compute[72239]:   </devices>
Jul 31 14:39:57 user nova-compute[72239]:   <features>
Jul 31 14:39:57 user nova-compute[72239]:     <gic supported='no'/>
Jul 31 14:39:57 user nova-compute[72239]:     <vmcoreinfo supported='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:     <genid supported='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:     <backingStoreInput supported='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:     <backup supported='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:     <sev supported='no'/>
Jul 31 14:39:57 user nova-compute[72239]:   </features>
Jul 31 14:39:57 user nova-compute[72239]: </domainCapabilities>
Jul 31 14:39:57 user nova-compute[72239]:  {{(pid=72239) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=72239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=72239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=72239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=72239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=72239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=72239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=72239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=72239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=72239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=72239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=72239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=72239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=72239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=72239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=72239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=72239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=72239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=72239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=72239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=72239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=72239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=72239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=72239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=72239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=72239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=72239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=72239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=72239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=72239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=72239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=72239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=72239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=72239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=72239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'ubuntu-q35', 'pc', 'q35'} {{(pid=72239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Jul 31 14:39:57 user nova-compute[72239]: <domainCapabilities>
Jul 31 14:39:57 user nova-compute[72239]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 31 14:39:57 user nova-compute[72239]:   <domain>kvm</domain>
Jul 31 14:39:57 user nova-compute[72239]:   <machine>pc-i440fx-jammy</machine>
Jul 31 14:39:57 user nova-compute[72239]:   <arch>x86_64</arch>
Jul 31 14:39:57 user nova-compute[72239]:   <vcpu max='255'/>
Jul 31 14:39:57 user nova-compute[72239]:   <iothreads supported='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:   <os supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:     <enum name='firmware'>
Jul 31 14:39:57 user nova-compute[72239]:       <value>efi</value>
Jul 31 14:39:57 user nova-compute[72239]:     </enum>
Jul 31 14:39:57 user nova-compute[72239]:     <loader supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='type'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>rom</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>pflash</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='readonly'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>yes</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>no</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='secure'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>no</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </loader>
Jul 31 14:39:57 user nova-compute[72239]:   </os>
Jul 31 14:39:57 user nova-compute[72239]:   <cpu>
Jul 31 14:39:57 user nova-compute[72239]:     <mode name='host-passthrough' supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='hostPassthroughMigratable'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>on</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>off</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </mode>
Jul 31 14:39:57 user nova-compute[72239]:     <mode name='maximum' supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='maximumMigratable'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>on</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>off</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </mode>
Jul 31 14:39:57 user nova-compute[72239]:     <mode name='host-model' supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <vendor>Intel</vendor>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='ss'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='vmx'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='pcid'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='hypervisor'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='arat'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='tsc_adjust'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='umip'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='md-clear'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='stibp'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='arch-capabilities'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='ssbd'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='invtsc'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='ibpb'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='ibrs'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='amd-stibp'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='amd-ssbd'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='rsba'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='pschange-mc-no'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='disable' name='erms'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='disable' name='xsaveopt'/>
Jul 31 14:39:57 user nova-compute[72239]:     </mode>
Jul 31 14:39:57 user nova-compute[72239]:     <mode name='custom' supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>qemu64</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>qemu32</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>phenom</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>pentium3</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>pentium2</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>pentium</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>n270</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>kvm64</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>kvm32</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>coreduo</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>core2duo</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>athlon</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>Westmere-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>Westmere</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Snowridge</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Server</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Client</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>SandyBridge</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>Penryn</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Opteron_G5</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Opteron_G4</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Opteron_G3</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Opteron_G2</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>Opteron_G1</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>Nehalem</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>IvyBridge</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Icelake-Server</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Haswell-noTSX</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Haswell-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Haswell</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>EPYC-Rome</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>EPYC-Milan</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>EPYC-IBPB</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>EPYC</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Dhyana</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Cooperlake</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>Conroe</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Cascadelake-Server</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Broadwell-noTSX</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Broadwell-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Broadwell</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>486</model>
Jul 31 14:39:57 user nova-compute[72239]:     </mode>
Jul 31 14:39:57 user nova-compute[72239]:   </cpu>
Jul 31 14:39:57 user nova-compute[72239]:   <memoryBacking supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:     <enum name='sourceType'>
Jul 31 14:39:57 user nova-compute[72239]:       <value>file</value>
Jul 31 14:39:57 user nova-compute[72239]:       <value>anonymous</value>
Jul 31 14:39:57 user nova-compute[72239]:       <value>memfd</value>
Jul 31 14:39:57 user nova-compute[72239]:     </enum>
Jul 31 14:39:57 user nova-compute[72239]:   </memoryBacking>
Jul 31 14:39:57 user nova-compute[72239]:   <devices>
Jul 31 14:39:57 user nova-compute[72239]:     <disk supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='diskDevice'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>disk</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>cdrom</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>floppy</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>lun</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='bus'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>ide</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>fdc</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>scsi</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>usb</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>sata</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='model'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio-transitional</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio-non-transitional</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </disk>
Jul 31 14:39:57 user nova-compute[72239]:     <graphics supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='type'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>sdl</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>vnc</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>spice</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>egl-headless</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </graphics>
Jul 31 14:39:57 user nova-compute[72239]:     <video supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='modelType'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>vga</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>cirrus</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>vmvga</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>qxl</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>none</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>bochs</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>ramfb</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </video>
Jul 31 14:39:57 user nova-compute[72239]:     <hostdev supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='mode'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>subsystem</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='startupPolicy'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>default</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>mandatory</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>requisite</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>optional</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='subsysType'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>usb</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>pci</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>scsi</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='capsType'/>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='pciBackend'/>
Jul 31 14:39:57 user nova-compute[72239]:     </hostdev>
Jul 31 14:39:57 user nova-compute[72239]:     <rng supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='model'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio-transitional</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio-non-transitional</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='backendModel'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>random</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>egd</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>builtin</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </rng>
Jul 31 14:39:57 user nova-compute[72239]:     <filesystem supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='driverType'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>path</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>handle</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtiofs</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </filesystem>
Jul 31 14:39:57 user nova-compute[72239]:     <tpm supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='model'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>tpm-tis</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>tpm-crb</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='backendModel'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>passthrough</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>emulator</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </tpm>
Jul 31 14:39:57 user nova-compute[72239]:   </devices>
Jul 31 14:39:57 user nova-compute[72239]:   <features>
Jul 31 14:39:57 user nova-compute[72239]:     <gic supported='no'/>
Jul 31 14:39:57 user nova-compute[72239]:     <vmcoreinfo supported='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:     <genid supported='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:     <backingStoreInput supported='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:     <backup supported='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:     <sev supported='no'/>
Jul 31 14:39:57 user nova-compute[72239]:   </features>
Jul 31 14:39:57 user nova-compute[72239]: </domainCapabilities>
Jul 31 14:39:57 user nova-compute[72239]:  {{(pid=72239) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Jul 31 14:39:57 user nova-compute[72239]: <domainCapabilities>
Jul 31 14:39:57 user nova-compute[72239]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 31 14:39:57 user nova-compute[72239]:   <domain>kvm</domain>
Jul 31 14:39:57 user nova-compute[72239]:   <machine>pc-q35-jammy</machine>
Jul 31 14:39:57 user nova-compute[72239]:   <arch>x86_64</arch>
Jul 31 14:39:57 user nova-compute[72239]:   <vcpu max='288'/>
Jul 31 14:39:57 user nova-compute[72239]:   <iothreads supported='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:   <os supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:     <enum name='firmware'>
Jul 31 14:39:57 user nova-compute[72239]:       <value>efi</value>
Jul 31 14:39:57 user nova-compute[72239]:     </enum>
Jul 31 14:39:57 user nova-compute[72239]:     <loader supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jul 31 14:39:57 user nova-compute[72239]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jul 31 14:39:57 user nova-compute[72239]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='type'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>rom</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>pflash</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='readonly'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>yes</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>no</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='secure'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>yes</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>no</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </loader>
Jul 31 14:39:57 user nova-compute[72239]:   </os>
Jul 31 14:39:57 user nova-compute[72239]:   <cpu>
Jul 31 14:39:57 user nova-compute[72239]:     <mode name='host-passthrough' supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='hostPassthroughMigratable'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>on</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>off</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </mode>
Jul 31 14:39:57 user nova-compute[72239]:     <mode name='maximum' supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='maximumMigratable'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>on</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>off</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </mode>
Jul 31 14:39:57 user nova-compute[72239]:     <mode name='host-model' supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <vendor>Intel</vendor>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='ss'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='vmx'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='pcid'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='hypervisor'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='arat'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='tsc_adjust'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='umip'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='md-clear'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='stibp'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='arch-capabilities'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='ssbd'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='invtsc'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='ibpb'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='ibrs'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='amd-stibp'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='amd-ssbd'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='rsba'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='pschange-mc-no'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='disable' name='erms'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='disable' name='xsaveopt'/>
Jul 31 14:39:57 user nova-compute[72239]:     </mode>
Jul 31 14:39:57 user nova-compute[72239]:     <mode name='custom' supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>qemu64</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>qemu32</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>phenom</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>pentium3</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>pentium2</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>pentium</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>n270</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>kvm64</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>kvm32</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>coreduo</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>core2duo</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>athlon</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>Westmere-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>Westmere</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Snowridge</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Server</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Client</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>SandyBridge</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>Penryn</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Opteron_G5</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Opteron_G4</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Opteron_G3</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Opteron_G2</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>Opteron_G1</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>Nehalem</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>IvyBridge</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Icelake-Server</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Haswell-noTSX</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Haswell-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Haswell</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>EPYC-Rome</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>EPYC-Milan</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>EPYC-IBPB</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>EPYC</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Dhyana</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Cooperlake</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>Conroe</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Cascadelake-Server</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Broadwell-noTSX</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Broadwell-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Broadwell</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>486</model>
Jul 31 14:39:57 user nova-compute[72239]:     </mode>
Jul 31 14:39:57 user nova-compute[72239]:   </cpu>
Jul 31 14:39:57 user nova-compute[72239]:   <memoryBacking supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:     <enum name='sourceType'>
Jul 31 14:39:57 user nova-compute[72239]:       <value>file</value>
Jul 31 14:39:57 user nova-compute[72239]:       <value>anonymous</value>
Jul 31 14:39:57 user nova-compute[72239]:       <value>memfd</value>
Jul 31 14:39:57 user nova-compute[72239]:     </enum>
Jul 31 14:39:57 user nova-compute[72239]:   </memoryBacking>
Jul 31 14:39:57 user nova-compute[72239]:   <devices>
Jul 31 14:39:57 user nova-compute[72239]:     <disk supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='diskDevice'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>disk</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>cdrom</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>floppy</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>lun</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='bus'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>fdc</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>scsi</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>usb</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>sata</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='model'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio-transitional</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio-non-transitional</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </disk>
Jul 31 14:39:57 user nova-compute[72239]:     <graphics supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='type'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>sdl</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>vnc</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>spice</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>egl-headless</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </graphics>
Jul 31 14:39:57 user nova-compute[72239]:     <video supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='modelType'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>vga</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>cirrus</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>vmvga</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>qxl</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>none</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>bochs</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>ramfb</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </video>
Jul 31 14:39:57 user nova-compute[72239]:     <hostdev supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='mode'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>subsystem</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='startupPolicy'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>default</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>mandatory</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>requisite</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>optional</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='subsysType'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>usb</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>pci</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>scsi</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='capsType'/>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='pciBackend'/>
Jul 31 14:39:57 user nova-compute[72239]:     </hostdev>
Jul 31 14:39:57 user nova-compute[72239]:     <rng supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='model'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio-transitional</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio-non-transitional</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='backendModel'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>random</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>egd</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>builtin</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </rng>
Jul 31 14:39:57 user nova-compute[72239]:     <filesystem supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='driverType'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>path</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>handle</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtiofs</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </filesystem>
Jul 31 14:39:57 user nova-compute[72239]:     <tpm supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='model'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>tpm-tis</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>tpm-crb</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='backendModel'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>passthrough</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>emulator</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </tpm>
Jul 31 14:39:57 user nova-compute[72239]:   </devices>
Jul 31 14:39:57 user nova-compute[72239]:   <features>
Jul 31 14:39:57 user nova-compute[72239]:     <gic supported='no'/>
Jul 31 14:39:57 user nova-compute[72239]:     <vmcoreinfo supported='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:     <genid supported='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:     <backingStoreInput supported='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:     <backup supported='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:     <sev supported='no'/>
Jul 31 14:39:57 user nova-compute[72239]:   </features>
Jul 31 14:39:57 user nova-compute[72239]: </domainCapabilities>
Jul 31 14:39:57 user nova-compute[72239]:  {{(pid=72239) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Jul 31 14:39:57 user nova-compute[72239]: <domainCapabilities>
Jul 31 14:39:57 user nova-compute[72239]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 31 14:39:57 user nova-compute[72239]:   <domain>kvm</domain>
Jul 31 14:39:57 user nova-compute[72239]:   <machine>pc-i440fx-6.2</machine>
Jul 31 14:39:57 user nova-compute[72239]:   <arch>x86_64</arch>
Jul 31 14:39:57 user nova-compute[72239]:   <vcpu max='255'/>
Jul 31 14:39:57 user nova-compute[72239]:   <iothreads supported='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:   <os supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:     <enum name='firmware'>
Jul 31 14:39:57 user nova-compute[72239]:       <value>efi</value>
Jul 31 14:39:57 user nova-compute[72239]:     </enum>
Jul 31 14:39:57 user nova-compute[72239]:     <loader supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='type'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>rom</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>pflash</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='readonly'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>yes</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>no</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='secure'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>no</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </loader>
Jul 31 14:39:57 user nova-compute[72239]:   </os>
Jul 31 14:39:57 user nova-compute[72239]:   <cpu>
Jul 31 14:39:57 user nova-compute[72239]:     <mode name='host-passthrough' supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='hostPassthroughMigratable'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>on</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>off</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </mode>
Jul 31 14:39:57 user nova-compute[72239]:     <mode name='maximum' supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='maximumMigratable'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>on</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>off</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </mode>
Jul 31 14:39:57 user nova-compute[72239]:     <mode name='host-model' supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <vendor>Intel</vendor>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='ss'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='vmx'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='pcid'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='hypervisor'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='arat'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='tsc_adjust'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='umip'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='md-clear'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='stibp'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='arch-capabilities'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='ssbd'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='invtsc'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='ibpb'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='ibrs'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='amd-stibp'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='amd-ssbd'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='rsba'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='pschange-mc-no'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='disable' name='erms'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='disable' name='xsaveopt'/>
Jul 31 14:39:57 user nova-compute[72239]:     </mode>
Jul 31 14:39:57 user nova-compute[72239]:     <mode name='custom' supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>qemu64</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>qemu32</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>phenom</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>pentium3</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>pentium2</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>pentium</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>n270</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>kvm64</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>kvm32</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>coreduo</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>core2duo</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>athlon</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>Westmere-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>Westmere</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Snowridge</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Server</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Client</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>SandyBridge</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>Penryn</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Opteron_G5</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Opteron_G4</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Opteron_G3</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Opteron_G2</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>Opteron_G1</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>Nehalem</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>IvyBridge</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Icelake-Server</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Haswell-noTSX</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Haswell-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Haswell</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>EPYC-Rome</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>EPYC-Milan</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>EPYC-IBPB</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>EPYC</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Dhyana</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Cooperlake</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>Conroe</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Cascadelake-Server</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Broadwell-noTSX</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Broadwell-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Broadwell</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>486</model>
Jul 31 14:39:57 user nova-compute[72239]:     </mode>
Jul 31 14:39:57 user nova-compute[72239]:   </cpu>
Jul 31 14:39:57 user nova-compute[72239]:   <memoryBacking supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:     <enum name='sourceType'>
Jul 31 14:39:57 user nova-compute[72239]:       <value>file</value>
Jul 31 14:39:57 user nova-compute[72239]:       <value>anonymous</value>
Jul 31 14:39:57 user nova-compute[72239]:       <value>memfd</value>
Jul 31 14:39:57 user nova-compute[72239]:     </enum>
Jul 31 14:39:57 user nova-compute[72239]:   </memoryBacking>
Jul 31 14:39:57 user nova-compute[72239]:   <devices>
Jul 31 14:39:57 user nova-compute[72239]:     <disk supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='diskDevice'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>disk</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>cdrom</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>floppy</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>lun</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='bus'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>ide</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>fdc</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>scsi</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>usb</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>sata</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='model'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio-transitional</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio-non-transitional</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </disk>
Jul 31 14:39:57 user nova-compute[72239]:     <graphics supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='type'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>sdl</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>vnc</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>spice</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>egl-headless</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </graphics>
Jul 31 14:39:57 user nova-compute[72239]:     <video supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='modelType'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>vga</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>cirrus</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>vmvga</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>qxl</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>none</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>bochs</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>ramfb</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </video>
Jul 31 14:39:57 user nova-compute[72239]:     <hostdev supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='mode'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>subsystem</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='startupPolicy'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>default</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>mandatory</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>requisite</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>optional</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='subsysType'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>usb</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>pci</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>scsi</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='capsType'/>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='pciBackend'/>
Jul 31 14:39:57 user nova-compute[72239]:     </hostdev>
Jul 31 14:39:57 user nova-compute[72239]:     <rng supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='model'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio-transitional</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio-non-transitional</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='backendModel'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>random</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>egd</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>builtin</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </rng>
Jul 31 14:39:57 user nova-compute[72239]:     <filesystem supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='driverType'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>path</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>handle</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtiofs</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </filesystem>
Jul 31 14:39:57 user nova-compute[72239]:     <tpm supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='model'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>tpm-tis</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>tpm-crb</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='backendModel'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>passthrough</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>emulator</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </tpm>
Jul 31 14:39:57 user nova-compute[72239]:   </devices>
Jul 31 14:39:57 user nova-compute[72239]:   <features>
Jul 31 14:39:57 user nova-compute[72239]:     <gic supported='no'/>
Jul 31 14:39:57 user nova-compute[72239]:     <vmcoreinfo supported='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:     <genid supported='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:     <backingStoreInput supported='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:     <backup supported='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:     <sev supported='no'/>
Jul 31 14:39:57 user nova-compute[72239]:   </features>
Jul 31 14:39:57 user nova-compute[72239]: </domainCapabilities>
Jul 31 14:39:57 user nova-compute[72239]:  {{(pid=72239) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Jul 31 14:39:57 user nova-compute[72239]: <domainCapabilities>
Jul 31 14:39:57 user nova-compute[72239]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 31 14:39:57 user nova-compute[72239]:   <domain>kvm</domain>
Jul 31 14:39:57 user nova-compute[72239]:   <machine>pc-q35-6.2</machine>
Jul 31 14:39:57 user nova-compute[72239]:   <arch>x86_64</arch>
Jul 31 14:39:57 user nova-compute[72239]:   <vcpu max='288'/>
Jul 31 14:39:57 user nova-compute[72239]:   <iothreads supported='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:   <os supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:     <enum name='firmware'>
Jul 31 14:39:57 user nova-compute[72239]:       <value>efi</value>
Jul 31 14:39:57 user nova-compute[72239]:     </enum>
Jul 31 14:39:57 user nova-compute[72239]:     <loader supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jul 31 14:39:57 user nova-compute[72239]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jul 31 14:39:57 user nova-compute[72239]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='type'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>rom</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>pflash</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='readonly'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>yes</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>no</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='secure'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>yes</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>no</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </loader>
Jul 31 14:39:57 user nova-compute[72239]:   </os>
Jul 31 14:39:57 user nova-compute[72239]:   <cpu>
Jul 31 14:39:57 user nova-compute[72239]:     <mode name='host-passthrough' supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='hostPassthroughMigratable'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>on</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>off</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </mode>
Jul 31 14:39:57 user nova-compute[72239]:     <mode name='maximum' supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='maximumMigratable'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>on</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>off</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </mode>
Jul 31 14:39:57 user nova-compute[72239]:     <mode name='host-model' supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <vendor>Intel</vendor>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='ss'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='vmx'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='pcid'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='hypervisor'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='arat'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='tsc_adjust'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='umip'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='md-clear'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='stibp'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='arch-capabilities'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='ssbd'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='invtsc'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='ibpb'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='ibrs'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='amd-stibp'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='amd-ssbd'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='rsba'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='require' name='pschange-mc-no'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='disable' name='erms'/>
Jul 31 14:39:57 user nova-compute[72239]:       <feature policy='disable' name='xsaveopt'/>
Jul 31 14:39:57 user nova-compute[72239]:     </mode>
Jul 31 14:39:57 user nova-compute[72239]:     <mode name='custom' supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>qemu64</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>qemu32</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>phenom</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>pentium3</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>pentium2</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>pentium</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>n270</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>kvm64</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>kvm32</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>coreduo</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>core2duo</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>athlon</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>Westmere-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>Westmere</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Snowridge</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Server</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Skylake-Client</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>SandyBridge</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>Penryn</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Opteron_G5</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Opteron_G4</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Opteron_G3</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Opteron_G2</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>Opteron_G1</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>Nehalem</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>IvyBridge</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Icelake-Server</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Haswell-noTSX</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Haswell-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Haswell</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>EPYC-Rome</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>EPYC-Milan</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>EPYC-IBPB</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>EPYC</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Dhyana</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Cooperlake</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>Conroe</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Cascadelake-Server</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Broadwell-noTSX</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Broadwell-IBRS</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='no'>Broadwell</model>
Jul 31 14:39:57 user nova-compute[72239]:       <model usable='yes'>486</model>
Jul 31 14:39:57 user nova-compute[72239]:     </mode>
Jul 31 14:39:57 user nova-compute[72239]:   </cpu>
Jul 31 14:39:57 user nova-compute[72239]:   <memoryBacking supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:     <enum name='sourceType'>
Jul 31 14:39:57 user nova-compute[72239]:       <value>file</value>
Jul 31 14:39:57 user nova-compute[72239]:       <value>anonymous</value>
Jul 31 14:39:57 user nova-compute[72239]:       <value>memfd</value>
Jul 31 14:39:57 user nova-compute[72239]:     </enum>
Jul 31 14:39:57 user nova-compute[72239]:   </memoryBacking>
Jul 31 14:39:57 user nova-compute[72239]:   <devices>
Jul 31 14:39:57 user nova-compute[72239]:     <disk supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='diskDevice'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>disk</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>cdrom</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>floppy</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>lun</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='bus'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>fdc</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>scsi</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>usb</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>sata</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='model'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio-transitional</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio-non-transitional</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </disk>
Jul 31 14:39:57 user nova-compute[72239]:     <graphics supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='type'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>sdl</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>vnc</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>spice</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>egl-headless</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </graphics>
Jul 31 14:39:57 user nova-compute[72239]:     <video supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='modelType'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>vga</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>cirrus</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>vmvga</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>qxl</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>none</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>bochs</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>ramfb</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </video>
Jul 31 14:39:57 user nova-compute[72239]:     <hostdev supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='mode'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>subsystem</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='startupPolicy'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>default</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>mandatory</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>requisite</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>optional</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='subsysType'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>usb</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>pci</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>scsi</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='capsType'/>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='pciBackend'/>
Jul 31 14:39:57 user nova-compute[72239]:     </hostdev>
Jul 31 14:39:57 user nova-compute[72239]:     <rng supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='model'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio-transitional</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtio-non-transitional</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='backendModel'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>random</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>egd</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>builtin</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </rng>
Jul 31 14:39:57 user nova-compute[72239]:     <filesystem supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='driverType'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>path</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>handle</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>virtiofs</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </filesystem>
Jul 31 14:39:57 user nova-compute[72239]:     <tpm supported='yes'>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='model'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>tpm-tis</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>tpm-crb</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:       <enum name='backendModel'>
Jul 31 14:39:57 user nova-compute[72239]:         <value>passthrough</value>
Jul 31 14:39:57 user nova-compute[72239]:         <value>emulator</value>
Jul 31 14:39:57 user nova-compute[72239]:       </enum>
Jul 31 14:39:57 user nova-compute[72239]:     </tpm>
Jul 31 14:39:57 user nova-compute[72239]:   </devices>
Jul 31 14:39:57 user nova-compute[72239]:   <features>
Jul 31 14:39:57 user nova-compute[72239]:     <gic supported='no'/>
Jul 31 14:39:57 user nova-compute[72239]:     <vmcoreinfo supported='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:     <genid supported='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:     <backingStoreInput supported='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:     <backup supported='yes'/>
Jul 31 14:39:57 user nova-compute[72239]:     <sev supported='no'/>
Jul 31 14:39:57 user nova-compute[72239]:   </features>
Jul 31 14:39:57 user nova-compute[72239]: </domainCapabilities>
Jul 31 14:39:57 user nova-compute[72239]:  {{(pid=72239) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=72239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=72239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=72239) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=72239) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Checking secure boot support for host arch (x86_64) {{(pid=72239) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Checking secure boot support for host arch (x86_64) {{(pid=72239) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Checking secure boot support for host arch (x86_64) {{(pid=72239) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Jul 31 14:39:57 user nova-compute[72239]: INFO nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Secure Boot support detected
Jul 31 14:39:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] cpu compare xml: <cpu match="exact">
Jul 31 14:39:57 user nova-compute[72239]:   <model>Nehalem</model>
Jul 31 14:39:57 user nova-compute[72239]: </cpu>
Jul 31 14:39:57 user nova-compute[72239]:  {{(pid=72239) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Jul 31 14:39:57 user nova-compute[72239]: INFO nova.virt.node [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Generated node identity 98aeb34d-09d0-4a3a-9216-4d8197134e8e
Jul 31 14:39:57 user nova-compute[72239]: INFO nova.virt.node [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Wrote node identity 98aeb34d-09d0-4a3a-9216-4d8197134e8e to /opt/stack/data/nova/compute_id
Jul 31 14:39:57 user nova-compute[72239]: WARNING nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Compute nodes ['98aeb34d-09d0-4a3a-9216-4d8197134e8e'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Jul 31 14:39:58 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Jul 31 14:39:58 user nova-compute[72239]: WARNING nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Jul 31 14:39:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:39:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:39:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:39:58 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 14:39:58 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:39:58 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:39:58 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Hypervisor/Node resource view: name=user free_ram=10876MB free_disk=26.254913330078125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 14:39:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:39:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:39:58 user nova-compute[72239]: WARNING nova.compute.resource_tracker [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] No compute node record for user:98aeb34d-09d0-4a3a-9216-4d8197134e8e: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 98aeb34d-09d0-4a3a-9216-4d8197134e8e could not be found.
Jul 31 14:39:58 user nova-compute[72239]: INFO nova.compute.resource_tracker [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Compute node record created for user:user with uuid: 98aeb34d-09d0-4a3a-9216-4d8197134e8e
Jul 31 14:39:58 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 14:39:58 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 14:39:58 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [req-e43b82e6-6790-4db3-a1f7-023ffb78ba9f] Created resource provider record via placement API for resource provider with UUID 98aeb34d-09d0-4a3a-9216-4d8197134e8e and name user.
Jul 31 14:39:58 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=72239) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Jul 31 14:39:58 user nova-compute[72239]: INFO nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] kernel doesn't support AMD SEV
Jul 31 14:39:58 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Updating inventory in ProviderTree for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 14:39:58 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:39:58 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Libvirt baseline CPU <cpu>
Jul 31 14:39:58 user nova-compute[72239]:   <arch>x86_64</arch>
Jul 31 14:39:58 user nova-compute[72239]:   <model>Nehalem</model>
Jul 31 14:39:58 user nova-compute[72239]:   <vendor>Intel</vendor>
Jul 31 14:39:58 user nova-compute[72239]:   <topology sockets="6" cores="1" threads="1"/>
Jul 31 14:39:58 user nova-compute[72239]: </cpu>
Jul 31 14:39:58 user nova-compute[72239]:  {{(pid=72239) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Jul 31 14:39:58 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Updated inventory for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Jul 31 14:39:58 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Updating resource provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e generation from 0 to 1 during operation: update_inventory {{(pid=72239) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jul 31 14:39:58 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Updating inventory in ProviderTree for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 14:39:59 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Updating resource provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e generation from 1 to 2 during operation: update_traits {{(pid=72239) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jul 31 14:39:59 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 14:39:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.711s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:39:59 user nova-compute[72239]: DEBUG nova.service [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Creating RPC server for service compute {{(pid=72239) start /opt/stack/nova/nova/service.py:182}}
Jul 31 14:39:59 user nova-compute[72239]: DEBUG nova.service [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Join ServiceGroup membership for this service compute {{(pid=72239) start /opt/stack/nova/nova/service.py:199}}
Jul 31 14:39:59 user nova-compute[72239]: DEBUG nova.servicegroup.drivers.db [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=72239) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Jul 31 14:40:31 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._sync_power_states {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:40:31 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:40:49 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:40:49 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:40:49 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 14:40:49 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Rebuilding the list of instances to heal {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 14:40:49 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Didn't find any instances for network info cache update. {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 14:40:49 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:40:49 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:40:49 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:40:49 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:40:49 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:40:49 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:40:49 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 14:40:49 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:40:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:40:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:40:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:40:49 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 14:40:49 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:40:49 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:40:49 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=10253MB free_disk=26.158889770507812GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 14:40:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:40:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:40:49 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 14:40:49 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 14:40:49 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:40:49 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:40:49 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 14:40:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.113s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:41:49 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:41:49 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:41:50 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:41:50 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:41:50 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 14:41:50 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Rebuilding the list of instances to heal {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 14:41:50 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Didn't find any instances for network info cache update. {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 14:41:50 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:41:50 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:41:50 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:41:50 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 14:41:51 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:41:51 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:41:51 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:41:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:41:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:41:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:41:51 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 14:41:51 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:41:51 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:41:51 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=10196MB free_disk=26.203487396240234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 14:41:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:41:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:41:51 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 14:41:51 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 14:41:51 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:41:51 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:41:51 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 14:41:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.131s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:42:50 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:42:51 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:42:51 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:42:51 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 14:42:51 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Rebuilding the list of instances to heal {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 14:42:51 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Didn't find any instances for network info cache update. {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 14:42:51 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:42:51 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:42:52 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:42:52 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 14:42:52 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:42:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:42:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:42:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:42:52 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 14:42:52 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:42:52 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:42:52 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=10183MB free_disk=25.97787094116211GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 14:42:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:42:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:42:52 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 14:42:52 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 14:42:52 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:42:52 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:42:52 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 14:42:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:42:53 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:42:53 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:43:51 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:43:51 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:43:51 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:43:51 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 14:43:51 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Rebuilding the list of instances to heal {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 14:43:51 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Didn't find any instances for network info cache update. {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 14:43:51 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:43:52 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:43:52 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:43:52 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:43:52 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 14:43:53 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:43:54 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:43:54 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:43:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:43:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:43:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:43:54 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 14:43:54 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:43:54 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:43:54 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=9477MB free_disk=25.999977111816406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 14:43:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:43:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:43:54 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 14:43:54 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 14:43:54 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:43:54 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:43:55 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 14:43:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.199s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:43:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "20abf743-de5b-4122-aad0-e2124c7804b7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:43:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "20abf743-de5b-4122-aad0-e2124c7804b7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:43:57 user nova-compute[72239]: DEBUG nova.compute.manager [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 14:43:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:43:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:43:57 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 14:43:57 user nova-compute[72239]: INFO nova.compute.claims [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Claim successful on node user
Jul 31 14:43:57 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:43:57 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:43:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:43:57 user nova-compute[72239]: DEBUG nova.compute.manager [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 14:43:57 user nova-compute[72239]: DEBUG nova.compute.manager [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 14:43:57 user nova-compute[72239]: DEBUG nova.network.neutron [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 14:43:57 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 14:43:57 user nova-compute[72239]: DEBUG nova.compute.manager [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 14:43:58 user nova-compute[72239]: DEBUG nova.compute.manager [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 14:43:58 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 14:43:58 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Creating image(s)
Jul 31 14:43:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "/opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:43:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "/opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:43:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "/opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:43:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "ca449065000c92aac3b7b9fa685f9a7710929444" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:43:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:43:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444.part --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:43:58 user nova-compute[72239]: DEBUG nova.policy [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '94ab9298205143d489f678b28be5b085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8281237f9c417a9685e55826911e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 14:43:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444.part --force-share --output=json" returned: 0 in 0.132s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:43:58 user nova-compute[72239]: DEBUG nova.virt.images [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] c6afbfe5-0fbc-464d-978f-d1243b0a6ba8 was qcow2, converting to raw {{(pid=72239) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 31 14:43:58 user nova-compute[72239]: DEBUG nova.privsep.utils [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72239) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 14:43:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444.part /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444.converted {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:43:59 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444.part /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444.converted" returned: 0 in 0.163s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:43:59 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444.converted --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:43:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Acquiring lock "6716534f-ae47-4b7d-bfd8-10f94ea8a182" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:43:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Lock "6716534f-ae47-4b7d-bfd8-10f94ea8a182" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:43:59 user nova-compute[72239]: DEBUG nova.compute.manager [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 14:43:59 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444.converted --force-share --output=json" returned: 0 in 0.141s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:43:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.114s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:43:59 user nova-compute[72239]: INFO oslo.privsep.daemon [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpv00j8ds5/privsep.sock']
Jul 31 14:43:59 user sudo[81389]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpv00j8ds5/privsep.sock
Jul 31 14:43:59 user sudo[81389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 31 14:43:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:43:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:43:59 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 14:43:59 user nova-compute[72239]: INFO nova.compute.claims [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Claim successful on node user
Jul 31 14:43:59 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:43:59 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:43:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.329s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:43:59 user nova-compute[72239]: DEBUG nova.compute.manager [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 14:43:59 user nova-compute[72239]: DEBUG nova.compute.manager [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 14:43:59 user nova-compute[72239]: DEBUG nova.network.neutron [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 14:43:59 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 14:43:59 user nova-compute[72239]: DEBUG nova.compute.manager [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 14:43:59 user nova-compute[72239]: DEBUG nova.compute.manager [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 14:43:59 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 14:43:59 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Creating image(s)
Jul 31 14:43:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Acquiring lock "/opt/stack/data/nova/instances/6716534f-ae47-4b7d-bfd8-10f94ea8a182/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:43:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Lock "/opt/stack/data/nova/instances/6716534f-ae47-4b7d-bfd8-10f94ea8a182/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:43:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Lock "/opt/stack/data/nova/instances/6716534f-ae47-4b7d-bfd8-10f94ea8a182/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:00 user nova-compute[72239]: DEBUG nova.policy [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '91360d7bd8654fe0ac076a96300cdd42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ffc3a1968554e5fa9550a9f4c37735d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 14:44:01 user sudo[81389]: pam_unix(sudo:session): session closed for user root
Jul 31 14:44:01 user nova-compute[72239]: INFO oslo.privsep.daemon [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Spawned new privsep daemon via rootwrap
Jul 31 14:44:01 user nova-compute[72239]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 31 14:44:01 user nova-compute[72239]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 31 14:44:01 user nova-compute[72239]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 31 14:44:01 user nova-compute[72239]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81392
Jul 31 14:44:01 user nova-compute[72239]: WARNING oslo_privsep.priv_context [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] privsep daemon already running
Jul 31 14:44:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.139s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "ca449065000c92aac3b7b9fa685f9a7710929444" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.165s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Acquiring lock "ca449065000c92aac3b7b9fa685f9a7710929444" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.132s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk 1073741824" returned: 0 in 0.057s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.170s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.149s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:01 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Checking if we can resize image /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 14:44:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.149s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/6716534f-ae47-4b7d-bfd8-10f94ea8a182/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/6716534f-ae47-4b7d-bfd8-10f94ea8a182/disk 1073741824" returned: 0 in 0.068s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:01 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Cannot resize image /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 14:44:01 user nova-compute[72239]: DEBUG nova.objects.instance [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lazy-loading 'migration_context' on Instance uuid 20abf743-de5b-4122-aad0-e2124c7804b7 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:44:01 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 14:44:01 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Ensure instance console log exists: /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 14:44:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.153s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:02 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6716534f-ae47-4b7d-bfd8-10f94ea8a182/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 14:44:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6716534f-ae47-4b7d-bfd8-10f94ea8a182/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6716534f-ae47-4b7d-bfd8-10f94ea8a182/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:02 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Cannot resize image /opt/stack/data/nova/instances/6716534f-ae47-4b7d-bfd8-10f94ea8a182/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 14:44:02 user nova-compute[72239]: DEBUG nova.objects.instance [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Lazy-loading 'migration_context' on Instance uuid 6716534f-ae47-4b7d-bfd8-10f94ea8a182 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:44:02 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 14:44:02 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Ensure instance console log exists: /opt/stack/data/nova/instances/6716534f-ae47-4b7d-bfd8-10f94ea8a182/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 14:44:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:02 user nova-compute[72239]: DEBUG nova.network.neutron [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Successfully created port: 025cadd3-7b0b-4a32-a973-d48a5ce7cfb4 {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:44:03 user nova-compute[72239]: DEBUG nova.network.neutron [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Successfully created port: 5606e369-50ff-4ebd-a3a4-7da83520dd63 {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:44:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "7d81b881-b44e-4fb3-8245-9dea634bdec9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:04 user nova-compute[72239]: DEBUG nova.compute.manager [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 14:44:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:04 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 14:44:04 user nova-compute[72239]: INFO nova.compute.claims [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Claim successful on node user
Jul 31 14:44:05 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:44:05 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:44:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.334s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:05 user nova-compute[72239]: DEBUG nova.compute.manager [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 14:44:05 user nova-compute[72239]: DEBUG nova.compute.manager [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 14:44:05 user nova-compute[72239]: DEBUG nova.network.neutron [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 14:44:05 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 14:44:05 user nova-compute[72239]: DEBUG nova.compute.manager [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 14:44:05 user nova-compute[72239]: DEBUG nova.compute.manager [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 14:44:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 14:44:05 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Creating image(s)
Jul 31 14:44:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "/opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "/opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "/opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.139s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "ca449065000c92aac3b7b9fa685f9a7710929444" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:05 user nova-compute[72239]: DEBUG nova.policy [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f10fd7b9c1d34ca5b37150f34ea09ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959107d575f04ba2b0ac800ed2ef61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 14:44:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.273s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk 1073741824" returned: 0 in 0.043s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.320s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.134s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:05 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 14:44:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json" returned: 0 in 0.126s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:06 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Cannot resize image /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 14:44:06 user nova-compute[72239]: DEBUG nova.objects.instance [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lazy-loading 'migration_context' on Instance uuid 7d81b881-b44e-4fb3-8245-9dea634bdec9 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:44:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 14:44:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Ensure instance console log exists: /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 14:44:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:06 user nova-compute[72239]: DEBUG nova.network.neutron [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Successfully updated port: 025cadd3-7b0b-4a32-a973-d48a5ce7cfb4 {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:44:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "refresh_cache-20abf743-de5b-4122-aad0-e2124c7804b7" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:44:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquired lock "refresh_cache-20abf743-de5b-4122-aad0-e2124c7804b7" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:44:06 user nova-compute[72239]: DEBUG nova.network.neutron [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:44:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "079a5ed7-ee25-495b-a2a4-924d830a670a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "079a5ed7-ee25-495b-a2a4-924d830a670a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:06 user nova-compute[72239]: DEBUG nova.compute.manager [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 14:44:06 user nova-compute[72239]: DEBUG nova.network.neutron [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:44:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:06 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 14:44:06 user nova-compute[72239]: INFO nova.compute.claims [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Claim successful on node user
Jul 31 14:44:06 user nova-compute[72239]: DEBUG nova.compute.manager [req-68c26f1c-4ceb-460b-8593-76e09a24045d req-e6e7ff65-91ea-40dc-9b6e-650382561003 service nova] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Received event network-changed-025cadd3-7b0b-4a32-a973-d48a5ce7cfb4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:44:06 user nova-compute[72239]: DEBUG nova.compute.manager [req-68c26f1c-4ceb-460b-8593-76e09a24045d req-e6e7ff65-91ea-40dc-9b6e-650382561003 service nova] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Refreshing instance network info cache due to event network-changed-025cadd3-7b0b-4a32-a973-d48a5ce7cfb4. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:44:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-68c26f1c-4ceb-460b-8593-76e09a24045d req-e6e7ff65-91ea-40dc-9b6e-650382561003 service nova] Acquiring lock "refresh_cache-20abf743-de5b-4122-aad0-e2124c7804b7" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:44:06 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:44:06 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:44:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.320s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:06 user nova-compute[72239]: DEBUG nova.compute.manager [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 14:44:06 user nova-compute[72239]: DEBUG nova.compute.manager [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 14:44:06 user nova-compute[72239]: DEBUG nova.network.neutron [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 14:44:06 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 14:44:06 user nova-compute[72239]: DEBUG nova.compute.manager [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 14:44:06 user nova-compute[72239]: DEBUG nova.compute.manager [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 14:44:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 14:44:07 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Creating image(s)
Jul 31 14:44:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "/opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "/opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "/opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.013s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.121s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "ca449065000c92aac3b7b9fa685f9a7710929444" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG nova.policy [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f10fd7b9c1d34ca5b37150f34ea09ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959107d575f04ba2b0ac800ed2ef61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.141s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk 1073741824" returned: 0 in 0.046s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.190s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.129s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Checking if we can resize image /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Cannot resize image /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG nova.objects.instance [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lazy-loading 'migration_context' on Instance uuid 079a5ed7-ee25-495b-a2a4-924d830a670a {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG nova.network.neutron [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Updating instance_info_cache with network_info: [{"id": "025cadd3-7b0b-4a32-a973-d48a5ce7cfb4", "address": "fa:16:3e:5e:74:46", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap025cadd3-7b", "ovs_interfaceid": "025cadd3-7b0b-4a32-a973-d48a5ce7cfb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Ensure instance console log exists: /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Releasing lock "refresh_cache-20abf743-de5b-4122-aad0-e2124c7804b7" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG nova.compute.manager [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Instance network_info: |[{"id": "025cadd3-7b0b-4a32-a973-d48a5ce7cfb4", "address": "fa:16:3e:5e:74:46", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap025cadd3-7b", "ovs_interfaceid": "025cadd3-7b0b-4a32-a973-d48a5ce7cfb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-68c26f1c-4ceb-460b-8593-76e09a24045d req-e6e7ff65-91ea-40dc-9b6e-650382561003 service nova] Acquired lock "refresh_cache-20abf743-de5b-4122-aad0-e2124c7804b7" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG nova.network.neutron [req-68c26f1c-4ceb-460b-8593-76e09a24045d req-e6e7ff65-91ea-40dc-9b6e-650382561003 service nova] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Refreshing network info cache for port 025cadd3-7b0b-4a32-a973-d48a5ce7cfb4 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Start _get_guest_xml network_info=[{"id": "025cadd3-7b0b-4a32-a973-d48a5ce7cfb4", "address": "fa:16:3e:5e:74:46", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap025cadd3-7b", "ovs_interfaceid": "025cadd3-7b0b-4a32-a973-d48a5ce7cfb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:44:07 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:44:07 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:44:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG nova.privsep.utils [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72239) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:43:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-162604998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-162604998',id=1,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d8281237f9c417a9685e55826911e1b',ramdisk_id='',reservation_id='r-3m15iawb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-148379254',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:43:58Z,user_data=None,user_id='94ab9298205143d489f678b28be5b085',uuid=20abf743-de5b-4122-aad0-e2124c7804b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "025cadd3-7b0b-4a32-a973-d48a5ce7cfb4", "address": "fa:16:3e:5e:74:46", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap025cadd3-7b", "ovs_interfaceid": "025cadd3-7b0b-4a32-a973-d48a5ce7cfb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Converting VIF {"id": "025cadd3-7b0b-4a32-a973-d48a5ce7cfb4", "address": "fa:16:3e:5e:74:46", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap025cadd3-7b", "ovs_interfaceid": "025cadd3-7b0b-4a32-a973-d48a5ce7cfb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:74:46,bridge_name='br-int',has_traffic_filtering=True,id=025cadd3-7b0b-4a32-a973-d48a5ce7cfb4,network=Network(172fb80f-4bbe-4706-91cf-60540fbceb2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap025cadd3-7b') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG nova.objects.instance [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lazy-loading 'pci_devices' on Instance uuid 20abf743-de5b-4122-aad0-e2124c7804b7 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:44:07 user nova-compute[72239]:   <uuid>20abf743-de5b-4122-aad0-e2124c7804b7</uuid>
Jul 31 14:44:07 user nova-compute[72239]:   <name>instance-00000001</name>
Jul 31 14:44:07 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:44:07 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:44:07 user nova-compute[72239]:   <metadata>
Jul 31 14:44:07 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:44:07 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:44:07 user nova-compute[72239]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-162604998</nova:name>
Jul 31 14:44:07 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:44:07</nova:creationTime>
Jul 31 14:44:07 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:44:07 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:44:07 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:44:07 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:44:07 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:44:07 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:44:07 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:44:07 user nova-compute[72239]:       <nova:owner>
Jul 31 14:44:07 user nova-compute[72239]:         <nova:user uuid="94ab9298205143d489f678b28be5b085">tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member</nova:user>
Jul 31 14:44:07 user nova-compute[72239]:         <nova:project uuid="1d8281237f9c417a9685e55826911e1b">tempest-ServerBootFromVolumeStableRescueTest-148379254</nova:project>
Jul 31 14:44:07 user nova-compute[72239]:       </nova:owner>
Jul 31 14:44:07 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:44:07 user nova-compute[72239]:       <nova:ports>
Jul 31 14:44:07 user nova-compute[72239]:         <nova:port uuid="025cadd3-7b0b-4a32-a973-d48a5ce7cfb4">
Jul 31 14:44:07 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 31 14:44:07 user nova-compute[72239]:         </nova:port>
Jul 31 14:44:07 user nova-compute[72239]:       </nova:ports>
Jul 31 14:44:07 user nova-compute[72239]:     </nova:instance>
Jul 31 14:44:07 user nova-compute[72239]:   </metadata>
Jul 31 14:44:07 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:44:07 user nova-compute[72239]:     <system>
Jul 31 14:44:07 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:44:07 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:44:07 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:44:07 user nova-compute[72239]:       <entry name="serial">20abf743-de5b-4122-aad0-e2124c7804b7</entry>
Jul 31 14:44:07 user nova-compute[72239]:       <entry name="uuid">20abf743-de5b-4122-aad0-e2124c7804b7</entry>
Jul 31 14:44:07 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:44:07 user nova-compute[72239]:     </system>
Jul 31 14:44:07 user nova-compute[72239]:   </sysinfo>
Jul 31 14:44:07 user nova-compute[72239]:   <os>
Jul 31 14:44:07 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:44:07 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:44:07 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:44:07 user nova-compute[72239]:   </os>
Jul 31 14:44:07 user nova-compute[72239]:   <features>
Jul 31 14:44:07 user nova-compute[72239]:     <acpi/>
Jul 31 14:44:07 user nova-compute[72239]:     <apic/>
Jul 31 14:44:07 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:44:07 user nova-compute[72239]:   </features>
Jul 31 14:44:07 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:44:07 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:44:07 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:44:07 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:44:07 user nova-compute[72239]:   </clock>
Jul 31 14:44:07 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:44:07 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:44:07 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:44:07 user nova-compute[72239]:   </cpu>
Jul 31 14:44:07 user nova-compute[72239]:   <devices>
Jul 31 14:44:07 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:44:07 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:44:07 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk"/>
Jul 31 14:44:07 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:44:07 user nova-compute[72239]:     </disk>
Jul 31 14:44:07 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:44:07 user nova-compute[72239]:       <mac address="fa:16:3e:5e:74:46"/>
Jul 31 14:44:07 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:44:07 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:44:07 user nova-compute[72239]:       <target dev="tap025cadd3-7b"/>
Jul 31 14:44:07 user nova-compute[72239]:     </interface>
Jul 31 14:44:07 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:44:07 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/console.log" append="off"/>
Jul 31 14:44:07 user nova-compute[72239]:     </serial>
Jul 31 14:44:07 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:44:07 user nova-compute[72239]:     <video>
Jul 31 14:44:07 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:44:07 user nova-compute[72239]:     </video>
Jul 31 14:44:07 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:44:07 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:44:07 user nova-compute[72239]:     </rng>
Jul 31 14:44:07 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:44:07 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:44:07 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:44:07 user nova-compute[72239]:     </memballoon>
Jul 31 14:44:07 user nova-compute[72239]:   </devices>
Jul 31 14:44:07 user nova-compute[72239]: </domain>
Jul 31 14:44:07 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:43:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-162604998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-162604998',id=1,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d8281237f9c417a9685e55826911e1b',ramdisk_id='',reservation_id='r-3m15iawb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-148379254',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:43:58Z,user_data=None,user_id='94ab9298205143d489f678b28be5b085',uuid=20abf743-de5b-4122-aad0-e2124c7804b7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "025cadd3-7b0b-4a32-a973-d48a5ce7cfb4", "address": "fa:16:3e:5e:74:46", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap025cadd3-7b", "ovs_interfaceid": "025cadd3-7b0b-4a32-a973-d48a5ce7cfb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Converting VIF {"id": "025cadd3-7b0b-4a32-a973-d48a5ce7cfb4", "address": "fa:16:3e:5e:74:46", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap025cadd3-7b", "ovs_interfaceid": "025cadd3-7b0b-4a32-a973-d48a5ce7cfb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:74:46,bridge_name='br-int',has_traffic_filtering=True,id=025cadd3-7b0b-4a32-a973-d48a5ce7cfb4,network=Network(172fb80f-4bbe-4706-91cf-60540fbceb2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap025cadd3-7b') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG os_vif [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:74:46,bridge_name='br-int',has_traffic_filtering=True,id=025cadd3-7b0b-4a32-a973-d48a5ce7cfb4,network=Network(172fb80f-4bbe-4706-91cf-60540fbceb2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap025cadd3-7b') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Created schema index Interface.name {{(pid=72239) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Created schema index Port.name {{(pid=72239) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Created schema index Bridge.name {{(pid=72239) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [POLLOUT] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:44:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:44:07 user nova-compute[72239]: INFO oslo.privsep.daemon [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpznu4rjy7/privsep.sock']
Jul 31 14:44:07 user sudo[81466]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpznu4rjy7/privsep.sock
Jul 31 14:44:07 user sudo[81466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 31 14:44:07 user nova-compute[72239]: DEBUG nova.network.neutron [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Successfully created port: 60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:44:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:08 user nova-compute[72239]: DEBUG nova.network.neutron [req-68c26f1c-4ceb-460b-8593-76e09a24045d req-e6e7ff65-91ea-40dc-9b6e-650382561003 service nova] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Updated VIF entry in instance network info cache for port 025cadd3-7b0b-4a32-a973-d48a5ce7cfb4. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:44:08 user nova-compute[72239]: DEBUG nova.network.neutron [req-68c26f1c-4ceb-460b-8593-76e09a24045d req-e6e7ff65-91ea-40dc-9b6e-650382561003 service nova] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Updating instance_info_cache with network_info: [{"id": "025cadd3-7b0b-4a32-a973-d48a5ce7cfb4", "address": "fa:16:3e:5e:74:46", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap025cadd3-7b", "ovs_interfaceid": "025cadd3-7b0b-4a32-a973-d48a5ce7cfb4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:44:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-68c26f1c-4ceb-460b-8593-76e09a24045d req-e6e7ff65-91ea-40dc-9b6e-650382561003 service nova] Releasing lock "refresh_cache-20abf743-de5b-4122-aad0-e2124c7804b7" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:44:09 user nova-compute[72239]: DEBUG nova.network.neutron [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Successfully updated port: 5606e369-50ff-4ebd-a3a4-7da83520dd63 {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:44:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Acquiring lock "refresh_cache-6716534f-ae47-4b7d-bfd8-10f94ea8a182" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:44:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Acquired lock "refresh_cache-6716534f-ae47-4b7d-bfd8-10f94ea8a182" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:44:09 user nova-compute[72239]: DEBUG nova.network.neutron [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:44:09 user nova-compute[72239]: DEBUG nova.network.neutron [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Successfully created port: e22b0941-5069-46e7-9722-621a758253f1 {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:44:09 user nova-compute[72239]: DEBUG nova.compute.manager [req-510f1611-8c83-4412-b665-20910ad971ff req-b5e20239-b308-4c21-9858-f7e33e22f192 service nova] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Received event network-changed-5606e369-50ff-4ebd-a3a4-7da83520dd63 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:44:09 user nova-compute[72239]: DEBUG nova.compute.manager [req-510f1611-8c83-4412-b665-20910ad971ff req-b5e20239-b308-4c21-9858-f7e33e22f192 service nova] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Refreshing instance network info cache due to event network-changed-5606e369-50ff-4ebd-a3a4-7da83520dd63. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:44:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-510f1611-8c83-4412-b665-20910ad971ff req-b5e20239-b308-4c21-9858-f7e33e22f192 service nova] Acquiring lock "refresh_cache-6716534f-ae47-4b7d-bfd8-10f94ea8a182" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:44:09 user nova-compute[72239]: DEBUG nova.network.neutron [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:44:09 user sudo[81466]: pam_unix(sudo:session): session closed for user root
Jul 31 14:44:09 user nova-compute[72239]: INFO oslo.privsep.daemon [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Spawned new privsep daemon via rootwrap
Jul 31 14:44:09 user nova-compute[72239]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 31 14:44:09 user nova-compute[72239]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 31 14:44:09 user nova-compute[72239]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Jul 31 14:44:09 user nova-compute[72239]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 81477
Jul 31 14:44:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap025cadd3-7b, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:44:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap025cadd3-7b, col_values=(('external_ids', {'iface-id': '025cadd3-7b0b-4a32-a973-d48a5ce7cfb4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:74:46', 'vm-uuid': '20abf743-de5b-4122-aad0-e2124c7804b7'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:44:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:44:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:10 user nova-compute[72239]: INFO os_vif [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:74:46,bridge_name='br-int',has_traffic_filtering=True,id=025cadd3-7b0b-4a32-a973-d48a5ce7cfb4,network=Network(172fb80f-4bbe-4706-91cf-60540fbceb2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap025cadd3-7b')
Jul 31 14:44:10 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:44:10 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] No VIF found with MAC fa:16:3e:5e:74:46, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:44:10 user nova-compute[72239]: DEBUG nova.network.neutron [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Successfully updated port: 60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:44:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "refresh_cache-7d81b881-b44e-4fb3-8245-9dea634bdec9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:44:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquired lock "refresh_cache-7d81b881-b44e-4fb3-8245-9dea634bdec9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:44:10 user nova-compute[72239]: DEBUG nova.network.neutron [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:44:10 user nova-compute[72239]: DEBUG nova.network.neutron [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:44:10 user nova-compute[72239]: DEBUG nova.compute.manager [req-9da6c64a-f9d6-4564-bb74-b47f766f6e7f req-5e1b4335-b3cd-4b88-81c7-96bb0ec204e7 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received event network-changed-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:44:10 user nova-compute[72239]: DEBUG nova.compute.manager [req-9da6c64a-f9d6-4564-bb74-b47f766f6e7f req-5e1b4335-b3cd-4b88-81c7-96bb0ec204e7 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Refreshing instance network info cache due to event network-changed-60f70f18-4024-4388-ae64-3c2cca0cafbc. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:44:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-9da6c64a-f9d6-4564-bb74-b47f766f6e7f req-5e1b4335-b3cd-4b88-81c7-96bb0ec204e7 service nova] Acquiring lock "refresh_cache-7d81b881-b44e-4fb3-8245-9dea634bdec9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.network.neutron [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Updating instance_info_cache with network_info: [{"id": "5606e369-50ff-4ebd-a3a4-7da83520dd63", "address": "fa:16:3e:7d:f8:d4", "network": {"id": "4b1e409d-af08-43b1-a228-04a24d8352f5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-720428295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ffc3a1968554e5fa9550a9f4c37735d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5606e369-50", "ovs_interfaceid": "5606e369-50ff-4ebd-a3a4-7da83520dd63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Releasing lock "refresh_cache-6716534f-ae47-4b7d-bfd8-10f94ea8a182" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.compute.manager [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Instance network_info: |[{"id": "5606e369-50ff-4ebd-a3a4-7da83520dd63", "address": "fa:16:3e:7d:f8:d4", "network": {"id": "4b1e409d-af08-43b1-a228-04a24d8352f5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-720428295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ffc3a1968554e5fa9550a9f4c37735d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5606e369-50", "ovs_interfaceid": "5606e369-50ff-4ebd-a3a4-7da83520dd63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-510f1611-8c83-4412-b665-20910ad971ff req-b5e20239-b308-4c21-9858-f7e33e22f192 service nova] Acquired lock "refresh_cache-6716534f-ae47-4b7d-bfd8-10f94ea8a182" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.network.neutron [req-510f1611-8c83-4412-b665-20910ad971ff req-b5e20239-b308-4c21-9858-f7e33e22f192 service nova] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Refreshing network info cache for port 5606e369-50ff-4ebd-a3a4-7da83520dd63 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Start _get_guest_xml network_info=[{"id": "5606e369-50ff-4ebd-a3a4-7da83520dd63", "address": "fa:16:3e:7d:f8:d4", "network": {"id": "4b1e409d-af08-43b1-a228-04a24d8352f5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-720428295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ffc3a1968554e5fa9550a9f4c37735d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5606e369-50", "ovs_interfaceid": "5606e369-50ff-4ebd-a3a4-7da83520dd63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:44:11 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:44:11 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:44:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:43:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-212184800',display_name='tempest-DeleteServersTestJSON-server-212184800',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-212184800',id=2,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ffc3a1968554e5fa9550a9f4c37735d',ramdisk_id='',reservation_id='r-dvkl0t6j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1110151379',owner_user_name='tempest-DeleteServersTestJSON-1110151379-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:44:00Z,user_data=None,user_id='91360d7bd8654fe0ac076a96300cdd42',uuid=6716534f-ae47-4b7d-bfd8-10f94ea8a182,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5606e369-50ff-4ebd-a3a4-7da83520dd63", "address": "fa:16:3e:7d:f8:d4", "network": {"id": "4b1e409d-af08-43b1-a228-04a24d8352f5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-720428295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ffc3a1968554e5fa9550a9f4c37735d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5606e369-50", "ovs_interfaceid": "5606e369-50ff-4ebd-a3a4-7da83520dd63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Converting VIF {"id": "5606e369-50ff-4ebd-a3a4-7da83520dd63", "address": "fa:16:3e:7d:f8:d4", "network": {"id": "4b1e409d-af08-43b1-a228-04a24d8352f5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-720428295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ffc3a1968554e5fa9550a9f4c37735d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5606e369-50", "ovs_interfaceid": "5606e369-50ff-4ebd-a3a4-7da83520dd63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:f8:d4,bridge_name='br-int',has_traffic_filtering=True,id=5606e369-50ff-4ebd-a3a4-7da83520dd63,network=Network(4b1e409d-af08-43b1-a228-04a24d8352f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5606e369-50') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.objects.instance [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Lazy-loading 'pci_devices' on Instance uuid 6716534f-ae47-4b7d-bfd8-10f94ea8a182 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:44:11 user nova-compute[72239]:   <uuid>6716534f-ae47-4b7d-bfd8-10f94ea8a182</uuid>
Jul 31 14:44:11 user nova-compute[72239]:   <name>instance-00000002</name>
Jul 31 14:44:11 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:44:11 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:44:11 user nova-compute[72239]:   <metadata>
Jul 31 14:44:11 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:44:11 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:44:11 user nova-compute[72239]:       <nova:name>tempest-DeleteServersTestJSON-server-212184800</nova:name>
Jul 31 14:44:11 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:44:11</nova:creationTime>
Jul 31 14:44:11 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:44:11 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:44:11 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:44:11 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:44:11 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:44:11 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:44:11 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:44:11 user nova-compute[72239]:       <nova:owner>
Jul 31 14:44:11 user nova-compute[72239]:         <nova:user uuid="91360d7bd8654fe0ac076a96300cdd42">tempest-DeleteServersTestJSON-1110151379-project-member</nova:user>
Jul 31 14:44:11 user nova-compute[72239]:         <nova:project uuid="5ffc3a1968554e5fa9550a9f4c37735d">tempest-DeleteServersTestJSON-1110151379</nova:project>
Jul 31 14:44:11 user nova-compute[72239]:       </nova:owner>
Jul 31 14:44:11 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:44:11 user nova-compute[72239]:       <nova:ports>
Jul 31 14:44:11 user nova-compute[72239]:         <nova:port uuid="5606e369-50ff-4ebd-a3a4-7da83520dd63">
Jul 31 14:44:11 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 31 14:44:11 user nova-compute[72239]:         </nova:port>
Jul 31 14:44:11 user nova-compute[72239]:       </nova:ports>
Jul 31 14:44:11 user nova-compute[72239]:     </nova:instance>
Jul 31 14:44:11 user nova-compute[72239]:   </metadata>
Jul 31 14:44:11 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:44:11 user nova-compute[72239]:     <system>
Jul 31 14:44:11 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:44:11 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:44:11 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:44:11 user nova-compute[72239]:       <entry name="serial">6716534f-ae47-4b7d-bfd8-10f94ea8a182</entry>
Jul 31 14:44:11 user nova-compute[72239]:       <entry name="uuid">6716534f-ae47-4b7d-bfd8-10f94ea8a182</entry>
Jul 31 14:44:11 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:44:11 user nova-compute[72239]:     </system>
Jul 31 14:44:11 user nova-compute[72239]:   </sysinfo>
Jul 31 14:44:11 user nova-compute[72239]:   <os>
Jul 31 14:44:11 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:44:11 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:44:11 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:44:11 user nova-compute[72239]:   </os>
Jul 31 14:44:11 user nova-compute[72239]:   <features>
Jul 31 14:44:11 user nova-compute[72239]:     <acpi/>
Jul 31 14:44:11 user nova-compute[72239]:     <apic/>
Jul 31 14:44:11 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:44:11 user nova-compute[72239]:   </features>
Jul 31 14:44:11 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:44:11 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:44:11 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:44:11 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:44:11 user nova-compute[72239]:   </clock>
Jul 31 14:44:11 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:44:11 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:44:11 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:44:11 user nova-compute[72239]:   </cpu>
Jul 31 14:44:11 user nova-compute[72239]:   <devices>
Jul 31 14:44:11 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:44:11 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:44:11 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/6716534f-ae47-4b7d-bfd8-10f94ea8a182/disk"/>
Jul 31 14:44:11 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:44:11 user nova-compute[72239]:     </disk>
Jul 31 14:44:11 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:44:11 user nova-compute[72239]:       <mac address="fa:16:3e:7d:f8:d4"/>
Jul 31 14:44:11 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:44:11 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:44:11 user nova-compute[72239]:       <target dev="tap5606e369-50"/>
Jul 31 14:44:11 user nova-compute[72239]:     </interface>
Jul 31 14:44:11 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:44:11 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/6716534f-ae47-4b7d-bfd8-10f94ea8a182/console.log" append="off"/>
Jul 31 14:44:11 user nova-compute[72239]:     </serial>
Jul 31 14:44:11 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:44:11 user nova-compute[72239]:     <video>
Jul 31 14:44:11 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:44:11 user nova-compute[72239]:     </video>
Jul 31 14:44:11 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:44:11 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:44:11 user nova-compute[72239]:     </rng>
Jul 31 14:44:11 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:44:11 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:44:11 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:44:11 user nova-compute[72239]:     </memballoon>
Jul 31 14:44:11 user nova-compute[72239]:   </devices>
Jul 31 14:44:11 user nova-compute[72239]: </domain>
Jul 31 14:44:11 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:43:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-212184800',display_name='tempest-DeleteServersTestJSON-server-212184800',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-212184800',id=2,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5ffc3a1968554e5fa9550a9f4c37735d',ramdisk_id='',reservation_id='r-dvkl0t6j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1110151379',owner_user_name='tempest-DeleteServersTestJSON-1110151379-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:44:00Z,user_data=None,user_id='91360d7bd8654fe0ac076a96300cdd42',uuid=6716534f-ae47-4b7d-bfd8-10f94ea8a182,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5606e369-50ff-4ebd-a3a4-7da83520dd63", "address": "fa:16:3e:7d:f8:d4", "network": {"id": "4b1e409d-af08-43b1-a228-04a24d8352f5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-720428295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ffc3a1968554e5fa9550a9f4c37735d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5606e369-50", "ovs_interfaceid": "5606e369-50ff-4ebd-a3a4-7da83520dd63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Converting VIF {"id": "5606e369-50ff-4ebd-a3a4-7da83520dd63", "address": "fa:16:3e:7d:f8:d4", "network": {"id": "4b1e409d-af08-43b1-a228-04a24d8352f5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-720428295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ffc3a1968554e5fa9550a9f4c37735d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5606e369-50", "ovs_interfaceid": "5606e369-50ff-4ebd-a3a4-7da83520dd63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:f8:d4,bridge_name='br-int',has_traffic_filtering=True,id=5606e369-50ff-4ebd-a3a4-7da83520dd63,network=Network(4b1e409d-af08-43b1-a228-04a24d8352f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5606e369-50') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG os_vif [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:f8:d4,bridge_name='br-int',has_traffic_filtering=True,id=5606e369-50ff-4ebd-a3a4-7da83520dd63,network=Network(4b1e409d-af08-43b1-a228-04a24d8352f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5606e369-50') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5606e369-50, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5606e369-50, col_values=(('external_ids', {'iface-id': '5606e369-50ff-4ebd-a3a4-7da83520dd63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:f8:d4', 'vm-uuid': '6716534f-ae47-4b7d-bfd8-10f94ea8a182'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:11 user nova-compute[72239]: INFO os_vif [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:f8:d4,bridge_name='br-int',has_traffic_filtering=True,id=5606e369-50ff-4ebd-a3a4-7da83520dd63,network=Network(4b1e409d-af08-43b1-a228-04a24d8352f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5606e369-50')
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] No VIF found with MAC fa:16:3e:7d:f8:d4, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.network.neutron [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Updating instance_info_cache with network_info: [{"id": "60f70f18-4024-4388-ae64-3c2cca0cafbc", "address": "fa:16:3e:a5:de:4b", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f70f18-40", "ovs_interfaceid": "60f70f18-4024-4388-ae64-3c2cca0cafbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Releasing lock "refresh_cache-7d81b881-b44e-4fb3-8245-9dea634bdec9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.compute.manager [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Instance network_info: |[{"id": "60f70f18-4024-4388-ae64-3c2cca0cafbc", "address": "fa:16:3e:a5:de:4b", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f70f18-40", "ovs_interfaceid": "60f70f18-4024-4388-ae64-3c2cca0cafbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-9da6c64a-f9d6-4564-bb74-b47f766f6e7f req-5e1b4335-b3cd-4b88-81c7-96bb0ec204e7 service nova] Acquired lock "refresh_cache-7d81b881-b44e-4fb3-8245-9dea634bdec9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.network.neutron [req-9da6c64a-f9d6-4564-bb74-b47f766f6e7f req-5e1b4335-b3cd-4b88-81c7-96bb0ec204e7 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Refreshing network info cache for port 60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Start _get_guest_xml network_info=[{"id": "60f70f18-4024-4388-ae64-3c2cca0cafbc", "address": "fa:16:3e:a5:de:4b", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f70f18-40", "ovs_interfaceid": "60f70f18-4024-4388-ae64-3c2cca0cafbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.network.neutron [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Successfully updated port: e22b0941-5069-46e7-9722-621a758253f1 {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:44:11 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:44:11 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "refresh_cache-079a5ed7-ee25-495b-a2a4-924d830a670a" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquired lock "refresh_cache-079a5ed7-ee25-495b-a2a4-924d830a670a" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.network.neutron [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:44:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-263563606',display_name='tempest-ServerRescueNegativeTestJSON-server-263563606',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-263563606',id=3,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='959107d575f04ba2b0ac800ed2ef61fa',ramdisk_id='',reservation_id='r-3kc25083',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1296361049',owner_user_name='tempest-ServerRescueNegativeTestJSON-1296361049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:44:05Z,user_data=None,user_id='f10fd7b9c1d34ca5b37150f34ea09ffa',uuid=7d81b881-b44e-4fb3-8245-9dea634bdec9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60f70f18-4024-4388-ae64-3c2cca0cafbc", "address": "fa:16:3e:a5:de:4b", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f70f18-40", "ovs_interfaceid": "60f70f18-4024-4388-ae64-3c2cca0cafbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Converting VIF {"id": "60f70f18-4024-4388-ae64-3c2cca0cafbc", "address": "fa:16:3e:a5:de:4b", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f70f18-40", "ovs_interfaceid": "60f70f18-4024-4388-ae64-3c2cca0cafbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:de:4b,bridge_name='br-int',has_traffic_filtering=True,id=60f70f18-4024-4388-ae64-3c2cca0cafbc,network=Network(02dfd673-dd23-4768-9c30-291cdbecbb64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f70f18-40') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.objects.instance [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d81b881-b44e-4fb3-8245-9dea634bdec9 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:44:11 user nova-compute[72239]:   <uuid>7d81b881-b44e-4fb3-8245-9dea634bdec9</uuid>
Jul 31 14:44:11 user nova-compute[72239]:   <name>instance-00000003</name>
Jul 31 14:44:11 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:44:11 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:44:11 user nova-compute[72239]:   <metadata>
Jul 31 14:44:11 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:44:11 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:44:11 user nova-compute[72239]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-263563606</nova:name>
Jul 31 14:44:11 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:44:11</nova:creationTime>
Jul 31 14:44:11 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:44:11 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:44:11 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:44:11 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:44:11 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:44:11 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:44:11 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:44:11 user nova-compute[72239]:       <nova:owner>
Jul 31 14:44:11 user nova-compute[72239]:         <nova:user uuid="f10fd7b9c1d34ca5b37150f34ea09ffa">tempest-ServerRescueNegativeTestJSON-1296361049-project-member</nova:user>
Jul 31 14:44:11 user nova-compute[72239]:         <nova:project uuid="959107d575f04ba2b0ac800ed2ef61fa">tempest-ServerRescueNegativeTestJSON-1296361049</nova:project>
Jul 31 14:44:11 user nova-compute[72239]:       </nova:owner>
Jul 31 14:44:11 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:44:11 user nova-compute[72239]:       <nova:ports>
Jul 31 14:44:11 user nova-compute[72239]:         <nova:port uuid="60f70f18-4024-4388-ae64-3c2cca0cafbc">
Jul 31 14:44:11 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 31 14:44:11 user nova-compute[72239]:         </nova:port>
Jul 31 14:44:11 user nova-compute[72239]:       </nova:ports>
Jul 31 14:44:11 user nova-compute[72239]:     </nova:instance>
Jul 31 14:44:11 user nova-compute[72239]:   </metadata>
Jul 31 14:44:11 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:44:11 user nova-compute[72239]:     <system>
Jul 31 14:44:11 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:44:11 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:44:11 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:44:11 user nova-compute[72239]:       <entry name="serial">7d81b881-b44e-4fb3-8245-9dea634bdec9</entry>
Jul 31 14:44:11 user nova-compute[72239]:       <entry name="uuid">7d81b881-b44e-4fb3-8245-9dea634bdec9</entry>
Jul 31 14:44:11 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:44:11 user nova-compute[72239]:     </system>
Jul 31 14:44:11 user nova-compute[72239]:   </sysinfo>
Jul 31 14:44:11 user nova-compute[72239]:   <os>
Jul 31 14:44:11 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:44:11 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:44:11 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:44:11 user nova-compute[72239]:   </os>
Jul 31 14:44:11 user nova-compute[72239]:   <features>
Jul 31 14:44:11 user nova-compute[72239]:     <acpi/>
Jul 31 14:44:11 user nova-compute[72239]:     <apic/>
Jul 31 14:44:11 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:44:11 user nova-compute[72239]:   </features>
Jul 31 14:44:11 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:44:11 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:44:11 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:44:11 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:44:11 user nova-compute[72239]:   </clock>
Jul 31 14:44:11 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:44:11 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:44:11 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:44:11 user nova-compute[72239]:   </cpu>
Jul 31 14:44:11 user nova-compute[72239]:   <devices>
Jul 31 14:44:11 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:44:11 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:44:11 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk"/>
Jul 31 14:44:11 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:44:11 user nova-compute[72239]:     </disk>
Jul 31 14:44:11 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:44:11 user nova-compute[72239]:       <mac address="fa:16:3e:a5:de:4b"/>
Jul 31 14:44:11 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:44:11 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:44:11 user nova-compute[72239]:       <target dev="tap60f70f18-40"/>
Jul 31 14:44:11 user nova-compute[72239]:     </interface>
Jul 31 14:44:11 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:44:11 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/console.log" append="off"/>
Jul 31 14:44:11 user nova-compute[72239]:     </serial>
Jul 31 14:44:11 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:44:11 user nova-compute[72239]:     <video>
Jul 31 14:44:11 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:44:11 user nova-compute[72239]:     </video>
Jul 31 14:44:11 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:44:11 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:44:11 user nova-compute[72239]:     </rng>
Jul 31 14:44:11 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:44:11 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:44:11 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:44:11 user nova-compute[72239]:     </memballoon>
Jul 31 14:44:11 user nova-compute[72239]:   </devices>
Jul 31 14:44:11 user nova-compute[72239]: </domain>
Jul 31 14:44:11 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:44:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-263563606',display_name='tempest-ServerRescueNegativeTestJSON-server-263563606',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-263563606',id=3,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='959107d575f04ba2b0ac800ed2ef61fa',ramdisk_id='',reservation_id='r-3kc25083',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1296361049',owner_user_name='tempest-ServerRescueNegativeTestJSON-1296361049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:44:05Z,user_data=None,user_id='f10fd7b9c1d34ca5b37150f34ea09ffa',uuid=7d81b881-b44e-4fb3-8245-9dea634bdec9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60f70f18-4024-4388-ae64-3c2cca0cafbc", "address": "fa:16:3e:a5:de:4b", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f70f18-40", "ovs_interfaceid": "60f70f18-4024-4388-ae64-3c2cca0cafbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Converting VIF {"id": "60f70f18-4024-4388-ae64-3c2cca0cafbc", "address": "fa:16:3e:a5:de:4b", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f70f18-40", "ovs_interfaceid": "60f70f18-4024-4388-ae64-3c2cca0cafbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:de:4b,bridge_name='br-int',has_traffic_filtering=True,id=60f70f18-4024-4388-ae64-3c2cca0cafbc,network=Network(02dfd673-dd23-4768-9c30-291cdbecbb64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f70f18-40') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG os_vif [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:de:4b,bridge_name='br-int',has_traffic_filtering=True,id=60f70f18-4024-4388-ae64-3c2cca0cafbc,network=Network(02dfd673-dd23-4768-9c30-291cdbecbb64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f70f18-40') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60f70f18-40, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap60f70f18-40, col_values=(('external_ids', {'iface-id': '60f70f18-4024-4388-ae64-3c2cca0cafbc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a5:de:4b', 'vm-uuid': '7d81b881-b44e-4fb3-8245-9dea634bdec9'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:11 user nova-compute[72239]: INFO os_vif [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:de:4b,bridge_name='br-int',has_traffic_filtering=True,id=60f70f18-4024-4388-ae64-3c2cca0cafbc,network=Network(02dfd673-dd23-4768-9c30-291cdbecbb64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f70f18-40')
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] No VIF found with MAC fa:16:3e:a5:de:4b, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:44:11 user nova-compute[72239]: DEBUG nova.network.neutron [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG nova.network.neutron [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Updating instance_info_cache with network_info: [{"id": "e22b0941-5069-46e7-9722-621a758253f1", "address": "fa:16:3e:5e:88:13", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape22b0941-50", "ovs_interfaceid": "e22b0941-5069-46e7-9722-621a758253f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Releasing lock "refresh_cache-079a5ed7-ee25-495b-a2a4-924d830a670a" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG nova.compute.manager [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Instance network_info: |[{"id": "e22b0941-5069-46e7-9722-621a758253f1", "address": "fa:16:3e:5e:88:13", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape22b0941-50", "ovs_interfaceid": "e22b0941-5069-46e7-9722-621a758253f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Start _get_guest_xml network_info=[{"id": "e22b0941-5069-46e7-9722-621a758253f1", "address": "fa:16:3e:5e:88:13", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape22b0941-50", "ovs_interfaceid": "e22b0941-5069-46e7-9722-621a758253f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:44:12 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:44:12 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:44:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:44:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1703908301',display_name='tempest-ServerRescueNegativeTestJSON-server-1703908301',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1703908301',id=4,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='959107d575f04ba2b0ac800ed2ef61fa',ramdisk_id='',reservation_id='r-ay6781r8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1296361049',owner_user_name='tempest-ServerRescueNegativeTestJSON-1296361049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:44:07Z,user_data=None,user_id='f10fd7b9c1d34ca5b37150f34ea09ffa',uuid=079a5ed7-ee25-495b-a2a4-924d830a670a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e22b0941-5069-46e7-9722-621a758253f1", "address": "fa:16:3e:5e:88:13", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape22b0941-50", "ovs_interfaceid": "e22b0941-5069-46e7-9722-621a758253f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Converting VIF {"id": "e22b0941-5069-46e7-9722-621a758253f1", "address": "fa:16:3e:5e:88:13", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape22b0941-50", "ovs_interfaceid": "e22b0941-5069-46e7-9722-621a758253f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:88:13,bridge_name='br-int',has_traffic_filtering=True,id=e22b0941-5069-46e7-9722-621a758253f1,network=Network(02dfd673-dd23-4768-9c30-291cdbecbb64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape22b0941-50') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG nova.objects.instance [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lazy-loading 'pci_devices' on Instance uuid 079a5ed7-ee25-495b-a2a4-924d830a670a {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG nova.compute.manager [req-dfd85ab9-21f0-4370-b45d-3c9adff5caa9 req-aed806b5-9d69-45a9-aa49-5619ea625986 service nova] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Received event network-vif-plugged-025cadd3-7b0b-4a32-a973-d48a5ce7cfb4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-dfd85ab9-21f0-4370-b45d-3c9adff5caa9 req-aed806b5-9d69-45a9-aa49-5619ea625986 service nova] Acquiring lock "20abf743-de5b-4122-aad0-e2124c7804b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-dfd85ab9-21f0-4370-b45d-3c9adff5caa9 req-aed806b5-9d69-45a9-aa49-5619ea625986 service nova] Lock "20abf743-de5b-4122-aad0-e2124c7804b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-dfd85ab9-21f0-4370-b45d-3c9adff5caa9 req-aed806b5-9d69-45a9-aa49-5619ea625986 service nova] Lock "20abf743-de5b-4122-aad0-e2124c7804b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG nova.compute.manager [req-dfd85ab9-21f0-4370-b45d-3c9adff5caa9 req-aed806b5-9d69-45a9-aa49-5619ea625986 service nova] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] No waiting events found dispatching network-vif-plugged-025cadd3-7b0b-4a32-a973-d48a5ce7cfb4 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:44:12 user nova-compute[72239]: WARNING nova.compute.manager [req-dfd85ab9-21f0-4370-b45d-3c9adff5caa9 req-aed806b5-9d69-45a9-aa49-5619ea625986 service nova] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Received unexpected event network-vif-plugged-025cadd3-7b0b-4a32-a973-d48a5ce7cfb4 for instance with vm_state building and task_state spawning.
Jul 31 14:44:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:44:12 user nova-compute[72239]:   <uuid>079a5ed7-ee25-495b-a2a4-924d830a670a</uuid>
Jul 31 14:44:12 user nova-compute[72239]:   <name>instance-00000004</name>
Jul 31 14:44:12 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:44:12 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:44:12 user nova-compute[72239]:   <metadata>
Jul 31 14:44:12 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:44:12 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:44:12 user nova-compute[72239]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1703908301</nova:name>
Jul 31 14:44:12 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:44:12</nova:creationTime>
Jul 31 14:44:12 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:44:12 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:44:12 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:44:12 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:44:12 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:44:12 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:44:12 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:44:12 user nova-compute[72239]:       <nova:owner>
Jul 31 14:44:12 user nova-compute[72239]:         <nova:user uuid="f10fd7b9c1d34ca5b37150f34ea09ffa">tempest-ServerRescueNegativeTestJSON-1296361049-project-member</nova:user>
Jul 31 14:44:12 user nova-compute[72239]:         <nova:project uuid="959107d575f04ba2b0ac800ed2ef61fa">tempest-ServerRescueNegativeTestJSON-1296361049</nova:project>
Jul 31 14:44:12 user nova-compute[72239]:       </nova:owner>
Jul 31 14:44:12 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:44:12 user nova-compute[72239]:       <nova:ports>
Jul 31 14:44:12 user nova-compute[72239]:         <nova:port uuid="e22b0941-5069-46e7-9722-621a758253f1">
Jul 31 14:44:12 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 31 14:44:12 user nova-compute[72239]:         </nova:port>
Jul 31 14:44:12 user nova-compute[72239]:       </nova:ports>
Jul 31 14:44:12 user nova-compute[72239]:     </nova:instance>
Jul 31 14:44:12 user nova-compute[72239]:   </metadata>
Jul 31 14:44:12 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:44:12 user nova-compute[72239]:     <system>
Jul 31 14:44:12 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:44:12 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:44:12 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:44:12 user nova-compute[72239]:       <entry name="serial">079a5ed7-ee25-495b-a2a4-924d830a670a</entry>
Jul 31 14:44:12 user nova-compute[72239]:       <entry name="uuid">079a5ed7-ee25-495b-a2a4-924d830a670a</entry>
Jul 31 14:44:12 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:44:12 user nova-compute[72239]:     </system>
Jul 31 14:44:12 user nova-compute[72239]:   </sysinfo>
Jul 31 14:44:12 user nova-compute[72239]:   <os>
Jul 31 14:44:12 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:44:12 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:44:12 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:44:12 user nova-compute[72239]:   </os>
Jul 31 14:44:12 user nova-compute[72239]:   <features>
Jul 31 14:44:12 user nova-compute[72239]:     <acpi/>
Jul 31 14:44:12 user nova-compute[72239]:     <apic/>
Jul 31 14:44:12 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:44:12 user nova-compute[72239]:   </features>
Jul 31 14:44:12 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:44:12 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:44:12 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:44:12 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:44:12 user nova-compute[72239]:   </clock>
Jul 31 14:44:12 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:44:12 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:44:12 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:44:12 user nova-compute[72239]:   </cpu>
Jul 31 14:44:12 user nova-compute[72239]:   <devices>
Jul 31 14:44:12 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:44:12 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:44:12 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk"/>
Jul 31 14:44:12 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:44:12 user nova-compute[72239]:     </disk>
Jul 31 14:44:12 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:44:12 user nova-compute[72239]:       <mac address="fa:16:3e:5e:88:13"/>
Jul 31 14:44:12 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:44:12 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:44:12 user nova-compute[72239]:       <target dev="tape22b0941-50"/>
Jul 31 14:44:12 user nova-compute[72239]:     </interface>
Jul 31 14:44:12 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:44:12 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/console.log" append="off"/>
Jul 31 14:44:12 user nova-compute[72239]:     </serial>
Jul 31 14:44:12 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:44:12 user nova-compute[72239]:     <video>
Jul 31 14:44:12 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:44:12 user nova-compute[72239]:     </video>
Jul 31 14:44:12 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:44:12 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:44:12 user nova-compute[72239]:     </rng>
Jul 31 14:44:12 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:44:12 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:44:12 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:44:12 user nova-compute[72239]:     </memballoon>
Jul 31 14:44:12 user nova-compute[72239]:   </devices>
Jul 31 14:44:12 user nova-compute[72239]: </domain>
Jul 31 14:44:12 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:44:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1703908301',display_name='tempest-ServerRescueNegativeTestJSON-server-1703908301',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1703908301',id=4,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='959107d575f04ba2b0ac800ed2ef61fa',ramdisk_id='',reservation_id='r-ay6781r8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1296361049',owner_user_name='tempest-ServerRescueNegativeTestJSON-1296361049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:44:07Z,user_data=None,user_id='f10fd7b9c1d34ca5b37150f34ea09ffa',uuid=079a5ed7-ee25-495b-a2a4-924d830a670a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e22b0941-5069-46e7-9722-621a758253f1", "address": "fa:16:3e:5e:88:13", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape22b0941-50", "ovs_interfaceid": "e22b0941-5069-46e7-9722-621a758253f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Converting VIF {"id": "e22b0941-5069-46e7-9722-621a758253f1", "address": "fa:16:3e:5e:88:13", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape22b0941-50", "ovs_interfaceid": "e22b0941-5069-46e7-9722-621a758253f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:88:13,bridge_name='br-int',has_traffic_filtering=True,id=e22b0941-5069-46e7-9722-621a758253f1,network=Network(02dfd673-dd23-4768-9c30-291cdbecbb64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape22b0941-50') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG os_vif [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:88:13,bridge_name='br-int',has_traffic_filtering=True,id=e22b0941-5069-46e7-9722-621a758253f1,network=Network(02dfd673-dd23-4768-9c30-291cdbecbb64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape22b0941-50') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape22b0941-50, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape22b0941-50, col_values=(('external_ids', {'iface-id': 'e22b0941-5069-46e7-9722-621a758253f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:88:13', 'vm-uuid': '079a5ed7-ee25-495b-a2a4-924d830a670a'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG nova.compute.manager [req-a7b81b87-0fe1-4c0d-bf78-26fca6284c9c req-d51b6877-a86a-42e8-99fa-966cd48c2835 service nova] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Received event network-changed-e22b0941-5069-46e7-9722-621a758253f1 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG nova.compute.manager [req-a7b81b87-0fe1-4c0d-bf78-26fca6284c9c req-d51b6877-a86a-42e8-99fa-966cd48c2835 service nova] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Refreshing instance network info cache due to event network-changed-e22b0941-5069-46e7-9722-621a758253f1. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a7b81b87-0fe1-4c0d-bf78-26fca6284c9c req-d51b6877-a86a-42e8-99fa-966cd48c2835 service nova] Acquiring lock "refresh_cache-079a5ed7-ee25-495b-a2a4-924d830a670a" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a7b81b87-0fe1-4c0d-bf78-26fca6284c9c req-d51b6877-a86a-42e8-99fa-966cd48c2835 service nova] Acquired lock "refresh_cache-079a5ed7-ee25-495b-a2a4-924d830a670a" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG nova.network.neutron [req-a7b81b87-0fe1-4c0d-bf78-26fca6284c9c req-d51b6877-a86a-42e8-99fa-966cd48c2835 service nova] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Refreshing network info cache for port e22b0941-5069-46e7-9722-621a758253f1 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:12 user nova-compute[72239]: INFO os_vif [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:88:13,bridge_name='br-int',has_traffic_filtering=True,id=e22b0941-5069-46e7-9722-621a758253f1,network=Network(02dfd673-dd23-4768-9c30-291cdbecbb64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape22b0941-50')
Jul 31 14:44:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:44:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] No VIF found with MAC fa:16:3e:5e:88:13, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:44:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:13 user nova-compute[72239]: DEBUG nova.network.neutron [req-9da6c64a-f9d6-4564-bb74-b47f766f6e7f req-5e1b4335-b3cd-4b88-81c7-96bb0ec204e7 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Updated VIF entry in instance network info cache for port 60f70f18-4024-4388-ae64-3c2cca0cafbc. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:44:13 user nova-compute[72239]: DEBUG nova.network.neutron [req-9da6c64a-f9d6-4564-bb74-b47f766f6e7f req-5e1b4335-b3cd-4b88-81c7-96bb0ec204e7 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Updating instance_info_cache with network_info: [{"id": "60f70f18-4024-4388-ae64-3c2cca0cafbc", "address": "fa:16:3e:a5:de:4b", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f70f18-40", "ovs_interfaceid": "60f70f18-4024-4388-ae64-3c2cca0cafbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:44:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-9da6c64a-f9d6-4564-bb74-b47f766f6e7f req-5e1b4335-b3cd-4b88-81c7-96bb0ec204e7 service nova] Releasing lock "refresh_cache-7d81b881-b44e-4fb3-8245-9dea634bdec9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:44:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:14 user nova-compute[72239]: DEBUG nova.network.neutron [req-a7b81b87-0fe1-4c0d-bf78-26fca6284c9c req-d51b6877-a86a-42e8-99fa-966cd48c2835 service nova] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Updated VIF entry in instance network info cache for port e22b0941-5069-46e7-9722-621a758253f1. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:44:14 user nova-compute[72239]: DEBUG nova.network.neutron [req-a7b81b87-0fe1-4c0d-bf78-26fca6284c9c req-d51b6877-a86a-42e8-99fa-966cd48c2835 service nova] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Updating instance_info_cache with network_info: [{"id": "e22b0941-5069-46e7-9722-621a758253f1", "address": "fa:16:3e:5e:88:13", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape22b0941-50", "ovs_interfaceid": "e22b0941-5069-46e7-9722-621a758253f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:44:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a7b81b87-0fe1-4c0d-bf78-26fca6284c9c req-d51b6877-a86a-42e8-99fa-966cd48c2835 service nova] Releasing lock "refresh_cache-079a5ed7-ee25-495b-a2a4-924d830a670a" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:44:14 user nova-compute[72239]: DEBUG nova.network.neutron [req-510f1611-8c83-4412-b665-20910ad971ff req-b5e20239-b308-4c21-9858-f7e33e22f192 service nova] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Updated VIF entry in instance network info cache for port 5606e369-50ff-4ebd-a3a4-7da83520dd63. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:44:14 user nova-compute[72239]: DEBUG nova.network.neutron [req-510f1611-8c83-4412-b665-20910ad971ff req-b5e20239-b308-4c21-9858-f7e33e22f192 service nova] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Updating instance_info_cache with network_info: [{"id": "5606e369-50ff-4ebd-a3a4-7da83520dd63", "address": "fa:16:3e:7d:f8:d4", "network": {"id": "4b1e409d-af08-43b1-a228-04a24d8352f5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-720428295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ffc3a1968554e5fa9550a9f4c37735d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5606e369-50", "ovs_interfaceid": "5606e369-50ff-4ebd-a3a4-7da83520dd63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:44:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-510f1611-8c83-4412-b665-20910ad971ff req-b5e20239-b308-4c21-9858-f7e33e22f192 service nova] Releasing lock "refresh_cache-6716534f-ae47-4b7d-bfd8-10f94ea8a182" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:44:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Acquiring lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:14 user nova-compute[72239]: DEBUG nova.compute.manager [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 14:44:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:14 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 14:44:14 user nova-compute[72239]: INFO nova.compute.claims [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Claim successful on node user
Jul 31 14:44:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:14 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:44:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:14 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG nova.compute.manager [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG nova.compute.manager [req-97331a73-6e91-48e2-a119-4d7fa2922024 req-41cad330-a979-4f1e-83f7-39bcc3eb6335 service nova] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Received event network-vif-plugged-025cadd3-7b0b-4a32-a973-d48a5ce7cfb4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-97331a73-6e91-48e2-a119-4d7fa2922024 req-41cad330-a979-4f1e-83f7-39bcc3eb6335 service nova] Acquiring lock "20abf743-de5b-4122-aad0-e2124c7804b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-97331a73-6e91-48e2-a119-4d7fa2922024 req-41cad330-a979-4f1e-83f7-39bcc3eb6335 service nova] Lock "20abf743-de5b-4122-aad0-e2124c7804b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-97331a73-6e91-48e2-a119-4d7fa2922024 req-41cad330-a979-4f1e-83f7-39bcc3eb6335 service nova] Lock "20abf743-de5b-4122-aad0-e2124c7804b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG nova.compute.manager [req-97331a73-6e91-48e2-a119-4d7fa2922024 req-41cad330-a979-4f1e-83f7-39bcc3eb6335 service nova] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] No waiting events found dispatching network-vif-plugged-025cadd3-7b0b-4a32-a973-d48a5ce7cfb4 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:44:15 user nova-compute[72239]: WARNING nova.compute.manager [req-97331a73-6e91-48e2-a119-4d7fa2922024 req-41cad330-a979-4f1e-83f7-39bcc3eb6335 service nova] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Received unexpected event network-vif-plugged-025cadd3-7b0b-4a32-a973-d48a5ce7cfb4 for instance with vm_state building and task_state spawning.
Jul 31 14:44:15 user nova-compute[72239]: DEBUG nova.compute.manager [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG nova.network.neutron [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 14:44:15 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 14:44:15 user nova-compute[72239]: DEBUG nova.compute.manager [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Acquiring lock "97917500-bc78-433b-8d3d-181ed13667dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lock "97917500-bc78-433b-8d3d-181ed13667dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814655.2376504, 20abf743-de5b-4122-aad0-e2124c7804b7 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:44:15 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] VM Resumed (Lifecycle Event)
Jul 31 14:44:15 user nova-compute[72239]: DEBUG nova.compute.manager [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG nova.compute.manager [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:15 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Instance spawned successfully.
Jul 31 14:44:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG nova.compute.manager [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 14:44:15 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Creating image(s)
Jul 31 14:44:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Acquiring lock "/opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "/opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "/opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG nova.policy [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c92e1d7e3b944359fcbf9475dcacef0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '506aad3c95a94800a4cc333a3478da17', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 14:44:15 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:44:15 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814655.2379527, 20abf743-de5b-4122-aad0-e2124c7804b7 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:44:15 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] VM Started (Lifecycle Event)
Jul 31 14:44:15 user nova-compute[72239]: INFO nova.compute.manager [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Took 17.36 seconds to spawn the instance on the hypervisor.
Jul 31 14:44:15 user nova-compute[72239]: DEBUG nova.compute.manager [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 14:44:15 user nova-compute[72239]: INFO nova.compute.claims [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Claim successful on node user
Jul 31 14:44:15 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.140s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Acquiring lock "ca449065000c92aac3b7b9fa685f9a7710929444" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:15 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:44:15 user nova-compute[72239]: INFO nova.compute.manager [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Took 18.44 seconds to build instance.
Jul 31 14:44:15 user nova-compute[72239]: DEBUG nova.compute.manager [req-63089abb-448c-44df-9a71-4999b397104c req-395159f6-25e6-4c01-bf6c-8c5f486d8af5 service nova] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Received event network-vif-plugged-5606e369-50ff-4ebd-a3a4-7da83520dd63 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-63089abb-448c-44df-9a71-4999b397104c req-395159f6-25e6-4c01-bf6c-8c5f486d8af5 service nova] Acquiring lock "6716534f-ae47-4b7d-bfd8-10f94ea8a182-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-63089abb-448c-44df-9a71-4999b397104c req-395159f6-25e6-4c01-bf6c-8c5f486d8af5 service nova] Lock "6716534f-ae47-4b7d-bfd8-10f94ea8a182-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-63089abb-448c-44df-9a71-4999b397104c req-395159f6-25e6-4c01-bf6c-8c5f486d8af5 service nova] Lock "6716534f-ae47-4b7d-bfd8-10f94ea8a182-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG nova.compute.manager [req-63089abb-448c-44df-9a71-4999b397104c req-395159f6-25e6-4c01-bf6c-8c5f486d8af5 service nova] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] No waiting events found dispatching network-vif-plugged-5606e369-50ff-4ebd-a3a4-7da83520dd63 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:44:15 user nova-compute[72239]: WARNING nova.compute.manager [req-63089abb-448c-44df-9a71-4999b397104c req-395159f6-25e6-4c01-bf6c-8c5f486d8af5 service nova] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Received unexpected event network-vif-plugged-5606e369-50ff-4ebd-a3a4-7da83520dd63 for instance with vm_state building and task_state spawning.
Jul 31 14:44:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-000a89bf-bd6b-4899-93f1-84d9eeebcb64 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "20abf743-de5b-4122-aad0-e2124c7804b7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.713s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.164s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk 1073741824" returned: 0 in 0.062s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.169s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 14:44:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:16 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Cannot resize image /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 14:44:16 user nova-compute[72239]: DEBUG nova.objects.instance [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lazy-loading 'migration_context' on Instance uuid d3e3612b-c6b9-4308-a45a-1ff3805e18bb {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:44:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 14:44:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Ensure instance console log exists: /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 14:44:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:16 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:44:16 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:44:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.965s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:16 user nova-compute[72239]: DEBUG nova.compute.manager [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 14:44:16 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:16 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:16 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:16 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:16 user nova-compute[72239]: DEBUG nova.compute.manager [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 14:44:16 user nova-compute[72239]: DEBUG nova.network.neutron [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 14:44:16 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 14:44:16 user nova-compute[72239]: DEBUG nova.compute.manager [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 14:44:16 user nova-compute[72239]: DEBUG nova.compute.manager [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 14:44:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 14:44:16 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Creating image(s)
Jul 31 14:44:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Acquiring lock "/opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lock "/opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lock "/opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.162s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Acquiring lock "ca449065000c92aac3b7b9fa685f9a7710929444" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.163s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk 1073741824" returned: 0 in 0.049s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:17 user nova-compute[72239]: DEBUG nova.compute.manager [req-f3017465-5cc4-4903-9697-c378fbb256bd req-2c40f7cf-5efa-4f62-9c36-c56b81910645 service nova] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Received event network-vif-plugged-e22b0941-5069-46e7-9722-621a758253f1 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:44:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-f3017465-5cc4-4903-9697-c378fbb256bd req-2c40f7cf-5efa-4f62-9c36-c56b81910645 service nova] Acquiring lock "079a5ed7-ee25-495b-a2a4-924d830a670a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-f3017465-5cc4-4903-9697-c378fbb256bd req-2c40f7cf-5efa-4f62-9c36-c56b81910645 service nova] Lock "079a5ed7-ee25-495b-a2a4-924d830a670a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-f3017465-5cc4-4903-9697-c378fbb256bd req-2c40f7cf-5efa-4f62-9c36-c56b81910645 service nova] Lock "079a5ed7-ee25-495b-a2a4-924d830a670a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:17 user nova-compute[72239]: DEBUG nova.compute.manager [req-f3017465-5cc4-4903-9697-c378fbb256bd req-2c40f7cf-5efa-4f62-9c36-c56b81910645 service nova] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] No waiting events found dispatching network-vif-plugged-e22b0941-5069-46e7-9722-621a758253f1 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:44:17 user nova-compute[72239]: WARNING nova.compute.manager [req-f3017465-5cc4-4903-9697-c378fbb256bd req-2c40f7cf-5efa-4f62-9c36-c56b81910645 service nova] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Received unexpected event network-vif-plugged-e22b0941-5069-46e7-9722-621a758253f1 for instance with vm_state building and task_state spawning.
Jul 31 14:44:17 user nova-compute[72239]: DEBUG nova.policy [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e1df7639d9db4005841b1b3812440f83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e59830ca9e40718341c3f2b0375af0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 14:44:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.157s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:17 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Checking if we can resize image /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 14:44:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:17 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Cannot resize image /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 14:44:17 user nova-compute[72239]: DEBUG nova.objects.instance [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lazy-loading 'migration_context' on Instance uuid 97917500-bc78-433b-8d3d-181ed13667dc {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:44:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 14:44:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Ensure instance console log exists: /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 14:44:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:17 user nova-compute[72239]: DEBUG nova.compute.manager [req-412562b8-af74-41a1-af5c-a3bb48cdf653 req-eb26942c-8071-4168-98e2-3ab6f02f1858 service nova] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Received event network-vif-plugged-5606e369-50ff-4ebd-a3a4-7da83520dd63 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:44:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-412562b8-af74-41a1-af5c-a3bb48cdf653 req-eb26942c-8071-4168-98e2-3ab6f02f1858 service nova] Acquiring lock "6716534f-ae47-4b7d-bfd8-10f94ea8a182-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-412562b8-af74-41a1-af5c-a3bb48cdf653 req-eb26942c-8071-4168-98e2-3ab6f02f1858 service nova] Lock "6716534f-ae47-4b7d-bfd8-10f94ea8a182-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-412562b8-af74-41a1-af5c-a3bb48cdf653 req-eb26942c-8071-4168-98e2-3ab6f02f1858 service nova] Lock "6716534f-ae47-4b7d-bfd8-10f94ea8a182-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:17 user nova-compute[72239]: DEBUG nova.compute.manager [req-412562b8-af74-41a1-af5c-a3bb48cdf653 req-eb26942c-8071-4168-98e2-3ab6f02f1858 service nova] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] No waiting events found dispatching network-vif-plugged-5606e369-50ff-4ebd-a3a4-7da83520dd63 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:44:17 user nova-compute[72239]: WARNING nova.compute.manager [req-412562b8-af74-41a1-af5c-a3bb48cdf653 req-eb26942c-8071-4168-98e2-3ab6f02f1858 service nova] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Received unexpected event network-vif-plugged-5606e369-50ff-4ebd-a3a4-7da83520dd63 for instance with vm_state building and task_state spawning.
Jul 31 14:44:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:18 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814658.7535067, 7d81b881-b44e-4fb3-8245-9dea634bdec9 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:44:18 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] VM Resumed (Lifecycle Event)
Jul 31 14:44:18 user nova-compute[72239]: DEBUG nova.compute.manager [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:44:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 14:44:18 user nova-compute[72239]: DEBUG nova.compute.manager [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:44:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 14:44:18 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Instance spawned successfully.
Jul 31 14:44:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 14:44:18 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:44:18 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Instance spawned successfully.
Jul 31 14:44:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 14:44:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:18 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:44:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:18 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:44:18 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814658.765927, 7d81b881-b44e-4fb3-8245-9dea634bdec9 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:44:18 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] VM Started (Lifecycle Event)
Jul 31 14:44:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:18 user nova-compute[72239]: DEBUG nova.compute.manager [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:44:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 14:44:18 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Instance spawned successfully.
Jul 31 14:44:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 14:44:18 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:44:19 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:44:19 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:44:19 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814658.7675126, 6716534f-ae47-4b7d-bfd8-10f94ea8a182 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:44:19 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] VM Resumed (Lifecycle Event)
Jul 31 14:44:19 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:19 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:19 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:19 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:19 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:19 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:19 user nova-compute[72239]: INFO nova.compute.manager [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Took 13.77 seconds to spawn the instance on the hypervisor.
Jul 31 14:44:19 user nova-compute[72239]: DEBUG nova.compute.manager [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:44:19 user nova-compute[72239]: INFO nova.compute.manager [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Took 19.19 seconds to spawn the instance on the hypervisor.
Jul 31 14:44:19 user nova-compute[72239]: DEBUG nova.compute.manager [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:44:19 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:44:19 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:44:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-34a2c6b2-d041-4aa7-98be-318c933e3a7d req-1fd32cfd-b06d-4fa3-b508-be5bcc0c6f5f service nova] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Received event network-vif-plugged-e22b0941-5069-46e7-9722-621a758253f1 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:44:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-34a2c6b2-d041-4aa7-98be-318c933e3a7d req-1fd32cfd-b06d-4fa3-b508-be5bcc0c6f5f service nova] Acquiring lock "079a5ed7-ee25-495b-a2a4-924d830a670a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-34a2c6b2-d041-4aa7-98be-318c933e3a7d req-1fd32cfd-b06d-4fa3-b508-be5bcc0c6f5f service nova] Lock "079a5ed7-ee25-495b-a2a4-924d830a670a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-34a2c6b2-d041-4aa7-98be-318c933e3a7d req-1fd32cfd-b06d-4fa3-b508-be5bcc0c6f5f service nova] Lock "079a5ed7-ee25-495b-a2a4-924d830a670a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.016s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-34a2c6b2-d041-4aa7-98be-318c933e3a7d req-1fd32cfd-b06d-4fa3-b508-be5bcc0c6f5f service nova] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] No waiting events found dispatching network-vif-plugged-e22b0941-5069-46e7-9722-621a758253f1 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:44:19 user nova-compute[72239]: WARNING nova.compute.manager [req-34a2c6b2-d041-4aa7-98be-318c933e3a7d req-1fd32cfd-b06d-4fa3-b508-be5bcc0c6f5f service nova] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Received unexpected event network-vif-plugged-e22b0941-5069-46e7-9722-621a758253f1 for instance with vm_state building and task_state spawning.
Jul 31 14:44:19 user nova-compute[72239]: INFO nova.compute.manager [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Took 20.02 seconds to build instance.
Jul 31 14:44:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:19 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814658.7678947, 6716534f-ae47-4b7d-bfd8-10f94ea8a182 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:44:19 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] VM Started (Lifecycle Event)
Jul 31 14:44:19 user nova-compute[72239]: DEBUG nova.network.neutron [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Successfully created port: d6ef6541-6b7e-4dc5-8149-a10940dfe87b {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:44:19 user nova-compute[72239]: INFO nova.compute.manager [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Took 12.38 seconds to spawn the instance on the hypervisor.
Jul 31 14:44:19 user nova-compute[72239]: DEBUG nova.compute.manager [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:44:19 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:44:19 user nova-compute[72239]: INFO nova.compute.manager [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Took 14.72 seconds to build instance.
Jul 31 14:44:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bab4229b-3c08-4e96-a70d-b769feb059aa tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Lock "6716534f-ae47-4b7d-bfd8-10f94ea8a182" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.299s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:19 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:44:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a6832963-087b-4085-a080-32eec8e7d484 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:19 user nova-compute[72239]: INFO nova.compute.manager [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Took 13.10 seconds to build instance.
Jul 31 14:44:19 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814658.970289, 079a5ed7-ee25-495b-a2a4-924d830a670a => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:44:19 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] VM Resumed (Lifecycle Event)
Jul 31 14:44:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-790a6a78-b73d-4f1e-a330-1270dd366b91 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "079a5ed7-ee25-495b-a2a4-924d830a670a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.219s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:19 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:44:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:19 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:44:19 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814658.9705236, 079a5ed7-ee25-495b-a2a4-924d830a670a => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:44:19 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] VM Started (Lifecycle Event)
Jul 31 14:44:19 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:44:19 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:44:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-f4500293-d96b-4331-88d4-2b5822d11bcf req-5926d9b1-3a03-4c11-88f5-1e3d4e866da3 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received event network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:44:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-f4500293-d96b-4331-88d4-2b5822d11bcf req-5926d9b1-3a03-4c11-88f5-1e3d4e866da3 service nova] Acquiring lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-f4500293-d96b-4331-88d4-2b5822d11bcf req-5926d9b1-3a03-4c11-88f5-1e3d4e866da3 service nova] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-f4500293-d96b-4331-88d4-2b5822d11bcf req-5926d9b1-3a03-4c11-88f5-1e3d4e866da3 service nova] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-f4500293-d96b-4331-88d4-2b5822d11bcf req-5926d9b1-3a03-4c11-88f5-1e3d4e866da3 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] No waiting events found dispatching network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:44:19 user nova-compute[72239]: WARNING nova.compute.manager [req-f4500293-d96b-4331-88d4-2b5822d11bcf req-5926d9b1-3a03-4c11-88f5-1e3d4e866da3 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received unexpected event network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc for instance with vm_state active and task_state None.
Jul 31 14:44:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:20 user nova-compute[72239]: DEBUG nova.network.neutron [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Successfully created port: 60c1bdaa-524e-41da-96d7-56c77f959c71 {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:44:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:22 user nova-compute[72239]: DEBUG nova.compute.manager [req-00451228-feed-44ac-9a0a-f5a092c08178 req-94d7752f-4288-44ab-9686-6f6687bafa7f service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received event network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:44:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-00451228-feed-44ac-9a0a-f5a092c08178 req-94d7752f-4288-44ab-9686-6f6687bafa7f service nova] Acquiring lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-00451228-feed-44ac-9a0a-f5a092c08178 req-94d7752f-4288-44ab-9686-6f6687bafa7f service nova] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-00451228-feed-44ac-9a0a-f5a092c08178 req-94d7752f-4288-44ab-9686-6f6687bafa7f service nova] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:22 user nova-compute[72239]: DEBUG nova.compute.manager [req-00451228-feed-44ac-9a0a-f5a092c08178 req-94d7752f-4288-44ab-9686-6f6687bafa7f service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] No waiting events found dispatching network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:44:22 user nova-compute[72239]: WARNING nova.compute.manager [req-00451228-feed-44ac-9a0a-f5a092c08178 req-94d7752f-4288-44ab-9686-6f6687bafa7f service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received unexpected event network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc for instance with vm_state active and task_state None.
Jul 31 14:44:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:23 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:24 user nova-compute[72239]: DEBUG nova.network.neutron [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Successfully updated port: 60c1bdaa-524e-41da-96d7-56c77f959c71 {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:44:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Acquiring lock "refresh_cache-97917500-bc78-433b-8d3d-181ed13667dc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:44:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Acquired lock "refresh_cache-97917500-bc78-433b-8d3d-181ed13667dc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:44:24 user nova-compute[72239]: DEBUG nova.network.neutron [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:44:24 user nova-compute[72239]: DEBUG nova.compute.manager [req-4ec01098-8304-4ebe-ae72-f01329c19843 req-0bf2a08e-79cd-4540-b471-c21826e3c35d service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Received event network-changed-60c1bdaa-524e-41da-96d7-56c77f959c71 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:44:24 user nova-compute[72239]: DEBUG nova.compute.manager [req-4ec01098-8304-4ebe-ae72-f01329c19843 req-0bf2a08e-79cd-4540-b471-c21826e3c35d service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Refreshing instance network info cache due to event network-changed-60c1bdaa-524e-41da-96d7-56c77f959c71. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:44:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-4ec01098-8304-4ebe-ae72-f01329c19843 req-0bf2a08e-79cd-4540-b471-c21826e3c35d service nova] Acquiring lock "refresh_cache-97917500-bc78-433b-8d3d-181ed13667dc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:44:24 user nova-compute[72239]: DEBUG nova.network.neutron [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG nova.network.neutron [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Successfully updated port: d6ef6541-6b7e-4dc5-8149-a10940dfe87b {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Acquiring lock "refresh_cache-d3e3612b-c6b9-4308-a45a-1ff3805e18bb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Acquired lock "refresh_cache-d3e3612b-c6b9-4308-a45a-1ff3805e18bb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG nova.network.neutron [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG nova.compute.manager [req-e43c1768-12bf-45b2-91ec-507cb825ea42 req-acb3bc2b-a3c6-4ce9-8d18-871ed4d1f4e3 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Received event network-changed-d6ef6541-6b7e-4dc5-8149-a10940dfe87b {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG nova.compute.manager [req-e43c1768-12bf-45b2-91ec-507cb825ea42 req-acb3bc2b-a3c6-4ce9-8d18-871ed4d1f4e3 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Refreshing instance network info cache due to event network-changed-d6ef6541-6b7e-4dc5-8149-a10940dfe87b. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e43c1768-12bf-45b2-91ec-507cb825ea42 req-acb3bc2b-a3c6-4ce9-8d18-871ed4d1f4e3 service nova] Acquiring lock "refresh_cache-d3e3612b-c6b9-4308-a45a-1ff3805e18bb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG nova.network.neutron [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG nova.network.neutron [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Updating instance_info_cache with network_info: [{"id": "60c1bdaa-524e-41da-96d7-56c77f959c71", "address": "fa:16:3e:a4:5f:0e", "network": {"id": "edecce7c-9fe9-4028-997d-b1ceef4e22bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1931054498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e59830ca9e40718341c3f2b0375af0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c1bdaa-52", "ovs_interfaceid": "60c1bdaa-524e-41da-96d7-56c77f959c71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Releasing lock "refresh_cache-97917500-bc78-433b-8d3d-181ed13667dc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG nova.compute.manager [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Instance network_info: |[{"id": "60c1bdaa-524e-41da-96d7-56c77f959c71", "address": "fa:16:3e:a4:5f:0e", "network": {"id": "edecce7c-9fe9-4028-997d-b1ceef4e22bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1931054498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e59830ca9e40718341c3f2b0375af0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c1bdaa-52", "ovs_interfaceid": "60c1bdaa-524e-41da-96d7-56c77f959c71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-4ec01098-8304-4ebe-ae72-f01329c19843 req-0bf2a08e-79cd-4540-b471-c21826e3c35d service nova] Acquired lock "refresh_cache-97917500-bc78-433b-8d3d-181ed13667dc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG nova.network.neutron [req-4ec01098-8304-4ebe-ae72-f01329c19843 req-0bf2a08e-79cd-4540-b471-c21826e3c35d service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Refreshing network info cache for port 60c1bdaa-524e-41da-96d7-56c77f959c71 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Start _get_guest_xml network_info=[{"id": "60c1bdaa-524e-41da-96d7-56c77f959c71", "address": "fa:16:3e:a4:5f:0e", "network": {"id": "edecce7c-9fe9-4028-997d-b1ceef4e22bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1931054498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e59830ca9e40718341c3f2b0375af0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c1bdaa-52", "ovs_interfaceid": "60c1bdaa-524e-41da-96d7-56c77f959c71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:44:25 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:44:25 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:44:25 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:44:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1906962809',display_name='tempest-ServerStableDeviceRescueTest-server-1906962809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1906962809',id=6,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlFBmAzelYchMoAGUb60rbfIln3qCeD2o8psoYFowByLC00hIP+y8UpBp70Jkvkzzjmyn4APvd5SxUameMY9qeQ+2b0RFNmW42aqb81yJhfLBj22P9rK42XpxH37WRJIw==',key_name='tempest-keypair-2011346805',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48e59830ca9e40718341c3f2b0375af0',ramdisk_id='',reservation_id='r-3xscnqmk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1096111935',owner_user_name='tempest-ServerStableDeviceRescueTest-1096111935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:44:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1df7639d9db4005841b1b3812440f83',uuid=97917500-bc78-433b-8d3d-181ed13667dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60c1bdaa-524e-41da-96d7-56c77f959c71", "address": "fa:16:3e:a4:5f:0e", "network": {"id": "edecce7c-9fe9-4028-997d-b1ceef4e22bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1931054498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e59830ca9e40718341c3f2b0375af0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c1bdaa-52", "ovs_interfaceid": "60c1bdaa-524e-41da-96d7-56c77f959c71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Converting VIF {"id": "60c1bdaa-524e-41da-96d7-56c77f959c71", "address": "fa:16:3e:a4:5f:0e", "network": {"id": "edecce7c-9fe9-4028-997d-b1ceef4e22bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1931054498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e59830ca9e40718341c3f2b0375af0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c1bdaa-52", "ovs_interfaceid": "60c1bdaa-524e-41da-96d7-56c77f959c71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:5f:0e,bridge_name='br-int',has_traffic_filtering=True,id=60c1bdaa-524e-41da-96d7-56c77f959c71,network=Network(edecce7c-9fe9-4028-997d-b1ceef4e22bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c1bdaa-52') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG nova.objects.instance [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lazy-loading 'pci_devices' on Instance uuid 97917500-bc78-433b-8d3d-181ed13667dc {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:44:25 user nova-compute[72239]:   <uuid>97917500-bc78-433b-8d3d-181ed13667dc</uuid>
Jul 31 14:44:25 user nova-compute[72239]:   <name>instance-00000006</name>
Jul 31 14:44:25 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:44:25 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:44:25 user nova-compute[72239]:   <metadata>
Jul 31 14:44:25 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:44:25 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:44:25 user nova-compute[72239]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1906962809</nova:name>
Jul 31 14:44:25 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:44:25</nova:creationTime>
Jul 31 14:44:25 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:44:25 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:44:25 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:44:25 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:44:25 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:44:25 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:44:25 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:44:25 user nova-compute[72239]:       <nova:owner>
Jul 31 14:44:25 user nova-compute[72239]:         <nova:user uuid="e1df7639d9db4005841b1b3812440f83">tempest-ServerStableDeviceRescueTest-1096111935-project-member</nova:user>
Jul 31 14:44:25 user nova-compute[72239]:         <nova:project uuid="48e59830ca9e40718341c3f2b0375af0">tempest-ServerStableDeviceRescueTest-1096111935</nova:project>
Jul 31 14:44:25 user nova-compute[72239]:       </nova:owner>
Jul 31 14:44:25 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:44:25 user nova-compute[72239]:       <nova:ports>
Jul 31 14:44:25 user nova-compute[72239]:         <nova:port uuid="60c1bdaa-524e-41da-96d7-56c77f959c71">
Jul 31 14:44:25 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 31 14:44:25 user nova-compute[72239]:         </nova:port>
Jul 31 14:44:25 user nova-compute[72239]:       </nova:ports>
Jul 31 14:44:25 user nova-compute[72239]:     </nova:instance>
Jul 31 14:44:25 user nova-compute[72239]:   </metadata>
Jul 31 14:44:25 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:44:25 user nova-compute[72239]:     <system>
Jul 31 14:44:25 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:44:25 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:44:25 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:44:25 user nova-compute[72239]:       <entry name="serial">97917500-bc78-433b-8d3d-181ed13667dc</entry>
Jul 31 14:44:25 user nova-compute[72239]:       <entry name="uuid">97917500-bc78-433b-8d3d-181ed13667dc</entry>
Jul 31 14:44:25 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:44:25 user nova-compute[72239]:     </system>
Jul 31 14:44:25 user nova-compute[72239]:   </sysinfo>
Jul 31 14:44:25 user nova-compute[72239]:   <os>
Jul 31 14:44:25 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:44:25 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:44:25 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:44:25 user nova-compute[72239]:   </os>
Jul 31 14:44:25 user nova-compute[72239]:   <features>
Jul 31 14:44:25 user nova-compute[72239]:     <acpi/>
Jul 31 14:44:25 user nova-compute[72239]:     <apic/>
Jul 31 14:44:25 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:44:25 user nova-compute[72239]:   </features>
Jul 31 14:44:25 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:44:25 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:44:25 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:44:25 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:44:25 user nova-compute[72239]:   </clock>
Jul 31 14:44:25 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:44:25 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:44:25 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:44:25 user nova-compute[72239]:   </cpu>
Jul 31 14:44:25 user nova-compute[72239]:   <devices>
Jul 31 14:44:25 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:44:25 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:44:25 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk"/>
Jul 31 14:44:25 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:44:25 user nova-compute[72239]:     </disk>
Jul 31 14:44:25 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:44:25 user nova-compute[72239]:       <mac address="fa:16:3e:a4:5f:0e"/>
Jul 31 14:44:25 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:44:25 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:44:25 user nova-compute[72239]:       <target dev="tap60c1bdaa-52"/>
Jul 31 14:44:25 user nova-compute[72239]:     </interface>
Jul 31 14:44:25 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:44:25 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/console.log" append="off"/>
Jul 31 14:44:25 user nova-compute[72239]:     </serial>
Jul 31 14:44:25 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:44:25 user nova-compute[72239]:     <video>
Jul 31 14:44:25 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:44:25 user nova-compute[72239]:     </video>
Jul 31 14:44:25 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:44:25 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:44:25 user nova-compute[72239]:     </rng>
Jul 31 14:44:25 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:44:25 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:44:25 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:44:25 user nova-compute[72239]:     </memballoon>
Jul 31 14:44:25 user nova-compute[72239]:   </devices>
Jul 31 14:44:25 user nova-compute[72239]: </domain>
Jul 31 14:44:25 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:44:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1906962809',display_name='tempest-ServerStableDeviceRescueTest-server-1906962809',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1906962809',id=6,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlFBmAzelYchMoAGUb60rbfIln3qCeD2o8psoYFowByLC00hIP+y8UpBp70Jkvkzzjmyn4APvd5SxUameMY9qeQ+2b0RFNmW42aqb81yJhfLBj22P9rK42XpxH37WRJIw==',key_name='tempest-keypair-2011346805',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48e59830ca9e40718341c3f2b0375af0',ramdisk_id='',reservation_id='r-3xscnqmk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1096111935',owner_user_name='tempest-ServerStableDeviceRescueTest-1096111935-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:44:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1df7639d9db4005841b1b3812440f83',uuid=97917500-bc78-433b-8d3d-181ed13667dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60c1bdaa-524e-41da-96d7-56c77f959c71", "address": "fa:16:3e:a4:5f:0e", "network": {"id": "edecce7c-9fe9-4028-997d-b1ceef4e22bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1931054498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e59830ca9e40718341c3f2b0375af0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c1bdaa-52", "ovs_interfaceid": "60c1bdaa-524e-41da-96d7-56c77f959c71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Converting VIF {"id": "60c1bdaa-524e-41da-96d7-56c77f959c71", "address": "fa:16:3e:a4:5f:0e", "network": {"id": "edecce7c-9fe9-4028-997d-b1ceef4e22bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1931054498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e59830ca9e40718341c3f2b0375af0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c1bdaa-52", "ovs_interfaceid": "60c1bdaa-524e-41da-96d7-56c77f959c71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:5f:0e,bridge_name='br-int',has_traffic_filtering=True,id=60c1bdaa-524e-41da-96d7-56c77f959c71,network=Network(edecce7c-9fe9-4028-997d-b1ceef4e22bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c1bdaa-52') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG os_vif [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:5f:0e,bridge_name='br-int',has_traffic_filtering=True,id=60c1bdaa-524e-41da-96d7-56c77f959c71,network=Network(edecce7c-9fe9-4028-997d-b1ceef4e22bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c1bdaa-52') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:44:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:44:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60c1bdaa-52, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:44:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap60c1bdaa-52, col_values=(('external_ids', {'iface-id': '60c1bdaa-524e-41da-96d7-56c77f959c71', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:5f:0e', 'vm-uuid': '97917500-bc78-433b-8d3d-181ed13667dc'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:44:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:44:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:26 user nova-compute[72239]: INFO os_vif [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:5f:0e,bridge_name='br-int',has_traffic_filtering=True,id=60c1bdaa-524e-41da-96d7-56c77f959c71,network=Network(edecce7c-9fe9-4028-997d-b1ceef4e22bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c1bdaa-52')
Jul 31 14:44:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:44:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] No VIF found with MAC fa:16:3e:a4:5f:0e, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:44:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG nova.network.neutron [req-4ec01098-8304-4ebe-ae72-f01329c19843 req-0bf2a08e-79cd-4540-b471-c21826e3c35d service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Updated VIF entry in instance network info cache for port 60c1bdaa-524e-41da-96d7-56c77f959c71. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG nova.network.neutron [req-4ec01098-8304-4ebe-ae72-f01329c19843 req-0bf2a08e-79cd-4540-b471-c21826e3c35d service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Updating instance_info_cache with network_info: [{"id": "60c1bdaa-524e-41da-96d7-56c77f959c71", "address": "fa:16:3e:a4:5f:0e", "network": {"id": "edecce7c-9fe9-4028-997d-b1ceef4e22bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1931054498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e59830ca9e40718341c3f2b0375af0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c1bdaa-52", "ovs_interfaceid": "60c1bdaa-524e-41da-96d7-56c77f959c71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-4ec01098-8304-4ebe-ae72-f01329c19843 req-0bf2a08e-79cd-4540-b471-c21826e3c35d service nova] Releasing lock "refresh_cache-97917500-bc78-433b-8d3d-181ed13667dc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG nova.network.neutron [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Updating instance_info_cache with network_info: [{"id": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "address": "fa:16:3e:f4:8d:da", "network": {"id": "ad1d78ca-d597-4586-8b1b-4dc00fac3c3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-398965992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "506aad3c95a94800a4cc333a3478da17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ef6541-6b", "ovs_interfaceid": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Releasing lock "refresh_cache-d3e3612b-c6b9-4308-a45a-1ff3805e18bb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG nova.compute.manager [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Instance network_info: |[{"id": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "address": "fa:16:3e:f4:8d:da", "network": {"id": "ad1d78ca-d597-4586-8b1b-4dc00fac3c3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-398965992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "506aad3c95a94800a4cc333a3478da17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ef6541-6b", "ovs_interfaceid": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e43c1768-12bf-45b2-91ec-507cb825ea42 req-acb3bc2b-a3c6-4ce9-8d18-871ed4d1f4e3 service nova] Acquired lock "refresh_cache-d3e3612b-c6b9-4308-a45a-1ff3805e18bb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG nova.network.neutron [req-e43c1768-12bf-45b2-91ec-507cb825ea42 req-acb3bc2b-a3c6-4ce9-8d18-871ed4d1f4e3 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Refreshing network info cache for port d6ef6541-6b7e-4dc5-8149-a10940dfe87b {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Start _get_guest_xml network_info=[{"id": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "address": "fa:16:3e:f4:8d:da", "network": {"id": "ad1d78ca-d597-4586-8b1b-4dc00fac3c3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-398965992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "506aad3c95a94800a4cc333a3478da17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ef6541-6b", "ovs_interfaceid": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:44:27 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:44:27 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:44:27 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:44:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-704430368',display_name='tempest-ServerActionsTestOtherB-server-704430368',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-704430368',id=5,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMAieHq8I0ZAPg3BJdF9GCCYAxcsl1TuUTZpA9U0PVBIFwXLp4luFdF9A4kOklr7N7b3+Doyb1i/MuF4moMlBsM1nlQtqnIuFR3yVshdpPI3XQmqmueJHWFXMGjAp573g==',key_name='tempest-keypair-1046174319',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='506aad3c95a94800a4cc333a3478da17',ramdisk_id='',reservation_id='r-rcs9kimd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-858495710',owner_user_name='tempest-ServerActionsTestOtherB-858495710-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:44:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c92e1d7e3b944359fcbf9475dcacef0',uuid=d3e3612b-c6b9-4308-a45a-1ff3805e18bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "address": "fa:16:3e:f4:8d:da", "network": {"id": "ad1d78ca-d597-4586-8b1b-4dc00fac3c3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-398965992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "506aad3c95a94800a4cc333a3478da17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ef6541-6b", "ovs_interfaceid": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Converting VIF {"id": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "address": "fa:16:3e:f4:8d:da", "network": {"id": "ad1d78ca-d597-4586-8b1b-4dc00fac3c3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-398965992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "506aad3c95a94800a4cc333a3478da17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ef6541-6b", "ovs_interfaceid": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:8d:da,bridge_name='br-int',has_traffic_filtering=True,id=d6ef6541-6b7e-4dc5-8149-a10940dfe87b,network=Network(ad1d78ca-d597-4586-8b1b-4dc00fac3c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ef6541-6b') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG nova.objects.instance [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lazy-loading 'pci_devices' on Instance uuid d3e3612b-c6b9-4308-a45a-1ff3805e18bb {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:44:27 user nova-compute[72239]:   <uuid>d3e3612b-c6b9-4308-a45a-1ff3805e18bb</uuid>
Jul 31 14:44:27 user nova-compute[72239]:   <name>instance-00000005</name>
Jul 31 14:44:27 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:44:27 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:44:27 user nova-compute[72239]:   <metadata>
Jul 31 14:44:27 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:44:27 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:44:27 user nova-compute[72239]:       <nova:name>tempest-ServerActionsTestOtherB-server-704430368</nova:name>
Jul 31 14:44:27 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:44:27</nova:creationTime>
Jul 31 14:44:27 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:44:27 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:44:27 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:44:27 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:44:27 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:44:27 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:44:27 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:44:27 user nova-compute[72239]:       <nova:owner>
Jul 31 14:44:27 user nova-compute[72239]:         <nova:user uuid="7c92e1d7e3b944359fcbf9475dcacef0">tempest-ServerActionsTestOtherB-858495710-project-member</nova:user>
Jul 31 14:44:27 user nova-compute[72239]:         <nova:project uuid="506aad3c95a94800a4cc333a3478da17">tempest-ServerActionsTestOtherB-858495710</nova:project>
Jul 31 14:44:27 user nova-compute[72239]:       </nova:owner>
Jul 31 14:44:27 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:44:27 user nova-compute[72239]:       <nova:ports>
Jul 31 14:44:27 user nova-compute[72239]:         <nova:port uuid="d6ef6541-6b7e-4dc5-8149-a10940dfe87b">
Jul 31 14:44:27 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 31 14:44:27 user nova-compute[72239]:         </nova:port>
Jul 31 14:44:27 user nova-compute[72239]:       </nova:ports>
Jul 31 14:44:27 user nova-compute[72239]:     </nova:instance>
Jul 31 14:44:27 user nova-compute[72239]:   </metadata>
Jul 31 14:44:27 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:44:27 user nova-compute[72239]:     <system>
Jul 31 14:44:27 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:44:27 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:44:27 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:44:27 user nova-compute[72239]:       <entry name="serial">d3e3612b-c6b9-4308-a45a-1ff3805e18bb</entry>
Jul 31 14:44:27 user nova-compute[72239]:       <entry name="uuid">d3e3612b-c6b9-4308-a45a-1ff3805e18bb</entry>
Jul 31 14:44:27 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:44:27 user nova-compute[72239]:     </system>
Jul 31 14:44:27 user nova-compute[72239]:   </sysinfo>
Jul 31 14:44:27 user nova-compute[72239]:   <os>
Jul 31 14:44:27 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:44:27 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:44:27 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:44:27 user nova-compute[72239]:   </os>
Jul 31 14:44:27 user nova-compute[72239]:   <features>
Jul 31 14:44:27 user nova-compute[72239]:     <acpi/>
Jul 31 14:44:27 user nova-compute[72239]:     <apic/>
Jul 31 14:44:27 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:44:27 user nova-compute[72239]:   </features>
Jul 31 14:44:27 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:44:27 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:44:27 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:44:27 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:44:27 user nova-compute[72239]:   </clock>
Jul 31 14:44:27 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:44:27 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:44:27 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:44:27 user nova-compute[72239]:   </cpu>
Jul 31 14:44:27 user nova-compute[72239]:   <devices>
Jul 31 14:44:27 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:44:27 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:44:27 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk"/>
Jul 31 14:44:27 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:44:27 user nova-compute[72239]:     </disk>
Jul 31 14:44:27 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:44:27 user nova-compute[72239]:       <mac address="fa:16:3e:f4:8d:da"/>
Jul 31 14:44:27 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:44:27 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:44:27 user nova-compute[72239]:       <target dev="tapd6ef6541-6b"/>
Jul 31 14:44:27 user nova-compute[72239]:     </interface>
Jul 31 14:44:27 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:44:27 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/console.log" append="off"/>
Jul 31 14:44:27 user nova-compute[72239]:     </serial>
Jul 31 14:44:27 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:44:27 user nova-compute[72239]:     <video>
Jul 31 14:44:27 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:44:27 user nova-compute[72239]:     </video>
Jul 31 14:44:27 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:44:27 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:44:27 user nova-compute[72239]:     </rng>
Jul 31 14:44:27 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:44:27 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:44:27 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:44:27 user nova-compute[72239]:     </memballoon>
Jul 31 14:44:27 user nova-compute[72239]:   </devices>
Jul 31 14:44:27 user nova-compute[72239]: </domain>
Jul 31 14:44:27 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:44:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-704430368',display_name='tempest-ServerActionsTestOtherB-server-704430368',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-704430368',id=5,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMAieHq8I0ZAPg3BJdF9GCCYAxcsl1TuUTZpA9U0PVBIFwXLp4luFdF9A4kOklr7N7b3+Doyb1i/MuF4moMlBsM1nlQtqnIuFR3yVshdpPI3XQmqmueJHWFXMGjAp573g==',key_name='tempest-keypair-1046174319',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='506aad3c95a94800a4cc333a3478da17',ramdisk_id='',reservation_id='r-rcs9kimd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-858495710',owner_user_name='tempest-ServerActionsTestOtherB-858495710-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:44:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c92e1d7e3b944359fcbf9475dcacef0',uuid=d3e3612b-c6b9-4308-a45a-1ff3805e18bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "address": "fa:16:3e:f4:8d:da", "network": {"id": "ad1d78ca-d597-4586-8b1b-4dc00fac3c3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-398965992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "506aad3c95a94800a4cc333a3478da17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ef6541-6b", "ovs_interfaceid": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Converting VIF {"id": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "address": "fa:16:3e:f4:8d:da", "network": {"id": "ad1d78ca-d597-4586-8b1b-4dc00fac3c3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-398965992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "506aad3c95a94800a4cc333a3478da17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ef6541-6b", "ovs_interfaceid": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:8d:da,bridge_name='br-int',has_traffic_filtering=True,id=d6ef6541-6b7e-4dc5-8149-a10940dfe87b,network=Network(ad1d78ca-d597-4586-8b1b-4dc00fac3c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ef6541-6b') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG os_vif [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:8d:da,bridge_name='br-int',has_traffic_filtering=True,id=d6ef6541-6b7e-4dc5-8149-a10940dfe87b,network=Network(ad1d78ca-d597-4586-8b1b-4dc00fac3c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ef6541-6b') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6ef6541-6b, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd6ef6541-6b, col_values=(('external_ids', {'iface-id': 'd6ef6541-6b7e-4dc5-8149-a10940dfe87b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:8d:da', 'vm-uuid': 'd3e3612b-c6b9-4308-a45a-1ff3805e18bb'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:27 user nova-compute[72239]: INFO os_vif [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:8d:da,bridge_name='br-int',has_traffic_filtering=True,id=d6ef6541-6b7e-4dc5-8149-a10940dfe87b,network=Network(ad1d78ca-d597-4586-8b1b-4dc00fac3c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ef6541-6b')
Jul 31 14:44:27 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] No VIF found with MAC fa:16:3e:f4:8d:da, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:29 user nova-compute[72239]: DEBUG nova.compute.manager [req-fbb57d3b-2992-429e-a639-5056b9538505 req-4fa83fbb-0e8d-4144-a634-e30a289637be service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Received event network-vif-plugged-60c1bdaa-524e-41da-96d7-56c77f959c71 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:44:29 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-fbb57d3b-2992-429e-a639-5056b9538505 req-4fa83fbb-0e8d-4144-a634-e30a289637be service nova] Acquiring lock "97917500-bc78-433b-8d3d-181ed13667dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:29 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-fbb57d3b-2992-429e-a639-5056b9538505 req-4fa83fbb-0e8d-4144-a634-e30a289637be service nova] Lock "97917500-bc78-433b-8d3d-181ed13667dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:29 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-fbb57d3b-2992-429e-a639-5056b9538505 req-4fa83fbb-0e8d-4144-a634-e30a289637be service nova] Lock "97917500-bc78-433b-8d3d-181ed13667dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:29 user nova-compute[72239]: DEBUG nova.compute.manager [req-fbb57d3b-2992-429e-a639-5056b9538505 req-4fa83fbb-0e8d-4144-a634-e30a289637be service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] No waiting events found dispatching network-vif-plugged-60c1bdaa-524e-41da-96d7-56c77f959c71 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:44:29 user nova-compute[72239]: WARNING nova.compute.manager [req-fbb57d3b-2992-429e-a639-5056b9538505 req-4fa83fbb-0e8d-4144-a634-e30a289637be service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Received unexpected event network-vif-plugged-60c1bdaa-524e-41da-96d7-56c77f959c71 for instance with vm_state building and task_state spawning.
Jul 31 14:44:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:29 user nova-compute[72239]: DEBUG nova.network.neutron [req-e43c1768-12bf-45b2-91ec-507cb825ea42 req-acb3bc2b-a3c6-4ce9-8d18-871ed4d1f4e3 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Updated VIF entry in instance network info cache for port d6ef6541-6b7e-4dc5-8149-a10940dfe87b. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:44:29 user nova-compute[72239]: DEBUG nova.network.neutron [req-e43c1768-12bf-45b2-91ec-507cb825ea42 req-acb3bc2b-a3c6-4ce9-8d18-871ed4d1f4e3 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Updating instance_info_cache with network_info: [{"id": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "address": "fa:16:3e:f4:8d:da", "network": {"id": "ad1d78ca-d597-4586-8b1b-4dc00fac3c3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-398965992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "506aad3c95a94800a4cc333a3478da17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ef6541-6b", "ovs_interfaceid": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:44:29 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e43c1768-12bf-45b2-91ec-507cb825ea42 req-acb3bc2b-a3c6-4ce9-8d18-871ed4d1f4e3 service nova] Releasing lock "refresh_cache-d3e3612b-c6b9-4308-a45a-1ff3805e18bb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:44:30 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:30 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:30 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:30 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:31 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:31 user nova-compute[72239]: DEBUG nova.compute.manager [req-d67a4262-7f2e-48a3-b57b-a4f49ec99b87 req-a7ef8d17-7013-47fe-939f-49443a2c8b45 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Received event network-vif-plugged-d6ef6541-6b7e-4dc5-8149-a10940dfe87b {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:44:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d67a4262-7f2e-48a3-b57b-a4f49ec99b87 req-a7ef8d17-7013-47fe-939f-49443a2c8b45 service nova] Acquiring lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d67a4262-7f2e-48a3-b57b-a4f49ec99b87 req-a7ef8d17-7013-47fe-939f-49443a2c8b45 service nova] Lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d67a4262-7f2e-48a3-b57b-a4f49ec99b87 req-a7ef8d17-7013-47fe-939f-49443a2c8b45 service nova] Lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:31 user nova-compute[72239]: DEBUG nova.compute.manager [req-d67a4262-7f2e-48a3-b57b-a4f49ec99b87 req-a7ef8d17-7013-47fe-939f-49443a2c8b45 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] No waiting events found dispatching network-vif-plugged-d6ef6541-6b7e-4dc5-8149-a10940dfe87b {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:44:31 user nova-compute[72239]: WARNING nova.compute.manager [req-d67a4262-7f2e-48a3-b57b-a4f49ec99b87 req-a7ef8d17-7013-47fe-939f-49443a2c8b45 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Received unexpected event network-vif-plugged-d6ef6541-6b7e-4dc5-8149-a10940dfe87b for instance with vm_state building and task_state spawning.
Jul 31 14:44:31 user nova-compute[72239]: DEBUG nova.compute.manager [req-5adc3e1e-1604-41ee-9aca-4a58dff57a2e req-176bcc83-0271-400e-bb62-c49919635fef service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Received event network-vif-plugged-60c1bdaa-524e-41da-96d7-56c77f959c71 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:44:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5adc3e1e-1604-41ee-9aca-4a58dff57a2e req-176bcc83-0271-400e-bb62-c49919635fef service nova] Acquiring lock "97917500-bc78-433b-8d3d-181ed13667dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5adc3e1e-1604-41ee-9aca-4a58dff57a2e req-176bcc83-0271-400e-bb62-c49919635fef service nova] Lock "97917500-bc78-433b-8d3d-181ed13667dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5adc3e1e-1604-41ee-9aca-4a58dff57a2e req-176bcc83-0271-400e-bb62-c49919635fef service nova] Lock "97917500-bc78-433b-8d3d-181ed13667dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:31 user nova-compute[72239]: DEBUG nova.compute.manager [req-5adc3e1e-1604-41ee-9aca-4a58dff57a2e req-176bcc83-0271-400e-bb62-c49919635fef service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] No waiting events found dispatching network-vif-plugged-60c1bdaa-524e-41da-96d7-56c77f959c71 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:44:31 user nova-compute[72239]: WARNING nova.compute.manager [req-5adc3e1e-1604-41ee-9aca-4a58dff57a2e req-176bcc83-0271-400e-bb62-c49919635fef service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Received unexpected event network-vif-plugged-60c1bdaa-524e-41da-96d7-56c77f959c71 for instance with vm_state building and task_state spawning.
Jul 31 14:44:32 user nova-compute[72239]: DEBUG nova.compute.manager [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:44:32 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 14:44:32 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814672.2954946, 97917500-bc78-433b-8d3d-181ed13667dc => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:44:32 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] VM Resumed (Lifecycle Event)
Jul 31 14:44:32 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Instance spawned successfully.
Jul 31 14:44:32 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 14:44:32 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:44:32 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:44:32 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:32 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:32 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:32 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:32 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:32 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:32 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:44:32 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814672.2957673, 97917500-bc78-433b-8d3d-181ed13667dc => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:44:32 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] VM Started (Lifecycle Event)
Jul 31 14:44:32 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:44:32 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:44:32 user nova-compute[72239]: INFO nova.compute.manager [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Took 15.84 seconds to spawn the instance on the hypervisor.
Jul 31 14:44:32 user nova-compute[72239]: DEBUG nova.compute.manager [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:44:32 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:44:32 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:32 user nova-compute[72239]: INFO nova.compute.manager [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Took 17.22 seconds to build instance.
Jul 31 14:44:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f7330506-b383-4705-a2b2-2fdcd93642ec tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lock "97917500-bc78-433b-8d3d-181ed13667dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.403s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:33 user nova-compute[72239]: DEBUG nova.compute.manager [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:44:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 14:44:33 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814673.0845215, d3e3612b-c6b9-4308-a45a-1ff3805e18bb => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:44:33 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] VM Resumed (Lifecycle Event)
Jul 31 14:44:33 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Instance spawned successfully.
Jul 31 14:44:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 14:44:33 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:44:33 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:44:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:33 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:44:33 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814673.0982242, d3e3612b-c6b9-4308-a45a-1ff3805e18bb => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:44:33 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] VM Started (Lifecycle Event)
Jul 31 14:44:33 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:44:33 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:44:33 user nova-compute[72239]: INFO nova.compute.manager [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Took 17.85 seconds to spawn the instance on the hypervisor.
Jul 31 14:44:33 user nova-compute[72239]: DEBUG nova.compute.manager [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:44:33 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:44:33 user nova-compute[72239]: INFO nova.compute.manager [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Took 18.95 seconds to build instance.
Jul 31 14:44:33 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a6de3997-0d9a-425b-81ae-b0970ff26d3b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.121s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:33 user nova-compute[72239]: DEBUG nova.compute.manager [req-cedb7ca8-d26a-4cee-94b7-1f7f13ee3033 req-b56799eb-700c-4caa-9d60-c5646e946ff5 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Received event network-vif-plugged-d6ef6541-6b7e-4dc5-8149-a10940dfe87b {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:44:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-cedb7ca8-d26a-4cee-94b7-1f7f13ee3033 req-b56799eb-700c-4caa-9d60-c5646e946ff5 service nova] Acquiring lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-cedb7ca8-d26a-4cee-94b7-1f7f13ee3033 req-b56799eb-700c-4caa-9d60-c5646e946ff5 service nova] Lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-cedb7ca8-d26a-4cee-94b7-1f7f13ee3033 req-b56799eb-700c-4caa-9d60-c5646e946ff5 service nova] Lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:33 user nova-compute[72239]: DEBUG nova.compute.manager [req-cedb7ca8-d26a-4cee-94b7-1f7f13ee3033 req-b56799eb-700c-4caa-9d60-c5646e946ff5 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] No waiting events found dispatching network-vif-plugged-d6ef6541-6b7e-4dc5-8149-a10940dfe87b {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:44:33 user nova-compute[72239]: WARNING nova.compute.manager [req-cedb7ca8-d26a-4cee-94b7-1f7f13ee3033 req-b56799eb-700c-4caa-9d60-c5646e946ff5 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Received unexpected event network-vif-plugged-d6ef6541-6b7e-4dc5-8149-a10940dfe87b for instance with vm_state active and task_state None.
Jul 31 14:44:36 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:36 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Acquiring lock "c244056f-d17d-4d92-98bb-7c0de6a4d261" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:36 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Lock "c244056f-d17d-4d92-98bb-7c0de6a4d261" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:36 user nova-compute[72239]: DEBUG nova.compute.manager [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 14:44:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:37 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 14:44:37 user nova-compute[72239]: INFO nova.compute.claims [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Claim successful on node user
Jul 31 14:44:37 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:44:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Acquiring lock "62122879-2a72-4ddf-a028-317eda0da465" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "62122879-2a72-4ddf-a028-317eda0da465" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:37 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:44:37 user nova-compute[72239]: DEBUG nova.compute.manager [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 14:44:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.437s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:37 user nova-compute[72239]: DEBUG nova.compute.manager [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 14:44:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:37 user nova-compute[72239]: DEBUG nova.compute.manager [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 14:44:37 user nova-compute[72239]: DEBUG nova.network.neutron [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 14:44:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:37 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 14:44:37 user nova-compute[72239]: INFO nova.compute.claims [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Claim successful on node user
Jul 31 14:44:37 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Jul 31 14:44:37 user nova-compute[72239]: DEBUG nova.compute.manager [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 14:44:37 user nova-compute[72239]: DEBUG nova.compute.manager [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 14:44:37 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 14:44:37 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Creating image(s)
Jul 31 14:44:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Acquiring lock "/opt/stack/data/nova/instances/c244056f-d17d-4d92-98bb-7c0de6a4d261/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Lock "/opt/stack/data/nova/instances/c244056f-d17d-4d92-98bb-7c0de6a4d261/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Lock "/opt/stack/data/nova/instances/c244056f-d17d-4d92-98bb-7c0de6a4d261/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Acquiring lock "12a7fe223e94ffb9a0fc2001e028ce7fbbedaf17" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Lock "12a7fe223e94ffb9a0fc2001e028ce7fbbedaf17" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:37 user nova-compute[72239]: DEBUG nova.policy [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '26efb4513a03454182cf241961521114', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f9bac52049b64df48709cc39d0eb0d8b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 14:44:38 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12a7fe223e94ffb9a0fc2001e028ce7fbbedaf17.part --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:38 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12a7fe223e94ffb9a0fc2001e028ce7fbbedaf17.part --force-share --output=json" returned: 0 in 0.152s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:38 user nova-compute[72239]: DEBUG nova.virt.images [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] 2b11b3a6-ec7a-4750-b89d-6b64a407ebcc was qcow2, converting to raw {{(pid=72239) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 31 14:44:38 user nova-compute[72239]: DEBUG nova.privsep.utils [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72239) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 14:44:38 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/12a7fe223e94ffb9a0fc2001e028ce7fbbedaf17.part /opt/stack/data/nova/instances/_base/12a7fe223e94ffb9a0fc2001e028ce7fbbedaf17.converted {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:38 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:44:38 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:44:38 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.897s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:38 user nova-compute[72239]: DEBUG nova.compute.manager [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 14:44:38 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/12a7fe223e94ffb9a0fc2001e028ce7fbbedaf17.part /opt/stack/data/nova/instances/_base/12a7fe223e94ffb9a0fc2001e028ce7fbbedaf17.converted" returned: 0 in 0.165s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:38 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12a7fe223e94ffb9a0fc2001e028ce7fbbedaf17.converted --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:38 user nova-compute[72239]: DEBUG nova.compute.manager [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 14:44:38 user nova-compute[72239]: DEBUG nova.network.neutron [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 14:44:38 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 14:44:38 user nova-compute[72239]: DEBUG nova.compute.manager [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 14:44:38 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12a7fe223e94ffb9a0fc2001e028ce7fbbedaf17.converted --force-share --output=json" returned: 0 in 0.171s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Lock "12a7fe223e94ffb9a0fc2001e028ce7fbbedaf17" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.918s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:38 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12a7fe223e94ffb9a0fc2001e028ce7fbbedaf17 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:38 user nova-compute[72239]: DEBUG nova.policy [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c6f0cfea2c0f4ec8bfa115354e65da96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aad7d4ecc24425a8571cc2ac8041628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 14:44:38 user nova-compute[72239]: DEBUG nova.compute.manager [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 14:44:38 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 14:44:38 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Creating image(s)
Jul 31 14:44:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Acquiring lock "/opt/stack/data/nova/instances/62122879-2a72-4ddf-a028-317eda0da465/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "/opt/stack/data/nova/instances/62122879-2a72-4ddf-a028-317eda0da465/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "/opt/stack/data/nova/instances/62122879-2a72-4ddf-a028-317eda0da465/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:38 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12a7fe223e94ffb9a0fc2001e028ce7fbbedaf17 --force-share --output=json" returned: 0 in 0.189s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Acquiring lock "12a7fe223e94ffb9a0fc2001e028ce7fbbedaf17" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Lock "12a7fe223e94ffb9a0fc2001e028ce7fbbedaf17" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:38 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12a7fe223e94ffb9a0fc2001e028ce7fbbedaf17 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:38 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:39 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12a7fe223e94ffb9a0fc2001e028ce7fbbedaf17 --force-share --output=json" returned: 0 in 0.151s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:39 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/12a7fe223e94ffb9a0fc2001e028ce7fbbedaf17,backing_fmt=raw /opt/stack/data/nova/instances/c244056f-d17d-4d92-98bb-7c0de6a4d261/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:39 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/12a7fe223e94ffb9a0fc2001e028ce7fbbedaf17,backing_fmt=raw /opt/stack/data/nova/instances/c244056f-d17d-4d92-98bb-7c0de6a4d261/disk 1073741824" returned: 0 in 0.059s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Lock "12a7fe223e94ffb9a0fc2001e028ce7fbbedaf17" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:39 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12a7fe223e94ffb9a0fc2001e028ce7fbbedaf17 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:39 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.211s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Acquiring lock "ca449065000c92aac3b7b9fa685f9a7710929444" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:39 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:39 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/12a7fe223e94ffb9a0fc2001e028ce7fbbedaf17 --force-share --output=json" returned: 0 in 0.151s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:39 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c244056f-d17d-4d92-98bb-7c0de6a4d261/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 14:44:39 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c244056f-d17d-4d92-98bb-7c0de6a4d261/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:39 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.157s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:39 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/62122879-2a72-4ddf-a028-317eda0da465/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:39 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/62122879-2a72-4ddf-a028-317eda0da465/disk 1073741824" returned: 0 in 0.069s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:39 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:39 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c244056f-d17d-4d92-98bb-7c0de6a4d261/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:39 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Cannot resize image /opt/stack/data/nova/instances/c244056f-d17d-4d92-98bb-7c0de6a4d261/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 14:44:39 user nova-compute[72239]: DEBUG nova.objects.instance [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Lazy-loading 'migration_context' on Instance uuid c244056f-d17d-4d92-98bb-7c0de6a4d261 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:44:39 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 14:44:39 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Ensure instance console log exists: /opt/stack/data/nova/instances/c244056f-d17d-4d92-98bb-7c0de6a4d261/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 14:44:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:39 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.183s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:39 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Checking if we can resize image /opt/stack/data/nova/instances/62122879-2a72-4ddf-a028-317eda0da465/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 14:44:39 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62122879-2a72-4ddf-a028-317eda0da465/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:39 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62122879-2a72-4ddf-a028-317eda0da465/disk --force-share --output=json" returned: 0 in 0.325s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:39 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Cannot resize image /opt/stack/data/nova/instances/62122879-2a72-4ddf-a028-317eda0da465/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 14:44:39 user nova-compute[72239]: DEBUG nova.objects.instance [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lazy-loading 'migration_context' on Instance uuid 62122879-2a72-4ddf-a028-317eda0da465 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:44:39 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 14:44:39 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Ensure instance console log exists: /opt/stack/data/nova/instances/62122879-2a72-4ddf-a028-317eda0da465/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 14:44:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:40 user nova-compute[72239]: DEBUG nova.network.neutron [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Successfully created port: 7bc07641-e336-4044-9615-fea49f5b056c {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:44:40 user nova-compute[72239]: DEBUG nova.network.neutron [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Successfully created port: 84eefab5-3319-4e79-9153-628396e013c6 {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:44:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Acquiring lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:41 user nova-compute[72239]: DEBUG nova.compute.manager [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 14:44:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:41 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 14:44:41 user nova-compute[72239]: INFO nova.compute.claims [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Claim successful on node user
Jul 31 14:44:41 user nova-compute[72239]: DEBUG nova.network.neutron [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Successfully updated port: 84eefab5-3319-4e79-9153-628396e013c6 {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:44:41 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:44:41 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:44:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Acquiring lock "refresh_cache-c244056f-d17d-4d92-98bb-7c0de6a4d261" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:44:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Acquired lock "refresh_cache-c244056f-d17d-4d92-98bb-7c0de6a4d261" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:44:41 user nova-compute[72239]: DEBUG nova.network.neutron [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:44:41 user nova-compute[72239]: DEBUG nova.compute.manager [req-aa4fa727-ca2f-4ee3-94a3-88961c553630 req-d3e62eee-98c1-44f1-94bd-a79d61bec95b service nova] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Received event network-changed-84eefab5-3319-4e79-9153-628396e013c6 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:44:41 user nova-compute[72239]: DEBUG nova.compute.manager [req-aa4fa727-ca2f-4ee3-94a3-88961c553630 req-d3e62eee-98c1-44f1-94bd-a79d61bec95b service nova] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Refreshing instance network info cache due to event network-changed-84eefab5-3319-4e79-9153-628396e013c6. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:44:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-aa4fa727-ca2f-4ee3-94a3-88961c553630 req-d3e62eee-98c1-44f1-94bd-a79d61bec95b service nova] Acquiring lock "refresh_cache-c244056f-d17d-4d92-98bb-7c0de6a4d261" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.795s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.compute.manager [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.network.neutron [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.compute.manager [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.network.neutron [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 14:44:42 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.compute.manager [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.network.neutron [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Successfully updated port: 7bc07641-e336-4044-9615-fea49f5b056c {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.compute.manager [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 14:44:42 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Creating image(s)
Jul 31 14:44:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Acquiring lock "/opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lock "/opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lock "/opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Acquiring lock "refresh_cache-62122879-2a72-4ddf-a028-317eda0da465" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Acquired lock "refresh_cache-62122879-2a72-4ddf-a028-317eda0da465" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.network.neutron [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.network.neutron [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Updating instance_info_cache with network_info: [{"id": "84eefab5-3319-4e79-9153-628396e013c6", "address": "fa:16:3e:3f:0e:9a", "network": {"id": "ec35da67-9eac-4670-8019-ca1eff993e4c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2131299185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9bac52049b64df48709cc39d0eb0d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84eefab5-33", "ovs_interfaceid": "84eefab5-3319-4e79-9153-628396e013c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.163s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Acquiring lock "ca449065000c92aac3b7b9fa685f9a7710929444" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Releasing lock "refresh_cache-c244056f-d17d-4d92-98bb-7c0de6a4d261" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.compute.manager [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Instance network_info: |[{"id": "84eefab5-3319-4e79-9153-628396e013c6", "address": "fa:16:3e:3f:0e:9a", "network": {"id": "ec35da67-9eac-4670-8019-ca1eff993e4c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2131299185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9bac52049b64df48709cc39d0eb0d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84eefab5-33", "ovs_interfaceid": "84eefab5-3319-4e79-9153-628396e013c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-aa4fa727-ca2f-4ee3-94a3-88961c553630 req-d3e62eee-98c1-44f1-94bd-a79d61bec95b service nova] Acquired lock "refresh_cache-c244056f-d17d-4d92-98bb-7c0de6a4d261" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.network.neutron [req-aa4fa727-ca2f-4ee3-94a3-88961c553630 req-d3e62eee-98c1-44f1-94bd-a79d61bec95b service nova] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Refreshing network info cache for port 84eefab5-3319-4e79-9153-628396e013c6 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Start _get_guest_xml network_info=[{"id": "84eefab5-3319-4e79-9153-628396e013c6", "address": "fa:16:3e:3f:0e:9a", "network": {"id": "ec35da67-9eac-4670-8019-ca1eff993e4c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2131299185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9bac52049b64df48709cc39d0eb0d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84eefab5-33", "ovs_interfaceid": "84eefab5-3319-4e79-9153-628396e013c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:44:27Z,direct_url=<?>,disk_format='qcow2',id=2b11b3a6-ec7a-4750-b89d-6b64a407ebcc,min_disk=0,min_ram=0,name='',owner='8bd11e303aa842b0b3ab554c9f49d6a7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:44:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/sda', 'disk_bus': 'scsi', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '2b11b3a6-ec7a-4750-b89d-6b64a407ebcc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.policy [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ffb1bd7bcf554374b9b3c5bb1fc2b00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef0e60cdf6a46cfb149c45d8f5443c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 14:44:42 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:44:42 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.compute.manager [req-b59d559b-4d3c-4682-a642-3baa503f08ed req-fb8b399f-cb5a-4977-bd62-a37de2bb7049 service nova] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Received event network-changed-7bc07641-e336-4044-9615-fea49f5b056c {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.compute.manager [req-b59d559b-4d3c-4682-a642-3baa503f08ed req-fb8b399f-cb5a-4977-bd62-a37de2bb7049 service nova] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Refreshing instance network info cache due to event network-changed-7bc07641-e336-4044-9615-fea49f5b056c. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b59d559b-4d3c-4682-a642-3baa503f08ed req-fb8b399f-cb5a-4977-bd62-a37de2bb7049 service nova] Acquiring lock "refresh_cache-62122879-2a72-4ddf-a028-317eda0da465" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:44:27Z,direct_url=<?>,disk_format='qcow2',id=2b11b3a6-ec7a-4750-b89d-6b64a407ebcc,min_disk=0,min_ram=0,name='',owner='8bd11e303aa842b0b3ab554c9f49d6a7',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:44:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:44:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-211925374',display_name='tempest-AttachSCSIVolumeTestJSON-server-211925374',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-211925374',id=7,image_ref='2b11b3a6-ec7a-4750-b89d-6b64a407ebcc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsSz4wNbhGDLqBJd2RtQebiILhRgGDv3TUEzbCLPcKfJ94p3ZUPY0fqLGq7EeflZq3emYRXydauMSQx6uTNFnjFDrbJOqQgtohj/FIei2RyRfwzjE/gdGfQBPfxD9HDwA==',key_name='tempest-keypair-243965215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9bac52049b64df48709cc39d0eb0d8b',ramdisk_id='',reservation_id='r-50xmmsuc',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b11b3a6-ec7a-4750-b89d-6b64a407ebcc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-410481285',owner_user_name='tempest-AttachSCSIVolumeTestJSON-410481285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:44:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26efb4513a03454182cf241961521114',uuid=c244056f-d17d-4d92-98bb-7c0de6a4d261,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84eefab5-3319-4e79-9153-628396e013c6", "address": "fa:16:3e:3f:0e:9a", "network": {"id": "ec35da67-9eac-4670-8019-ca1eff993e4c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2131299185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9bac52049b64df48709cc39d0eb0d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84eefab5-33", "ovs_interfaceid": "84eefab5-3319-4e79-9153-628396e013c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Converting VIF {"id": "84eefab5-3319-4e79-9153-628396e013c6", "address": "fa:16:3e:3f:0e:9a", "network": {"id": "ec35da67-9eac-4670-8019-ca1eff993e4c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2131299185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9bac52049b64df48709cc39d0eb0d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84eefab5-33", "ovs_interfaceid": "84eefab5-3319-4e79-9153-628396e013c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:0e:9a,bridge_name='br-int',has_traffic_filtering=True,id=84eefab5-3319-4e79-9153-628396e013c6,network=Network(ec35da67-9eac-4670-8019-ca1eff993e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84eefab5-33') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.objects.instance [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Lazy-loading 'pci_devices' on Instance uuid c244056f-d17d-4d92-98bb-7c0de6a4d261 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.network.neutron [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.157s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:44:42 user nova-compute[72239]:   <uuid>c244056f-d17d-4d92-98bb-7c0de6a4d261</uuid>
Jul 31 14:44:42 user nova-compute[72239]:   <name>instance-00000007</name>
Jul 31 14:44:42 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:44:42 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:44:42 user nova-compute[72239]:   <metadata>
Jul 31 14:44:42 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:44:42 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:44:42 user nova-compute[72239]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-211925374</nova:name>
Jul 31 14:44:42 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:44:42</nova:creationTime>
Jul 31 14:44:42 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:44:42 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:44:42 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:44:42 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:44:42 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:44:42 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:44:42 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:44:42 user nova-compute[72239]:       <nova:owner>
Jul 31 14:44:42 user nova-compute[72239]:         <nova:user uuid="26efb4513a03454182cf241961521114">tempest-AttachSCSIVolumeTestJSON-410481285-project-member</nova:user>
Jul 31 14:44:42 user nova-compute[72239]:         <nova:project uuid="f9bac52049b64df48709cc39d0eb0d8b">tempest-AttachSCSIVolumeTestJSON-410481285</nova:project>
Jul 31 14:44:42 user nova-compute[72239]:       </nova:owner>
Jul 31 14:44:42 user nova-compute[72239]:       <nova:root type="image" uuid="2b11b3a6-ec7a-4750-b89d-6b64a407ebcc"/>
Jul 31 14:44:42 user nova-compute[72239]:       <nova:ports>
Jul 31 14:44:42 user nova-compute[72239]:         <nova:port uuid="84eefab5-3319-4e79-9153-628396e013c6">
Jul 31 14:44:42 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 31 14:44:42 user nova-compute[72239]:         </nova:port>
Jul 31 14:44:42 user nova-compute[72239]:       </nova:ports>
Jul 31 14:44:42 user nova-compute[72239]:     </nova:instance>
Jul 31 14:44:42 user nova-compute[72239]:   </metadata>
Jul 31 14:44:42 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:44:42 user nova-compute[72239]:     <system>
Jul 31 14:44:42 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:44:42 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:44:42 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:44:42 user nova-compute[72239]:       <entry name="serial">c244056f-d17d-4d92-98bb-7c0de6a4d261</entry>
Jul 31 14:44:42 user nova-compute[72239]:       <entry name="uuid">c244056f-d17d-4d92-98bb-7c0de6a4d261</entry>
Jul 31 14:44:42 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:44:42 user nova-compute[72239]:     </system>
Jul 31 14:44:42 user nova-compute[72239]:   </sysinfo>
Jul 31 14:44:42 user nova-compute[72239]:   <os>
Jul 31 14:44:42 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:44:42 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:44:42 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:44:42 user nova-compute[72239]:   </os>
Jul 31 14:44:42 user nova-compute[72239]:   <features>
Jul 31 14:44:42 user nova-compute[72239]:     <acpi/>
Jul 31 14:44:42 user nova-compute[72239]:     <apic/>
Jul 31 14:44:42 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:44:42 user nova-compute[72239]:   </features>
Jul 31 14:44:42 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:44:42 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:44:42 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:44:42 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:44:42 user nova-compute[72239]:   </clock>
Jul 31 14:44:42 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:44:42 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:44:42 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:44:42 user nova-compute[72239]:   </cpu>
Jul 31 14:44:42 user nova-compute[72239]:   <devices>
Jul 31 14:44:42 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:44:42 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:44:42 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/c244056f-d17d-4d92-98bb-7c0de6a4d261/disk"/>
Jul 31 14:44:42 user nova-compute[72239]:       <target dev="sda" bus="scsi"/>
Jul 31 14:44:42 user nova-compute[72239]:       <address type="drive" controller="0" unit="0"/>
Jul 31 14:44:42 user nova-compute[72239]:     </disk>
Jul 31 14:44:42 user nova-compute[72239]:     <disk type="file" device="cdrom">
Jul 31 14:44:42 user nova-compute[72239]:       <driver name="qemu" type="raw" cache="none"/>
Jul 31 14:44:42 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/c244056f-d17d-4d92-98bb-7c0de6a4d261/disk.config"/>
Jul 31 14:44:42 user nova-compute[72239]:       <target dev="sdb" bus="scsi"/>
Jul 31 14:44:42 user nova-compute[72239]:       <address type="drive" controller="0" unit="1"/>
Jul 31 14:44:42 user nova-compute[72239]:     </disk>
Jul 31 14:44:42 user nova-compute[72239]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Jul 31 14:44:42 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:44:42 user nova-compute[72239]:       <mac address="fa:16:3e:3f:0e:9a"/>
Jul 31 14:44:42 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:44:42 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:44:42 user nova-compute[72239]:       <target dev="tap84eefab5-33"/>
Jul 31 14:44:42 user nova-compute[72239]:     </interface>
Jul 31 14:44:42 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:44:42 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/c244056f-d17d-4d92-98bb-7c0de6a4d261/console.log" append="off"/>
Jul 31 14:44:42 user nova-compute[72239]:     </serial>
Jul 31 14:44:42 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:44:42 user nova-compute[72239]:     <video>
Jul 31 14:44:42 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:44:42 user nova-compute[72239]:     </video>
Jul 31 14:44:42 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:44:42 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:44:42 user nova-compute[72239]:     </rng>
Jul 31 14:44:42 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:44:42 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:44:42 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:44:42 user nova-compute[72239]:     </memballoon>
Jul 31 14:44:42 user nova-compute[72239]:   </devices>
Jul 31 14:44:42 user nova-compute[72239]: </domain>
Jul 31 14:44:42 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:44:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-211925374',display_name='tempest-AttachSCSIVolumeTestJSON-server-211925374',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-211925374',id=7,image_ref='2b11b3a6-ec7a-4750-b89d-6b64a407ebcc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsSz4wNbhGDLqBJd2RtQebiILhRgGDv3TUEzbCLPcKfJ94p3ZUPY0fqLGq7EeflZq3emYRXydauMSQx6uTNFnjFDrbJOqQgtohj/FIei2RyRfwzjE/gdGfQBPfxD9HDwA==',key_name='tempest-keypair-243965215',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f9bac52049b64df48709cc39d0eb0d8b',ramdisk_id='',reservation_id='r-50xmmsuc',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b11b3a6-ec7a-4750-b89d-6b64a407ebcc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-410481285',owner_user_name='tempest-AttachSCSIVolumeTestJSON-410481285-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:44:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26efb4513a03454182cf241961521114',uuid=c244056f-d17d-4d92-98bb-7c0de6a4d261,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84eefab5-3319-4e79-9153-628396e013c6", "address": "fa:16:3e:3f:0e:9a", "network": {"id": "ec35da67-9eac-4670-8019-ca1eff993e4c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2131299185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9bac52049b64df48709cc39d0eb0d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84eefab5-33", "ovs_interfaceid": "84eefab5-3319-4e79-9153-628396e013c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Converting VIF {"id": "84eefab5-3319-4e79-9153-628396e013c6", "address": "fa:16:3e:3f:0e:9a", "network": {"id": "ec35da67-9eac-4670-8019-ca1eff993e4c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2131299185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9bac52049b64df48709cc39d0eb0d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84eefab5-33", "ovs_interfaceid": "84eefab5-3319-4e79-9153-628396e013c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3f:0e:9a,bridge_name='br-int',has_traffic_filtering=True,id=84eefab5-3319-4e79-9153-628396e013c6,network=Network(ec35da67-9eac-4670-8019-ca1eff993e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84eefab5-33') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG os_vif [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:0e:9a,bridge_name='br-int',has_traffic_filtering=True,id=84eefab5-3319-4e79-9153-628396e013c6,network=Network(ec35da67-9eac-4670-8019-ca1eff993e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84eefab5-33') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/disk 1073741824" returned: 0 in 0.056s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.214s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84eefab5-33, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap84eefab5-33, col_values=(('external_ids', {'iface-id': '84eefab5-3319-4e79-9153-628396e013c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3f:0e:9a', 'vm-uuid': 'c244056f-d17d-4d92-98bb-7c0de6a4d261'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:42 user nova-compute[72239]: INFO os_vif [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3f:0e:9a,bridge_name='br-int',has_traffic_filtering=True,id=84eefab5-3319-4e79-9153-628396e013c6,network=Network(ec35da67-9eac-4670-8019-ca1eff993e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84eefab5-33')
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] No BDM found with device name sda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] No VIF found with MAC fa:16:3e:3f:0e:9a, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:44:42 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Using config drive
Jul 31 14:44:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.153s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 14:44:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:43 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Creating config drive at /opt/stack/data/nova/instances/c244056f-d17d-4d92-98bb-7c0de6a4d261/disk.config
Jul 31 14:44:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c244056f-d17d-4d92-98bb-7c0de6a4d261/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpwlc1uqym {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Cannot resize image /opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG nova.objects.instance [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lazy-loading 'migration_context' on Instance uuid 9bd6169a-9a44-4d9c-a406-c10a2542a7b4 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c244056f-d17d-4d92-98bb-7c0de6a4d261/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpwlc1uqym" returned: 0 in 0.055s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Ensure instance console log exists: /opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG nova.network.neutron [req-aa4fa727-ca2f-4ee3-94a3-88961c553630 req-d3e62eee-98c1-44f1-94bd-a79d61bec95b service nova] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Updated VIF entry in instance network info cache for port 84eefab5-3319-4e79-9153-628396e013c6. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG nova.network.neutron [req-aa4fa727-ca2f-4ee3-94a3-88961c553630 req-d3e62eee-98c1-44f1-94bd-a79d61bec95b service nova] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Updating instance_info_cache with network_info: [{"id": "84eefab5-3319-4e79-9153-628396e013c6", "address": "fa:16:3e:3f:0e:9a", "network": {"id": "ec35da67-9eac-4670-8019-ca1eff993e4c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2131299185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9bac52049b64df48709cc39d0eb0d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84eefab5-33", "ovs_interfaceid": "84eefab5-3319-4e79-9153-628396e013c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-aa4fa727-ca2f-4ee3-94a3-88961c553630 req-d3e62eee-98c1-44f1-94bd-a79d61bec95b service nova] Releasing lock "refresh_cache-c244056f-d17d-4d92-98bb-7c0de6a4d261" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG nova.network.neutron [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Updating instance_info_cache with network_info: [{"id": "7bc07641-e336-4044-9615-fea49f5b056c", "address": "fa:16:3e:f6:05:0e", "network": {"id": "f05d7a54-33c7-463e-a73e-8d726fe2a9b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-181910970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aad7d4ecc24425a8571cc2ac8041628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc07641-e3", "ovs_interfaceid": "7bc07641-e336-4044-9615-fea49f5b056c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Releasing lock "refresh_cache-62122879-2a72-4ddf-a028-317eda0da465" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG nova.compute.manager [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Instance network_info: |[{"id": "7bc07641-e336-4044-9615-fea49f5b056c", "address": "fa:16:3e:f6:05:0e", "network": {"id": "f05d7a54-33c7-463e-a73e-8d726fe2a9b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-181910970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aad7d4ecc24425a8571cc2ac8041628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc07641-e3", "ovs_interfaceid": "7bc07641-e336-4044-9615-fea49f5b056c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b59d559b-4d3c-4682-a642-3baa503f08ed req-fb8b399f-cb5a-4977-bd62-a37de2bb7049 service nova] Acquired lock "refresh_cache-62122879-2a72-4ddf-a028-317eda0da465" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG nova.network.neutron [req-b59d559b-4d3c-4682-a642-3baa503f08ed req-fb8b399f-cb5a-4977-bd62-a37de2bb7049 service nova] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Refreshing network info cache for port 7bc07641-e336-4044-9615-fea49f5b056c {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Start _get_guest_xml network_info=[{"id": "7bc07641-e336-4044-9615-fea49f5b056c", "address": "fa:16:3e:f6:05:0e", "network": {"id": "f05d7a54-33c7-463e-a73e-8d726fe2a9b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-181910970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aad7d4ecc24425a8571cc2ac8041628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc07641-e3", "ovs_interfaceid": "7bc07641-e336-4044-9615-fea49f5b056c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:44:43 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:44:43 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:44:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:44:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-189505167',display_name='tempest-VolumesAdminNegativeTest-server-189505167',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-189505167',id=8,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4kZUaCf+F4oCkncSIsfc5+enaKqNDv+6vwD5z6khTKLoFMKLUdOqFKyUsjo4h/rOQ9AFcsum7pSFLn4Rr3FzXqr4CgzCNiYvpP6LABZjYccaFZoUc0imgdLvxj3Ry4vw==',key_name='tempest-keypair-462772525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6aad7d4ecc24425a8571cc2ac8041628',ramdisk_id='',reservation_id='r-nliz7znl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1841650306',owner_user_name='tempest-VolumesAdminNegativeTest-1841650306-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:44:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6f0cfea2c0f4ec8bfa115354e65da96',uuid=62122879-2a72-4ddf-a028-317eda0da465,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bc07641-e336-4044-9615-fea49f5b056c", "address": "fa:16:3e:f6:05:0e", "network": {"id": "f05d7a54-33c7-463e-a73e-8d726fe2a9b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-181910970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aad7d4ecc24425a8571cc2ac8041628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc07641-e3", "ovs_interfaceid": "7bc07641-e336-4044-9615-fea49f5b056c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Converting VIF {"id": "7bc07641-e336-4044-9615-fea49f5b056c", "address": "fa:16:3e:f6:05:0e", "network": {"id": "f05d7a54-33c7-463e-a73e-8d726fe2a9b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-181910970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aad7d4ecc24425a8571cc2ac8041628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc07641-e3", "ovs_interfaceid": "7bc07641-e336-4044-9615-fea49f5b056c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:05:0e,bridge_name='br-int',has_traffic_filtering=True,id=7bc07641-e336-4044-9615-fea49f5b056c,network=Network(f05d7a54-33c7-463e-a73e-8d726fe2a9b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc07641-e3') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG nova.objects.instance [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lazy-loading 'pci_devices' on Instance uuid 62122879-2a72-4ddf-a028-317eda0da465 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:44:43 user nova-compute[72239]:   <uuid>62122879-2a72-4ddf-a028-317eda0da465</uuid>
Jul 31 14:44:43 user nova-compute[72239]:   <name>instance-00000008</name>
Jul 31 14:44:43 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:44:43 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:44:43 user nova-compute[72239]:   <metadata>
Jul 31 14:44:43 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:44:43 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:44:43 user nova-compute[72239]:       <nova:name>tempest-VolumesAdminNegativeTest-server-189505167</nova:name>
Jul 31 14:44:43 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:44:43</nova:creationTime>
Jul 31 14:44:43 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:44:43 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:44:43 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:44:43 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:44:43 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:44:43 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:44:43 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:44:43 user nova-compute[72239]:       <nova:owner>
Jul 31 14:44:43 user nova-compute[72239]:         <nova:user uuid="c6f0cfea2c0f4ec8bfa115354e65da96">tempest-VolumesAdminNegativeTest-1841650306-project-member</nova:user>
Jul 31 14:44:43 user nova-compute[72239]:         <nova:project uuid="6aad7d4ecc24425a8571cc2ac8041628">tempest-VolumesAdminNegativeTest-1841650306</nova:project>
Jul 31 14:44:43 user nova-compute[72239]:       </nova:owner>
Jul 31 14:44:43 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:44:43 user nova-compute[72239]:       <nova:ports>
Jul 31 14:44:43 user nova-compute[72239]:         <nova:port uuid="7bc07641-e336-4044-9615-fea49f5b056c">
Jul 31 14:44:43 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 31 14:44:43 user nova-compute[72239]:         </nova:port>
Jul 31 14:44:43 user nova-compute[72239]:       </nova:ports>
Jul 31 14:44:43 user nova-compute[72239]:     </nova:instance>
Jul 31 14:44:43 user nova-compute[72239]:   </metadata>
Jul 31 14:44:43 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:44:43 user nova-compute[72239]:     <system>
Jul 31 14:44:43 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:44:43 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:44:43 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:44:43 user nova-compute[72239]:       <entry name="serial">62122879-2a72-4ddf-a028-317eda0da465</entry>
Jul 31 14:44:43 user nova-compute[72239]:       <entry name="uuid">62122879-2a72-4ddf-a028-317eda0da465</entry>
Jul 31 14:44:43 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:44:43 user nova-compute[72239]:     </system>
Jul 31 14:44:43 user nova-compute[72239]:   </sysinfo>
Jul 31 14:44:43 user nova-compute[72239]:   <os>
Jul 31 14:44:43 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:44:43 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:44:43 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:44:43 user nova-compute[72239]:   </os>
Jul 31 14:44:43 user nova-compute[72239]:   <features>
Jul 31 14:44:43 user nova-compute[72239]:     <acpi/>
Jul 31 14:44:43 user nova-compute[72239]:     <apic/>
Jul 31 14:44:43 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:44:43 user nova-compute[72239]:   </features>
Jul 31 14:44:43 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:44:43 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:44:43 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:44:43 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:44:43 user nova-compute[72239]:   </clock>
Jul 31 14:44:43 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:44:43 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:44:43 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:44:43 user nova-compute[72239]:   </cpu>
Jul 31 14:44:43 user nova-compute[72239]:   <devices>
Jul 31 14:44:43 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:44:43 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:44:43 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/62122879-2a72-4ddf-a028-317eda0da465/disk"/>
Jul 31 14:44:43 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:44:43 user nova-compute[72239]:     </disk>
Jul 31 14:44:43 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:44:43 user nova-compute[72239]:       <mac address="fa:16:3e:f6:05:0e"/>
Jul 31 14:44:43 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:44:43 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:44:43 user nova-compute[72239]:       <target dev="tap7bc07641-e3"/>
Jul 31 14:44:43 user nova-compute[72239]:     </interface>
Jul 31 14:44:43 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:44:43 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/62122879-2a72-4ddf-a028-317eda0da465/console.log" append="off"/>
Jul 31 14:44:43 user nova-compute[72239]:     </serial>
Jul 31 14:44:43 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:44:43 user nova-compute[72239]:     <video>
Jul 31 14:44:43 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:44:43 user nova-compute[72239]:     </video>
Jul 31 14:44:43 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:44:43 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:44:43 user nova-compute[72239]:     </rng>
Jul 31 14:44:43 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:44:43 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:44:43 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:44:43 user nova-compute[72239]:     </memballoon>
Jul 31 14:44:43 user nova-compute[72239]:   </devices>
Jul 31 14:44:43 user nova-compute[72239]: </domain>
Jul 31 14:44:43 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:44:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-189505167',display_name='tempest-VolumesAdminNegativeTest-server-189505167',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-189505167',id=8,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4kZUaCf+F4oCkncSIsfc5+enaKqNDv+6vwD5z6khTKLoFMKLUdOqFKyUsjo4h/rOQ9AFcsum7pSFLn4Rr3FzXqr4CgzCNiYvpP6LABZjYccaFZoUc0imgdLvxj3Ry4vw==',key_name='tempest-keypair-462772525',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6aad7d4ecc24425a8571cc2ac8041628',ramdisk_id='',reservation_id='r-nliz7znl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1841650306',owner_user_name='tempest-VolumesAdminNegativeTest-1841650306-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:44:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6f0cfea2c0f4ec8bfa115354e65da96',uuid=62122879-2a72-4ddf-a028-317eda0da465,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bc07641-e336-4044-9615-fea49f5b056c", "address": "fa:16:3e:f6:05:0e", "network": {"id": "f05d7a54-33c7-463e-a73e-8d726fe2a9b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-181910970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aad7d4ecc24425a8571cc2ac8041628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc07641-e3", "ovs_interfaceid": "7bc07641-e336-4044-9615-fea49f5b056c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Converting VIF {"id": "7bc07641-e336-4044-9615-fea49f5b056c", "address": "fa:16:3e:f6:05:0e", "network": {"id": "f05d7a54-33c7-463e-a73e-8d726fe2a9b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-181910970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aad7d4ecc24425a8571cc2ac8041628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc07641-e3", "ovs_interfaceid": "7bc07641-e336-4044-9615-fea49f5b056c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f6:05:0e,bridge_name='br-int',has_traffic_filtering=True,id=7bc07641-e336-4044-9615-fea49f5b056c,network=Network(f05d7a54-33c7-463e-a73e-8d726fe2a9b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc07641-e3') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG os_vif [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:05:0e,bridge_name='br-int',has_traffic_filtering=True,id=7bc07641-e336-4044-9615-fea49f5b056c,network=Network(f05d7a54-33c7-463e-a73e-8d726fe2a9b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc07641-e3') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7bc07641-e3, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7bc07641-e3, col_values=(('external_ids', {'iface-id': '7bc07641-e336-4044-9615-fea49f5b056c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f6:05:0e', 'vm-uuid': '62122879-2a72-4ddf-a028-317eda0da465'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:43 user nova-compute[72239]: INFO os_vif [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f6:05:0e,bridge_name='br-int',has_traffic_filtering=True,id=7bc07641-e336-4044-9615-fea49f5b056c,network=Network(f05d7a54-33c7-463e-a73e-8d726fe2a9b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc07641-e3')
Jul 31 14:44:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:44:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] No VIF found with MAC fa:16:3e:f6:05:0e, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:44:44 user nova-compute[72239]: DEBUG nova.network.neutron [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Successfully created port: bc41ac8f-b231-4381-9278-64ce17f8833d {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:44:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:44 user nova-compute[72239]: DEBUG nova.network.neutron [req-b59d559b-4d3c-4682-a642-3baa503f08ed req-fb8b399f-cb5a-4977-bd62-a37de2bb7049 service nova] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Updated VIF entry in instance network info cache for port 7bc07641-e336-4044-9615-fea49f5b056c. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:44:44 user nova-compute[72239]: DEBUG nova.network.neutron [req-b59d559b-4d3c-4682-a642-3baa503f08ed req-fb8b399f-cb5a-4977-bd62-a37de2bb7049 service nova] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Updating instance_info_cache with network_info: [{"id": "7bc07641-e336-4044-9615-fea49f5b056c", "address": "fa:16:3e:f6:05:0e", "network": {"id": "f05d7a54-33c7-463e-a73e-8d726fe2a9b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-181910970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aad7d4ecc24425a8571cc2ac8041628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc07641-e3", "ovs_interfaceid": "7bc07641-e336-4044-9615-fea49f5b056c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:44:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b59d559b-4d3c-4682-a642-3baa503f08ed req-fb8b399f-cb5a-4977-bd62-a37de2bb7049 service nova] Releasing lock "refresh_cache-62122879-2a72-4ddf-a028-317eda0da465" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:44:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:45 user nova-compute[72239]: DEBUG nova.compute.manager [req-e1baeef4-2fbf-4d72-8fe0-0a338183365b req-87232a8b-a36e-4261-bff1-ec7a5f872f61 service nova] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Received event network-vif-plugged-84eefab5-3319-4e79-9153-628396e013c6 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:44:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e1baeef4-2fbf-4d72-8fe0-0a338183365b req-87232a8b-a36e-4261-bff1-ec7a5f872f61 service nova] Acquiring lock "c244056f-d17d-4d92-98bb-7c0de6a4d261-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e1baeef4-2fbf-4d72-8fe0-0a338183365b req-87232a8b-a36e-4261-bff1-ec7a5f872f61 service nova] Lock "c244056f-d17d-4d92-98bb-7c0de6a4d261-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e1baeef4-2fbf-4d72-8fe0-0a338183365b req-87232a8b-a36e-4261-bff1-ec7a5f872f61 service nova] Lock "c244056f-d17d-4d92-98bb-7c0de6a4d261-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:45 user nova-compute[72239]: DEBUG nova.compute.manager [req-e1baeef4-2fbf-4d72-8fe0-0a338183365b req-87232a8b-a36e-4261-bff1-ec7a5f872f61 service nova] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] No waiting events found dispatching network-vif-plugged-84eefab5-3319-4e79-9153-628396e013c6 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:44:45 user nova-compute[72239]: WARNING nova.compute.manager [req-e1baeef4-2fbf-4d72-8fe0-0a338183365b req-87232a8b-a36e-4261-bff1-ec7a5f872f61 service nova] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Received unexpected event network-vif-plugged-84eefab5-3319-4e79-9153-628396e013c6 for instance with vm_state building and task_state spawning.
Jul 31 14:44:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:46 user nova-compute[72239]: DEBUG nova.network.neutron [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Successfully updated port: bc41ac8f-b231-4381-9278-64ce17f8833d {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:44:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Acquiring lock "refresh_cache-9bd6169a-9a44-4d9c-a406-c10a2542a7b4" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:44:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Acquired lock "refresh_cache-9bd6169a-9a44-4d9c-a406-c10a2542a7b4" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:44:46 user nova-compute[72239]: DEBUG nova.network.neutron [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:44:46 user nova-compute[72239]: DEBUG nova.compute.manager [req-6c216961-3932-403e-960e-84fc05f22cb0 req-0577d7a9-7b21-4dd6-887b-af26ec6cb0de service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Received event network-changed-bc41ac8f-b231-4381-9278-64ce17f8833d {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:44:46 user nova-compute[72239]: DEBUG nova.compute.manager [req-6c216961-3932-403e-960e-84fc05f22cb0 req-0577d7a9-7b21-4dd6-887b-af26ec6cb0de service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Refreshing instance network info cache due to event network-changed-bc41ac8f-b231-4381-9278-64ce17f8833d. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:44:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-6c216961-3932-403e-960e-84fc05f22cb0 req-0577d7a9-7b21-4dd6-887b-af26ec6cb0de service nova] Acquiring lock "refresh_cache-9bd6169a-9a44-4d9c-a406-c10a2542a7b4" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:44:46 user nova-compute[72239]: DEBUG nova.network.neutron [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:44:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:46 user nova-compute[72239]: DEBUG nova.network.neutron [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Updating instance_info_cache with network_info: [{"id": "bc41ac8f-b231-4381-9278-64ce17f8833d", "address": "fa:16:3e:25:8c:a7", "network": {"id": "c36e8dbf-183c-4511-bb8d-12d2f61ff51c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1591719384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0e60cdf6a46cfb149c45d8f5443c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc41ac8f-b2", "ovs_interfaceid": "bc41ac8f-b231-4381-9278-64ce17f8833d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:44:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Releasing lock "refresh_cache-9bd6169a-9a44-4d9c-a406-c10a2542a7b4" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:44:46 user nova-compute[72239]: DEBUG nova.compute.manager [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Instance network_info: |[{"id": "bc41ac8f-b231-4381-9278-64ce17f8833d", "address": "fa:16:3e:25:8c:a7", "network": {"id": "c36e8dbf-183c-4511-bb8d-12d2f61ff51c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1591719384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0e60cdf6a46cfb149c45d8f5443c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc41ac8f-b2", "ovs_interfaceid": "bc41ac8f-b231-4381-9278-64ce17f8833d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 14:44:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-6c216961-3932-403e-960e-84fc05f22cb0 req-0577d7a9-7b21-4dd6-887b-af26ec6cb0de service nova] Acquired lock "refresh_cache-9bd6169a-9a44-4d9c-a406-c10a2542a7b4" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:44:46 user nova-compute[72239]: DEBUG nova.network.neutron [req-6c216961-3932-403e-960e-84fc05f22cb0 req-0577d7a9-7b21-4dd6-887b-af26ec6cb0de service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Refreshing network info cache for port bc41ac8f-b231-4381-9278-64ce17f8833d {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Start _get_guest_xml network_info=[{"id": "bc41ac8f-b231-4381-9278-64ce17f8833d", "address": "fa:16:3e:25:8c:a7", "network": {"id": "c36e8dbf-183c-4511-bb8d-12d2f61ff51c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1591719384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0e60cdf6a46cfb149c45d8f5443c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc41ac8f-b2", "ovs_interfaceid": "bc41ac8f-b231-4381-9278-64ce17f8833d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:44:47 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:44:47 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:44:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1518629609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1518629609',id=9,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkO64Mxo9V45ZvyZddW60Bj3R/wxTnuP74Wl0QbQrxRPpHV5wIIOFOuVL0TXCzmSq9fH99PAiORRcNxyzp52Ts3i5cecEtzUOk3DHNvVsfSIw0FbT8y4KNU2UgxwmOgpg==',key_name='tempest-keypair-1851777278',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ef0e60cdf6a46cfb149c45d8f5443c6',ramdisk_id='',reservation_id='r-uyqcqdz1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-99713276',owner_user_name='tempest-TaggedAttachmentsTest-99713276-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:44:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffb1bd7bcf554374b9b3c5bb1fc2b00a',uuid=9bd6169a-9a44-4d9c-a406-c10a2542a7b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc41ac8f-b231-4381-9278-64ce17f8833d", "address": "fa:16:3e:25:8c:a7", "network": {"id": "c36e8dbf-183c-4511-bb8d-12d2f61ff51c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1591719384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0e60cdf6a46cfb149c45d8f5443c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc41ac8f-b2", "ovs_interfaceid": "bc41ac8f-b231-4381-9278-64ce17f8833d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Converting VIF {"id": "bc41ac8f-b231-4381-9278-64ce17f8833d", "address": "fa:16:3e:25:8c:a7", "network": {"id": "c36e8dbf-183c-4511-bb8d-12d2f61ff51c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1591719384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0e60cdf6a46cfb149c45d8f5443c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc41ac8f-b2", "ovs_interfaceid": "bc41ac8f-b231-4381-9278-64ce17f8833d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:8c:a7,bridge_name='br-int',has_traffic_filtering=True,id=bc41ac8f-b231-4381-9278-64ce17f8833d,network=Network(c36e8dbf-183c-4511-bb8d-12d2f61ff51c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc41ac8f-b2') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG nova.objects.instance [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lazy-loading 'pci_devices' on Instance uuid 9bd6169a-9a44-4d9c-a406-c10a2542a7b4 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:44:47 user nova-compute[72239]:   <uuid>9bd6169a-9a44-4d9c-a406-c10a2542a7b4</uuid>
Jul 31 14:44:47 user nova-compute[72239]:   <name>instance-00000009</name>
Jul 31 14:44:47 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:44:47 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:44:47 user nova-compute[72239]:   <metadata>
Jul 31 14:44:47 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:44:47 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:44:47 user nova-compute[72239]:       <nova:name>tempest-device-tagging-server-1518629609</nova:name>
Jul 31 14:44:47 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:44:47</nova:creationTime>
Jul 31 14:44:47 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:44:47 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:44:47 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:44:47 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:44:47 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:44:47 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:44:47 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:44:47 user nova-compute[72239]:       <nova:owner>
Jul 31 14:44:47 user nova-compute[72239]:         <nova:user uuid="ffb1bd7bcf554374b9b3c5bb1fc2b00a">tempest-TaggedAttachmentsTest-99713276-project-member</nova:user>
Jul 31 14:44:47 user nova-compute[72239]:         <nova:project uuid="0ef0e60cdf6a46cfb149c45d8f5443c6">tempest-TaggedAttachmentsTest-99713276</nova:project>
Jul 31 14:44:47 user nova-compute[72239]:       </nova:owner>
Jul 31 14:44:47 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:44:47 user nova-compute[72239]:       <nova:ports>
Jul 31 14:44:47 user nova-compute[72239]:         <nova:port uuid="bc41ac8f-b231-4381-9278-64ce17f8833d">
Jul 31 14:44:47 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 31 14:44:47 user nova-compute[72239]:         </nova:port>
Jul 31 14:44:47 user nova-compute[72239]:       </nova:ports>
Jul 31 14:44:47 user nova-compute[72239]:     </nova:instance>
Jul 31 14:44:47 user nova-compute[72239]:   </metadata>
Jul 31 14:44:47 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:44:47 user nova-compute[72239]:     <system>
Jul 31 14:44:47 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:44:47 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:44:47 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:44:47 user nova-compute[72239]:       <entry name="serial">9bd6169a-9a44-4d9c-a406-c10a2542a7b4</entry>
Jul 31 14:44:47 user nova-compute[72239]:       <entry name="uuid">9bd6169a-9a44-4d9c-a406-c10a2542a7b4</entry>
Jul 31 14:44:47 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:44:47 user nova-compute[72239]:     </system>
Jul 31 14:44:47 user nova-compute[72239]:   </sysinfo>
Jul 31 14:44:47 user nova-compute[72239]:   <os>
Jul 31 14:44:47 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:44:47 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:44:47 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:44:47 user nova-compute[72239]:   </os>
Jul 31 14:44:47 user nova-compute[72239]:   <features>
Jul 31 14:44:47 user nova-compute[72239]:     <acpi/>
Jul 31 14:44:47 user nova-compute[72239]:     <apic/>
Jul 31 14:44:47 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:44:47 user nova-compute[72239]:   </features>
Jul 31 14:44:47 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:44:47 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:44:47 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:44:47 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:44:47 user nova-compute[72239]:   </clock>
Jul 31 14:44:47 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:44:47 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:44:47 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:44:47 user nova-compute[72239]:   </cpu>
Jul 31 14:44:47 user nova-compute[72239]:   <devices>
Jul 31 14:44:47 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:44:47 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:44:47 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/disk"/>
Jul 31 14:44:47 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:44:47 user nova-compute[72239]:     </disk>
Jul 31 14:44:47 user nova-compute[72239]:     <disk type="file" device="cdrom">
Jul 31 14:44:47 user nova-compute[72239]:       <driver name="qemu" type="raw" cache="none"/>
Jul 31 14:44:47 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/disk.config"/>
Jul 31 14:44:47 user nova-compute[72239]:       <target dev="hda" bus="ide"/>
Jul 31 14:44:47 user nova-compute[72239]:     </disk>
Jul 31 14:44:47 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:44:47 user nova-compute[72239]:       <mac address="fa:16:3e:25:8c:a7"/>
Jul 31 14:44:47 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:44:47 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:44:47 user nova-compute[72239]:       <target dev="tapbc41ac8f-b2"/>
Jul 31 14:44:47 user nova-compute[72239]:     </interface>
Jul 31 14:44:47 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:44:47 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/console.log" append="off"/>
Jul 31 14:44:47 user nova-compute[72239]:     </serial>
Jul 31 14:44:47 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:44:47 user nova-compute[72239]:     <video>
Jul 31 14:44:47 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:44:47 user nova-compute[72239]:     </video>
Jul 31 14:44:47 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:44:47 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:44:47 user nova-compute[72239]:     </rng>
Jul 31 14:44:47 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:44:47 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:44:47 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:44:47 user nova-compute[72239]:     </memballoon>
Jul 31 14:44:47 user nova-compute[72239]:   </devices>
Jul 31 14:44:47 user nova-compute[72239]: </domain>
Jul 31 14:44:47 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1518629609',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1518629609',id=9,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkO64Mxo9V45ZvyZddW60Bj3R/wxTnuP74Wl0QbQrxRPpHV5wIIOFOuVL0TXCzmSq9fH99PAiORRcNxyzp52Ts3i5cecEtzUOk3DHNvVsfSIw0FbT8y4KNU2UgxwmOgpg==',key_name='tempest-keypair-1851777278',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ef0e60cdf6a46cfb149c45d8f5443c6',ramdisk_id='',reservation_id='r-uyqcqdz1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-99713276',owner_user_name='tempest-TaggedAttachmentsTest-99713276-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:44:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffb1bd7bcf554374b9b3c5bb1fc2b00a',uuid=9bd6169a-9a44-4d9c-a406-c10a2542a7b4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bc41ac8f-b231-4381-9278-64ce17f8833d", "address": "fa:16:3e:25:8c:a7", "network": {"id": "c36e8dbf-183c-4511-bb8d-12d2f61ff51c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1591719384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0e60cdf6a46cfb149c45d8f5443c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc41ac8f-b2", "ovs_interfaceid": "bc41ac8f-b231-4381-9278-64ce17f8833d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Converting VIF {"id": "bc41ac8f-b231-4381-9278-64ce17f8833d", "address": "fa:16:3e:25:8c:a7", "network": {"id": "c36e8dbf-183c-4511-bb8d-12d2f61ff51c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1591719384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0e60cdf6a46cfb149c45d8f5443c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc41ac8f-b2", "ovs_interfaceid": "bc41ac8f-b231-4381-9278-64ce17f8833d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:8c:a7,bridge_name='br-int',has_traffic_filtering=True,id=bc41ac8f-b231-4381-9278-64ce17f8833d,network=Network(c36e8dbf-183c-4511-bb8d-12d2f61ff51c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc41ac8f-b2') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG os_vif [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:8c:a7,bridge_name='br-int',has_traffic_filtering=True,id=bc41ac8f-b231-4381-9278-64ce17f8833d,network=Network(c36e8dbf-183c-4511-bb8d-12d2f61ff51c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc41ac8f-b2') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbc41ac8f-b2, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbc41ac8f-b2, col_values=(('external_ids', {'iface-id': 'bc41ac8f-b231-4381-9278-64ce17f8833d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:8c:a7', 'vm-uuid': '9bd6169a-9a44-4d9c-a406-c10a2542a7b4'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:47 user nova-compute[72239]: INFO os_vif [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:8c:a7,bridge_name='br-int',has_traffic_filtering=True,id=bc41ac8f-b231-4381-9278-64ce17f8833d,network=Network(c36e8dbf-183c-4511-bb8d-12d2f61ff51c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc41ac8f-b2')
Jul 31 14:44:47 user nova-compute[72239]: DEBUG nova.compute.manager [req-063af5e4-d139-4679-a550-1fa40251e029 req-34f4f539-a5c6-4db2-bfec-f6290482f61d service nova] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Received event network-vif-plugged-84eefab5-3319-4e79-9153-628396e013c6 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-063af5e4-d139-4679-a550-1fa40251e029 req-34f4f539-a5c6-4db2-bfec-f6290482f61d service nova] Acquiring lock "c244056f-d17d-4d92-98bb-7c0de6a4d261-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-063af5e4-d139-4679-a550-1fa40251e029 req-34f4f539-a5c6-4db2-bfec-f6290482f61d service nova] Lock "c244056f-d17d-4d92-98bb-7c0de6a4d261-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-063af5e4-d139-4679-a550-1fa40251e029 req-34f4f539-a5c6-4db2-bfec-f6290482f61d service nova] Lock "c244056f-d17d-4d92-98bb-7c0de6a4d261-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG nova.compute.manager [req-063af5e4-d139-4679-a550-1fa40251e029 req-34f4f539-a5c6-4db2-bfec-f6290482f61d service nova] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] No waiting events found dispatching network-vif-plugged-84eefab5-3319-4e79-9153-628396e013c6 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:44:47 user nova-compute[72239]: WARNING nova.compute.manager [req-063af5e4-d139-4679-a550-1fa40251e029 req-34f4f539-a5c6-4db2-bfec-f6290482f61d service nova] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Received unexpected event network-vif-plugged-84eefab5-3319-4e79-9153-628396e013c6 for instance with vm_state building and task_state spawning.
Jul 31 14:44:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] No BDM found with device name hda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] No VIF found with MAC fa:16:3e:25:8c:a7, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:44:47 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Using config drive
Jul 31 14:44:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:47 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Creating config drive at /opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/disk.config
Jul 31 14:44:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7yubamx6 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp7yubamx6" returned: 0 in 0.063s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:48 user nova-compute[72239]: DEBUG nova.compute.manager [req-e407dfdc-d8d1-4cec-a9ac-b45a0c25d915 req-db814f61-01a7-4c7e-9363-fd24e95decee service nova] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Received event network-vif-plugged-7bc07641-e336-4044-9615-fea49f5b056c {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:44:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e407dfdc-d8d1-4cec-a9ac-b45a0c25d915 req-db814f61-01a7-4c7e-9363-fd24e95decee service nova] Acquiring lock "62122879-2a72-4ddf-a028-317eda0da465-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e407dfdc-d8d1-4cec-a9ac-b45a0c25d915 req-db814f61-01a7-4c7e-9363-fd24e95decee service nova] Lock "62122879-2a72-4ddf-a028-317eda0da465-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e407dfdc-d8d1-4cec-a9ac-b45a0c25d915 req-db814f61-01a7-4c7e-9363-fd24e95decee service nova] Lock "62122879-2a72-4ddf-a028-317eda0da465-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:48 user nova-compute[72239]: DEBUG nova.compute.manager [req-e407dfdc-d8d1-4cec-a9ac-b45a0c25d915 req-db814f61-01a7-4c7e-9363-fd24e95decee service nova] [instance: 62122879-2a72-4ddf-a028-317eda0da465] No waiting events found dispatching network-vif-plugged-7bc07641-e336-4044-9615-fea49f5b056c {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:44:48 user nova-compute[72239]: WARNING nova.compute.manager [req-e407dfdc-d8d1-4cec-a9ac-b45a0c25d915 req-db814f61-01a7-4c7e-9363-fd24e95decee service nova] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Received unexpected event network-vif-plugged-7bc07641-e336-4044-9615-fea49f5b056c for instance with vm_state building and task_state spawning.
Jul 31 14:44:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:48 user nova-compute[72239]: DEBUG nova.network.neutron [req-6c216961-3932-403e-960e-84fc05f22cb0 req-0577d7a9-7b21-4dd6-887b-af26ec6cb0de service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Updated VIF entry in instance network info cache for port bc41ac8f-b231-4381-9278-64ce17f8833d. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:44:48 user nova-compute[72239]: DEBUG nova.network.neutron [req-6c216961-3932-403e-960e-84fc05f22cb0 req-0577d7a9-7b21-4dd6-887b-af26ec6cb0de service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Updating instance_info_cache with network_info: [{"id": "bc41ac8f-b231-4381-9278-64ce17f8833d", "address": "fa:16:3e:25:8c:a7", "network": {"id": "c36e8dbf-183c-4511-bb8d-12d2f61ff51c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1591719384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0e60cdf6a46cfb149c45d8f5443c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc41ac8f-b2", "ovs_interfaceid": "bc41ac8f-b231-4381-9278-64ce17f8833d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:44:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-6c216961-3932-403e-960e-84fc05f22cb0 req-0577d7a9-7b21-4dd6-887b-af26ec6cb0de service nova] Releasing lock "refresh_cache-9bd6169a-9a44-4d9c-a406-c10a2542a7b4" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:44:49 user nova-compute[72239]: DEBUG nova.compute.manager [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:44:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 14:44:49 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814689.2398992, c244056f-d17d-4d92-98bb-7c0de6a4d261 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:44:49 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] VM Resumed (Lifecycle Event)
Jul 31 14:44:49 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Instance spawned successfully.
Jul 31 14:44:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 14:44:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:49 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:44:49 user nova-compute[72239]: DEBUG nova.compute.manager [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:44:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 14:44:49 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:44:49 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Instance spawned successfully.
Jul 31 14:44:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 14:44:49 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:44:49 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814689.240058, c244056f-d17d-4d92-98bb-7c0de6a4d261 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:44:49 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] VM Started (Lifecycle Event)
Jul 31 14:44:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:49 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:44:49 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:44:49 user nova-compute[72239]: INFO nova.compute.manager [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Took 11.57 seconds to spawn the instance on the hypervisor.
Jul 31 14:44:49 user nova-compute[72239]: DEBUG nova.compute.manager [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:44:49 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:44:49 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814689.267225, 62122879-2a72-4ddf-a028-317eda0da465 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:44:49 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 62122879-2a72-4ddf-a028-317eda0da465] VM Resumed (Lifecycle Event)
Jul 31 14:44:49 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:44:49 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Cleaning up deleted instances {{(pid=72239) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 14:44:49 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:44:49 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:44:49 user nova-compute[72239]: INFO nova.compute.manager [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Took 10.51 seconds to spawn the instance on the hypervisor.
Jul 31 14:44:49 user nova-compute[72239]: DEBUG nova.compute.manager [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:44:49 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] There are 0 instances to clean {{(pid=72239) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 14:44:49 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:44:49 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Cleaning up deleted instances with incomplete migration  {{(pid=72239) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 14:44:49 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:44:49 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 62122879-2a72-4ddf-a028-317eda0da465] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:44:49 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814689.273215, 62122879-2a72-4ddf-a028-317eda0da465 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:44:49 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 62122879-2a72-4ddf-a028-317eda0da465] VM Started (Lifecycle Event)
Jul 31 14:44:49 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:44:49 user nova-compute[72239]: INFO nova.compute.manager [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Took 11.95 seconds to build instance.
Jul 31 14:44:49 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:44:49 user nova-compute[72239]: INFO nova.compute.manager [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Took 12.51 seconds to build instance.
Jul 31 14:44:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-56bc7d76-6924-406b-b024-da1595a8acd1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "62122879-2a72-4ddf-a028-317eda0da465" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.067s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7ebdc88d-867d-4785-b678-420b852cb131 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Lock "c244056f-d17d-4d92-98bb-7c0de6a4d261" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.698s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:50 user nova-compute[72239]: DEBUG nova.compute.manager [req-e6df475c-1587-43de-aeb1-94baeb6810c5 req-2d09bc9e-6441-40c2-b1d0-332bbf6095d4 service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Received event network-vif-plugged-bc41ac8f-b231-4381-9278-64ce17f8833d {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:44:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e6df475c-1587-43de-aeb1-94baeb6810c5 req-2d09bc9e-6441-40c2-b1d0-332bbf6095d4 service nova] Acquiring lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e6df475c-1587-43de-aeb1-94baeb6810c5 req-2d09bc9e-6441-40c2-b1d0-332bbf6095d4 service nova] Lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e6df475c-1587-43de-aeb1-94baeb6810c5 req-2d09bc9e-6441-40c2-b1d0-332bbf6095d4 service nova] Lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:50 user nova-compute[72239]: DEBUG nova.compute.manager [req-e6df475c-1587-43de-aeb1-94baeb6810c5 req-2d09bc9e-6441-40c2-b1d0-332bbf6095d4 service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] No waiting events found dispatching network-vif-plugged-bc41ac8f-b231-4381-9278-64ce17f8833d {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:44:50 user nova-compute[72239]: WARNING nova.compute.manager [req-e6df475c-1587-43de-aeb1-94baeb6810c5 req-2d09bc9e-6441-40c2-b1d0-332bbf6095d4 service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Received unexpected event network-vif-plugged-bc41ac8f-b231-4381-9278-64ce17f8833d for instance with vm_state building and task_state spawning.
Jul 31 14:44:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:50 user nova-compute[72239]: DEBUG nova.compute.manager [req-9d71fe0e-cfbc-42c0-bdc8-84d76ceafbf6 req-f5a4e21b-5982-4832-81cb-ddb30bff15d7 service nova] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Received event network-vif-plugged-7bc07641-e336-4044-9615-fea49f5b056c {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:44:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-9d71fe0e-cfbc-42c0-bdc8-84d76ceafbf6 req-f5a4e21b-5982-4832-81cb-ddb30bff15d7 service nova] Acquiring lock "62122879-2a72-4ddf-a028-317eda0da465-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-9d71fe0e-cfbc-42c0-bdc8-84d76ceafbf6 req-f5a4e21b-5982-4832-81cb-ddb30bff15d7 service nova] Lock "62122879-2a72-4ddf-a028-317eda0da465-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-9d71fe0e-cfbc-42c0-bdc8-84d76ceafbf6 req-f5a4e21b-5982-4832-81cb-ddb30bff15d7 service nova] Lock "62122879-2a72-4ddf-a028-317eda0da465-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:50 user nova-compute[72239]: DEBUG nova.compute.manager [req-9d71fe0e-cfbc-42c0-bdc8-84d76ceafbf6 req-f5a4e21b-5982-4832-81cb-ddb30bff15d7 service nova] [instance: 62122879-2a72-4ddf-a028-317eda0da465] No waiting events found dispatching network-vif-plugged-7bc07641-e336-4044-9615-fea49f5b056c {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:44:50 user nova-compute[72239]: WARNING nova.compute.manager [req-9d71fe0e-cfbc-42c0-bdc8-84d76ceafbf6 req-f5a4e21b-5982-4832-81cb-ddb30bff15d7 service nova] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Received unexpected event network-vif-plugged-7bc07641-e336-4044-9615-fea49f5b056c for instance with vm_state active and task_state None.
Jul 31 14:44:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Acquiring lock "f011c736-1a43-4b0e-ac7c-d512bcaa9bdc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Lock "f011c736-1a43-4b0e-ac7c-d512bcaa9bdc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:51 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 14:44:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:51 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 14:44:51 user nova-compute[72239]: INFO nova.compute.claims [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Claim successful on node user
Jul 31 14:44:51 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:44:51 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:44:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.536s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:51 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 14:44:52 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 14:44:52 user nova-compute[72239]: DEBUG nova.network.neutron [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 14:44:52 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 14:44:52 user nova-compute[72239]: DEBUG nova.compute.manager [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:44:52 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 14:44:52 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814692.079156, 9bd6169a-9a44-4d9c-a406-c10a2542a7b4 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:44:52 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] VM Resumed (Lifecycle Event)
Jul 31 14:44:52 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 14:44:52 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Instance spawned successfully.
Jul 31 14:44:52 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 14:44:52 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:44:52 user nova-compute[72239]: DEBUG nova.compute.manager [req-ae26bc92-a783-4375-858e-9cb46b0f5ded req-b6fec007-aa78-4935-ac86-ac9a3cbfbaef service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Received event network-vif-plugged-bc41ac8f-b231-4381-9278-64ce17f8833d {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:44:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ae26bc92-a783-4375-858e-9cb46b0f5ded req-b6fec007-aa78-4935-ac86-ac9a3cbfbaef service nova] Acquiring lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ae26bc92-a783-4375-858e-9cb46b0f5ded req-b6fec007-aa78-4935-ac86-ac9a3cbfbaef service nova] Lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ae26bc92-a783-4375-858e-9cb46b0f5ded req-b6fec007-aa78-4935-ac86-ac9a3cbfbaef service nova] Lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:52 user nova-compute[72239]: DEBUG nova.compute.manager [req-ae26bc92-a783-4375-858e-9cb46b0f5ded req-b6fec007-aa78-4935-ac86-ac9a3cbfbaef service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] No waiting events found dispatching network-vif-plugged-bc41ac8f-b231-4381-9278-64ce17f8833d {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:44:52 user nova-compute[72239]: WARNING nova.compute.manager [req-ae26bc92-a783-4375-858e-9cb46b0f5ded req-b6fec007-aa78-4935-ac86-ac9a3cbfbaef service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Received unexpected event network-vif-plugged-bc41ac8f-b231-4381-9278-64ce17f8833d for instance with vm_state building and task_state spawning.
Jul 31 14:44:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:52 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:44:52 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:52 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:52 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:52 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:52 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:52 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:44:52 user nova-compute[72239]: DEBUG nova.policy [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '28d77037a8964b7f8f443ca00c82cd76', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ec2ff6a04934b24973a97b4cde3af01', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 14:44:52 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:44:52 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814692.0825727, 9bd6169a-9a44-4d9c-a406-c10a2542a7b4 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:44:52 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] VM Started (Lifecycle Event)
Jul 31 14:44:52 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:44:52 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:44:52 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:44:52 user nova-compute[72239]: INFO nova.compute.manager [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Took 9.94 seconds to spawn the instance on the hypervisor.
Jul 31 14:44:52 user nova-compute[72239]: DEBUG nova.compute.manager [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:44:52 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 14:44:52 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 14:44:52 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Creating image(s)
Jul 31 14:44:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Acquiring lock "/opt/stack/data/nova/instances/f011c736-1a43-4b0e-ac7c-d512bcaa9bdc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Lock "/opt/stack/data/nova/instances/f011c736-1a43-4b0e-ac7c-d512bcaa9bdc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Lock "/opt/stack/data/nova/instances/f011c736-1a43-4b0e-ac7c-d512bcaa9bdc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:52 user nova-compute[72239]: INFO nova.compute.manager [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Took 11.18 seconds to build instance.
Jul 31 14:44:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-92749dbf-02cd-4e03-8cf9-5e48c0268dcc tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.307s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:52 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:44:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.163s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:52 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:44:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Acquiring lock "ca449065000c92aac3b7b9fa685f9a7710929444" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.155s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/f011c736-1a43-4b0e-ac7c-d512bcaa9bdc/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/f011c736-1a43-4b0e-ac7c-d512bcaa9bdc/disk 1073741824" returned: 0 in 0.047s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.151s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:52 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f011c736-1a43-4b0e-ac7c-d512bcaa9bdc/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 14:44:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f011c736-1a43-4b0e-ac7c-d512bcaa9bdc/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:53 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f011c736-1a43-4b0e-ac7c-d512bcaa9bdc/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:53 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Cannot resize image /opt/stack/data/nova/instances/f011c736-1a43-4b0e-ac7c-d512bcaa9bdc/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 14:44:53 user nova-compute[72239]: DEBUG nova.objects.instance [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Lazy-loading 'migration_context' on Instance uuid f011c736-1a43-4b0e-ac7c-d512bcaa9bdc {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:44:53 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 14:44:53 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Ensure instance console log exists: /opt/stack/data/nova/instances/f011c736-1a43-4b0e-ac7c-d512bcaa9bdc/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 14:44:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:53 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:44:53 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:44:53 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 14:44:53 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Rebuilding the list of instances to heal {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 14:44:53 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Skipping network cache update for instance because it is Building. {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Jul 31 14:44:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-20abf743-de5b-4122-aad0-e2124c7804b7" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:44:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-20abf743-de5b-4122-aad0-e2124c7804b7" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:44:53 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 14:44:53 user nova-compute[72239]: DEBUG nova.objects.instance [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lazy-loading 'info_cache' on Instance uuid 20abf743-de5b-4122-aad0-e2124c7804b7 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:44:53 user nova-compute[72239]: DEBUG nova.network.neutron [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Successfully created port: 8953e4f0-db77-497e-884b-2521c5b7d385 {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:44:55 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Updating instance_info_cache with network_info: [{"id": "025cadd3-7b0b-4a32-a973-d48a5ce7cfb4", "address": "fa:16:3e:5e:74:46", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap025cadd3-7b", "ovs_interfaceid": "025cadd3-7b0b-4a32-a973-d48a5ce7cfb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:44:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-20abf743-de5b-4122-aad0-e2124c7804b7" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:44:55 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 14:44:55 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:44:55 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:44:55 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 14:44:55 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:44:56 user nova-compute[72239]: DEBUG nova.network.neutron [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Successfully updated port: 8953e4f0-db77-497e-884b-2521c5b7d385 {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:44:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Acquiring lock "refresh_cache-f011c736-1a43-4b0e-ac7c-d512bcaa9bdc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:44:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Acquired lock "refresh_cache-f011c736-1a43-4b0e-ac7c-d512bcaa9bdc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:44:56 user nova-compute[72239]: DEBUG nova.network.neutron [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:44:56 user nova-compute[72239]: DEBUG nova.compute.manager [req-b7b622a2-badd-4456-b750-8ad297289bd3 req-4ae6a33a-9acf-4638-9072-a6ca59eab564 service nova] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Received event network-changed-8953e4f0-db77-497e-884b-2521c5b7d385 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:44:56 user nova-compute[72239]: DEBUG nova.compute.manager [req-b7b622a2-badd-4456-b750-8ad297289bd3 req-4ae6a33a-9acf-4638-9072-a6ca59eab564 service nova] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Refreshing instance network info cache due to event network-changed-8953e4f0-db77-497e-884b-2521c5b7d385. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:44:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b7b622a2-badd-4456-b750-8ad297289bd3 req-4ae6a33a-9acf-4638-9072-a6ca59eab564 service nova] Acquiring lock "refresh_cache-f011c736-1a43-4b0e-ac7c-d512bcaa9bdc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:44:56 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:44:56 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:44:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:44:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:44:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:44:56 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 14:44:56 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:56 user nova-compute[72239]: DEBUG nova.network.neutron [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:44:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:57 user nova-compute[72239]: DEBUG nova.network.neutron [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Updating instance_info_cache with network_info: [{"id": "8953e4f0-db77-497e-884b-2521c5b7d385", "address": "fa:16:3e:57:47:b5", "network": {"id": "3adf6b2e-86b8-4345-af2a-0d45f9d2c77b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-869289263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec2ff6a04934b24973a97b4cde3af01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8953e4f0-db", "ovs_interfaceid": "8953e4f0-db77-497e-884b-2521c5b7d385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Releasing lock "refresh_cache-f011c736-1a43-4b0e-ac7c-d512bcaa9bdc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Instance network_info: |[{"id": "8953e4f0-db77-497e-884b-2521c5b7d385", "address": "fa:16:3e:57:47:b5", "network": {"id": "3adf6b2e-86b8-4345-af2a-0d45f9d2c77b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-869289263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec2ff6a04934b24973a97b4cde3af01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8953e4f0-db", "ovs_interfaceid": "8953e4f0-db77-497e-884b-2521c5b7d385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b7b622a2-badd-4456-b750-8ad297289bd3 req-4ae6a33a-9acf-4638-9072-a6ca59eab564 service nova] Acquired lock "refresh_cache-f011c736-1a43-4b0e-ac7c-d512bcaa9bdc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG nova.network.neutron [req-b7b622a2-badd-4456-b750-8ad297289bd3 req-4ae6a33a-9acf-4638-9072-a6ca59eab564 service nova] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Refreshing network info cache for port 8953e4f0-db77-497e-884b-2521c5b7d385 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Start _get_guest_xml network_info=[{"id": "8953e4f0-db77-497e-884b-2521c5b7d385", "address": "fa:16:3e:57:47:b5", "network": {"id": "3adf6b2e-86b8-4345-af2a-0d45f9d2c77b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-869289263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec2ff6a04934b24973a97b4cde3af01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8953e4f0-db", "ovs_interfaceid": "8953e4f0-db77-497e-884b-2521c5b7d385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:44:58 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:44:58 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:44:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:44:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-216023446',display_name='tempest-TestVolumeSwap-server-216023446',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-216023446',id=10,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNaOhmM1Va6nh7Nv4Vm3OZbOciQpdA+BT91UbsFfXxRqNmQEZAMYPsHEDPa0NGylj6Hsnwtd4O81RXTXSoxTFCTi3ceGdlehvSLPdcgy4blLp+L2hjG0Mboa553J7dRtGA==',key_name='tempest-keypair-1203809248',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ec2ff6a04934b24973a97b4cde3af01',ramdisk_id='',reservation_id='r-tkeyjhaq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-997241221',owner_user_name='tempest-TestVolumeSwap-997241221-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:44:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28d77037a8964b7f8f443ca00c82cd76',uuid=f011c736-1a43-4b0e-ac7c-d512bcaa9bdc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8953e4f0-db77-497e-884b-2521c5b7d385", "address": "fa:16:3e:57:47:b5", "network": {"id": "3adf6b2e-86b8-4345-af2a-0d45f9d2c77b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-869289263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec2ff6a04934b24973a97b4cde3af01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8953e4f0-db", "ovs_interfaceid": "8953e4f0-db77-497e-884b-2521c5b7d385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Converting VIF {"id": "8953e4f0-db77-497e-884b-2521c5b7d385", "address": "fa:16:3e:57:47:b5", "network": {"id": "3adf6b2e-86b8-4345-af2a-0d45f9d2c77b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-869289263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec2ff6a04934b24973a97b4cde3af01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8953e4f0-db", "ovs_interfaceid": "8953e4f0-db77-497e-884b-2521c5b7d385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:47:b5,bridge_name='br-int',has_traffic_filtering=True,id=8953e4f0-db77-497e-884b-2521c5b7d385,network=Network(3adf6b2e-86b8-4345-af2a-0d45f9d2c77b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8953e4f0-db') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG nova.objects.instance [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Lazy-loading 'pci_devices' on Instance uuid f011c736-1a43-4b0e-ac7c-d512bcaa9bdc {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:44:58 user nova-compute[72239]:   <uuid>f011c736-1a43-4b0e-ac7c-d512bcaa9bdc</uuid>
Jul 31 14:44:58 user nova-compute[72239]:   <name>instance-0000000a</name>
Jul 31 14:44:58 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:44:58 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:44:58 user nova-compute[72239]:   <metadata>
Jul 31 14:44:58 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:44:58 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:44:58 user nova-compute[72239]:       <nova:name>tempest-TestVolumeSwap-server-216023446</nova:name>
Jul 31 14:44:58 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:44:58</nova:creationTime>
Jul 31 14:44:58 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:44:58 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:44:58 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:44:58 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:44:58 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:44:58 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:44:58 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:44:58 user nova-compute[72239]:       <nova:owner>
Jul 31 14:44:58 user nova-compute[72239]:         <nova:user uuid="28d77037a8964b7f8f443ca00c82cd76">tempest-TestVolumeSwap-997241221-project-member</nova:user>
Jul 31 14:44:58 user nova-compute[72239]:         <nova:project uuid="6ec2ff6a04934b24973a97b4cde3af01">tempest-TestVolumeSwap-997241221</nova:project>
Jul 31 14:44:58 user nova-compute[72239]:       </nova:owner>
Jul 31 14:44:58 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:44:58 user nova-compute[72239]:       <nova:ports>
Jul 31 14:44:58 user nova-compute[72239]:         <nova:port uuid="8953e4f0-db77-497e-884b-2521c5b7d385">
Jul 31 14:44:58 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 31 14:44:58 user nova-compute[72239]:         </nova:port>
Jul 31 14:44:58 user nova-compute[72239]:       </nova:ports>
Jul 31 14:44:58 user nova-compute[72239]:     </nova:instance>
Jul 31 14:44:58 user nova-compute[72239]:   </metadata>
Jul 31 14:44:58 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:44:58 user nova-compute[72239]:     <system>
Jul 31 14:44:58 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:44:58 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:44:58 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:44:58 user nova-compute[72239]:       <entry name="serial">f011c736-1a43-4b0e-ac7c-d512bcaa9bdc</entry>
Jul 31 14:44:58 user nova-compute[72239]:       <entry name="uuid">f011c736-1a43-4b0e-ac7c-d512bcaa9bdc</entry>
Jul 31 14:44:58 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:44:58 user nova-compute[72239]:     </system>
Jul 31 14:44:58 user nova-compute[72239]:   </sysinfo>
Jul 31 14:44:58 user nova-compute[72239]:   <os>
Jul 31 14:44:58 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:44:58 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:44:58 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:44:58 user nova-compute[72239]:   </os>
Jul 31 14:44:58 user nova-compute[72239]:   <features>
Jul 31 14:44:58 user nova-compute[72239]:     <acpi/>
Jul 31 14:44:58 user nova-compute[72239]:     <apic/>
Jul 31 14:44:58 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:44:58 user nova-compute[72239]:   </features>
Jul 31 14:44:58 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:44:58 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:44:58 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:44:58 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:44:58 user nova-compute[72239]:   </clock>
Jul 31 14:44:58 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:44:58 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:44:58 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:44:58 user nova-compute[72239]:   </cpu>
Jul 31 14:44:58 user nova-compute[72239]:   <devices>
Jul 31 14:44:58 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:44:58 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:44:58 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/f011c736-1a43-4b0e-ac7c-d512bcaa9bdc/disk"/>
Jul 31 14:44:58 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:44:58 user nova-compute[72239]:     </disk>
Jul 31 14:44:58 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:44:58 user nova-compute[72239]:       <mac address="fa:16:3e:57:47:b5"/>
Jul 31 14:44:58 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:44:58 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:44:58 user nova-compute[72239]:       <target dev="tap8953e4f0-db"/>
Jul 31 14:44:58 user nova-compute[72239]:     </interface>
Jul 31 14:44:58 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:44:58 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/f011c736-1a43-4b0e-ac7c-d512bcaa9bdc/console.log" append="off"/>
Jul 31 14:44:58 user nova-compute[72239]:     </serial>
Jul 31 14:44:58 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:44:58 user nova-compute[72239]:     <video>
Jul 31 14:44:58 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:44:58 user nova-compute[72239]:     </video>
Jul 31 14:44:58 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:44:58 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:44:58 user nova-compute[72239]:     </rng>
Jul 31 14:44:58 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:44:58 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:44:58 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:44:58 user nova-compute[72239]:     </memballoon>
Jul 31 14:44:58 user nova-compute[72239]:   </devices>
Jul 31 14:44:58 user nova-compute[72239]: </domain>
Jul 31 14:44:58 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:44:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-216023446',display_name='tempest-TestVolumeSwap-server-216023446',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-216023446',id=10,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNaOhmM1Va6nh7Nv4Vm3OZbOciQpdA+BT91UbsFfXxRqNmQEZAMYPsHEDPa0NGylj6Hsnwtd4O81RXTXSoxTFCTi3ceGdlehvSLPdcgy4blLp+L2hjG0Mboa553J7dRtGA==',key_name='tempest-keypair-1203809248',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6ec2ff6a04934b24973a97b4cde3af01',ramdisk_id='',reservation_id='r-tkeyjhaq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-997241221',owner_user_name='tempest-TestVolumeSwap-997241221-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:44:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28d77037a8964b7f8f443ca00c82cd76',uuid=f011c736-1a43-4b0e-ac7c-d512bcaa9bdc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8953e4f0-db77-497e-884b-2521c5b7d385", "address": "fa:16:3e:57:47:b5", "network": {"id": "3adf6b2e-86b8-4345-af2a-0d45f9d2c77b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-869289263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec2ff6a04934b24973a97b4cde3af01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8953e4f0-db", "ovs_interfaceid": "8953e4f0-db77-497e-884b-2521c5b7d385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Converting VIF {"id": "8953e4f0-db77-497e-884b-2521c5b7d385", "address": "fa:16:3e:57:47:b5", "network": {"id": "3adf6b2e-86b8-4345-af2a-0d45f9d2c77b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-869289263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec2ff6a04934b24973a97b4cde3af01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8953e4f0-db", "ovs_interfaceid": "8953e4f0-db77-497e-884b-2521c5b7d385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:47:b5,bridge_name='br-int',has_traffic_filtering=True,id=8953e4f0-db77-497e-884b-2521c5b7d385,network=Network(3adf6b2e-86b8-4345-af2a-0d45f9d2c77b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8953e4f0-db') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG os_vif [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:47:b5,bridge_name='br-int',has_traffic_filtering=True,id=8953e4f0-db77-497e-884b-2521c5b7d385,network=Network(3adf6b2e-86b8-4345-af2a-0d45f9d2c77b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8953e4f0-db') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8953e4f0-db, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8953e4f0-db, col_values=(('external_ids', {'iface-id': '8953e4f0-db77-497e-884b-2521c5b7d385', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:47:b5', 'vm-uuid': 'f011c736-1a43-4b0e-ac7c-d512bcaa9bdc'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:44:58 user nova-compute[72239]: INFO os_vif [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:47:b5,bridge_name='br-int',has_traffic_filtering=True,id=8953e4f0-db77-497e-884b-2521c5b7d385,network=Network(3adf6b2e-86b8-4345-af2a-0d45f9d2c77b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8953e4f0-db')
Jul 31 14:44:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6716534f-ae47-4b7d-bfd8-10f94ea8a182/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] No VIF found with MAC fa:16:3e:57:47:b5, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6716534f-ae47-4b7d-bfd8-10f94ea8a182/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6716534f-ae47-4b7d-bfd8-10f94ea8a182/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6716534f-ae47-4b7d-bfd8-10f94ea8a182/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:59 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:59 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:59 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:59 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62122879-2a72-4ddf-a028-317eda0da465/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:59 user nova-compute[72239]: DEBUG nova.network.neutron [req-b7b622a2-badd-4456-b750-8ad297289bd3 req-4ae6a33a-9acf-4638-9072-a6ca59eab564 service nova] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Updated VIF entry in instance network info cache for port 8953e4f0-db77-497e-884b-2521c5b7d385. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:44:59 user nova-compute[72239]: DEBUG nova.network.neutron [req-b7b622a2-badd-4456-b750-8ad297289bd3 req-4ae6a33a-9acf-4638-9072-a6ca59eab564 service nova] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Updating instance_info_cache with network_info: [{"id": "8953e4f0-db77-497e-884b-2521c5b7d385", "address": "fa:16:3e:57:47:b5", "network": {"id": "3adf6b2e-86b8-4345-af2a-0d45f9d2c77b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-869289263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec2ff6a04934b24973a97b4cde3af01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8953e4f0-db", "ovs_interfaceid": "8953e4f0-db77-497e-884b-2521c5b7d385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:44:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b7b622a2-badd-4456-b750-8ad297289bd3 req-4ae6a33a-9acf-4638-9072-a6ca59eab564 service nova] Releasing lock "refresh_cache-f011c736-1a43-4b0e-ac7c-d512bcaa9bdc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:44:59 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62122879-2a72-4ddf-a028-317eda0da465/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:59 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62122879-2a72-4ddf-a028-317eda0da465/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:59 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62122879-2a72-4ddf-a028-317eda0da465/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:59 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:44:59 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:44:59 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:00 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:00 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:00 user nova-compute[72239]: DEBUG nova.compute.manager [req-9cc93b69-392b-4d8f-8015-c9dfaf343380 req-fc291bd4-ff7c-47be-8369-b3cf71185ff9 service nova] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Received event network-vif-plugged-8953e4f0-db77-497e-884b-2521c5b7d385 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:45:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-9cc93b69-392b-4d8f-8015-c9dfaf343380 req-fc291bd4-ff7c-47be-8369-b3cf71185ff9 service nova] Acquiring lock "f011c736-1a43-4b0e-ac7c-d512bcaa9bdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:45:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-9cc93b69-392b-4d8f-8015-c9dfaf343380 req-fc291bd4-ff7c-47be-8369-b3cf71185ff9 service nova] Lock "f011c736-1a43-4b0e-ac7c-d512bcaa9bdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:45:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-9cc93b69-392b-4d8f-8015-c9dfaf343380 req-fc291bd4-ff7c-47be-8369-b3cf71185ff9 service nova] Lock "f011c736-1a43-4b0e-ac7c-d512bcaa9bdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:45:00 user nova-compute[72239]: DEBUG nova.compute.manager [req-9cc93b69-392b-4d8f-8015-c9dfaf343380 req-fc291bd4-ff7c-47be-8369-b3cf71185ff9 service nova] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] No waiting events found dispatching network-vif-plugged-8953e4f0-db77-497e-884b-2521c5b7d385 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:45:00 user nova-compute[72239]: WARNING nova.compute.manager [req-9cc93b69-392b-4d8f-8015-c9dfaf343380 req-fc291bd4-ff7c-47be-8369-b3cf71185ff9 service nova] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Received unexpected event network-vif-plugged-8953e4f0-db77-497e-884b-2521c5b7d385 for instance with vm_state building and task_state spawning.
Jul 31 14:45:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c244056f-d17d-4d92-98bb-7c0de6a4d261/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c244056f-d17d-4d92-98bb-7c0de6a4d261/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c244056f-d17d-4d92-98bb-7c0de6a4d261/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:00 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c244056f-d17d-4d92-98bb-7c0de6a4d261/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:02 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814702.4501536, f011c736-1a43-4b0e-ac7c-d512bcaa9bdc => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:45:02 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] VM Resumed (Lifecycle Event)
Jul 31 14:45:02 user nova-compute[72239]: DEBUG nova.compute.manager [req-da499311-c7ff-467a-8600-4da840d8d4fc req-7940e9e8-869e-4806-9853-d47ac9253186 service nova] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Received event network-vif-plugged-8953e4f0-db77-497e-884b-2521c5b7d385 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:45:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-da499311-c7ff-467a-8600-4da840d8d4fc req-7940e9e8-869e-4806-9853-d47ac9253186 service nova] Acquiring lock "f011c736-1a43-4b0e-ac7c-d512bcaa9bdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:45:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-da499311-c7ff-467a-8600-4da840d8d4fc req-7940e9e8-869e-4806-9853-d47ac9253186 service nova] Lock "f011c736-1a43-4b0e-ac7c-d512bcaa9bdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:45:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-da499311-c7ff-467a-8600-4da840d8d4fc req-7940e9e8-869e-4806-9853-d47ac9253186 service nova] Lock "f011c736-1a43-4b0e-ac7c-d512bcaa9bdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:45:02 user nova-compute[72239]: DEBUG nova.compute.manager [req-da499311-c7ff-467a-8600-4da840d8d4fc req-7940e9e8-869e-4806-9853-d47ac9253186 service nova] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] No waiting events found dispatching network-vif-plugged-8953e4f0-db77-497e-884b-2521c5b7d385 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:45:02 user nova-compute[72239]: WARNING nova.compute.manager [req-da499311-c7ff-467a-8600-4da840d8d4fc req-7940e9e8-869e-4806-9853-d47ac9253186 service nova] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Received unexpected event network-vif-plugged-8953e4f0-db77-497e-884b-2521c5b7d385 for instance with vm_state building and task_state spawning.
Jul 31 14:45:02 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:45:02 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 14:45:02 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:45:02 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Instance spawned successfully.
Jul 31 14:45:02 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 14:45:02 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:45:03 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:45:03 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:45:03 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=7534MB free_disk=25.69939422607422GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 14:45:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:45:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:45:03 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:45:03 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814702.4503937, f011c736-1a43-4b0e-ac7c-d512bcaa9bdc => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:45:03 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] VM Started (Lifecycle Event)
Jul 31 14:45:03 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:45:03 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:45:03 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:45:03 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:45:03 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:45:03 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:45:03 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:45:03 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:45:03 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:45:03 user nova-compute[72239]: INFO nova.compute.manager [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Took 10.83 seconds to spawn the instance on the hypervisor.
Jul 31 14:45:03 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:45:03 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:03 user nova-compute[72239]: INFO nova.compute.manager [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Took 12.11 seconds to build instance.
Jul 31 14:45:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1f957d6c-8043-44dd-a2d4-75d2d93d56b1 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Lock "f011c736-1a43-4b0e-ac7c-d512bcaa9bdc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.244s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:45:03 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:03 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 20abf743-de5b-4122-aad0-e2124c7804b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:45:03 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 6716534f-ae47-4b7d-bfd8-10f94ea8a182 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:45:03 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 7d81b881-b44e-4fb3-8245-9dea634bdec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:45:03 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 079a5ed7-ee25-495b-a2a4-924d830a670a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:45:03 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance d3e3612b-c6b9-4308-a45a-1ff3805e18bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:45:03 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 97917500-bc78-433b-8d3d-181ed13667dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:45:03 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance c244056f-d17d-4d92-98bb-7c0de6a4d261 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:45:03 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 62122879-2a72-4ddf-a028-317eda0da465 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:45:03 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 9bd6169a-9a44-4d9c-a406-c10a2542a7b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:45:03 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance f011c736-1a43-4b0e-ac7c-d512bcaa9bdc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:45:03 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 14:45:03 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 14:45:03 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Refreshing inventories for resource provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 14:45:03 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Updating ProviderTree inventory for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 14:45:03 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Updating inventory in ProviderTree for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 14:45:03 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Refreshing aggregate associations for resource provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e, aggregates: None {{(pid=72239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 14:45:03 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Refreshing trait associations for resource provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI {{(pid=72239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 14:45:04 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:45:04 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:45:04 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 14:45:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.207s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:45:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Acquiring lock "82116af8-3702-401b-8d00-9291d4caeb03" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:45:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "82116af8-3702-401b-8d00-9291d4caeb03" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:45:06 user nova-compute[72239]: DEBUG nova.compute.manager [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 14:45:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:45:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:45:06 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 14:45:06 user nova-compute[72239]: INFO nova.compute.claims [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Claim successful on node user
Jul 31 14:45:06 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:45:06 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:45:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.572s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:45:06 user nova-compute[72239]: DEBUG nova.compute.manager [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 14:45:06 user nova-compute[72239]: DEBUG nova.compute.manager [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 14:45:06 user nova-compute[72239]: DEBUG nova.network.neutron [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 14:45:06 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 14:45:06 user nova-compute[72239]: DEBUG nova.compute.manager [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 14:45:06 user nova-compute[72239]: DEBUG nova.policy [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '57f64bf571964fb5ab30b6bcf647becc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '464c4d98738c4a58b69e93b15eacda29', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 14:45:06 user nova-compute[72239]: DEBUG nova.compute.manager [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 14:45:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 14:45:06 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Creating image(s)
Jul 31 14:45:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Acquiring lock "/opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:45:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "/opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:45:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "/opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:45:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.140s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Acquiring lock "ca449065000c92aac3b7b9fa685f9a7710929444" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:45:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:45:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.146s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03/disk 1073741824" returned: 0 in 0.048s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.200s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:45:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.142s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:07 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Checking if we can resize image /opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 14:45:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:07 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Cannot resize image /opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 14:45:07 user nova-compute[72239]: DEBUG nova.objects.instance [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lazy-loading 'migration_context' on Instance uuid 82116af8-3702-401b-8d00-9291d4caeb03 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:45:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 14:45:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Ensure instance console log exists: /opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 14:45:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:45:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:45:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:45:07 user nova-compute[72239]: DEBUG nova.network.neutron [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Successfully created port: 8bcdec5f-6bd8-4afc-8618-284f21e2d3c5 {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:45:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:08 user nova-compute[72239]: DEBUG nova.network.neutron [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Successfully updated port: 8bcdec5f-6bd8-4afc-8618-284f21e2d3c5 {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:45:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Acquiring lock "refresh_cache-82116af8-3702-401b-8d00-9291d4caeb03" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:45:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Acquired lock "refresh_cache-82116af8-3702-401b-8d00-9291d4caeb03" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:45:08 user nova-compute[72239]: DEBUG nova.network.neutron [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:45:08 user nova-compute[72239]: DEBUG nova.compute.manager [req-dfa3cf6b-b03e-4d05-bfea-44738c94aad3 req-d188731c-1e9c-4dd7-a00c-d896a27b83ad service nova] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Received event network-changed-8bcdec5f-6bd8-4afc-8618-284f21e2d3c5 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:45:08 user nova-compute[72239]: DEBUG nova.compute.manager [req-dfa3cf6b-b03e-4d05-bfea-44738c94aad3 req-d188731c-1e9c-4dd7-a00c-d896a27b83ad service nova] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Refreshing instance network info cache due to event network-changed-8bcdec5f-6bd8-4afc-8618-284f21e2d3c5. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:45:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-dfa3cf6b-b03e-4d05-bfea-44738c94aad3 req-d188731c-1e9c-4dd7-a00c-d896a27b83ad service nova] Acquiring lock "refresh_cache-82116af8-3702-401b-8d00-9291d4caeb03" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:45:08 user nova-compute[72239]: DEBUG nova.network.neutron [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG nova.network.neutron [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Updating instance_info_cache with network_info: [{"id": "8bcdec5f-6bd8-4afc-8618-284f21e2d3c5", "address": "fa:16:3e:2e:96:96", "network": {"id": "024fea8e-c1bc-4b21-9965-ac495ab32b25", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1281491819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "464c4d98738c4a58b69e93b15eacda29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bcdec5f-6b", "ovs_interfaceid": "8bcdec5f-6bd8-4afc-8618-284f21e2d3c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Releasing lock "refresh_cache-82116af8-3702-401b-8d00-9291d4caeb03" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG nova.compute.manager [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Instance network_info: |[{"id": "8bcdec5f-6bd8-4afc-8618-284f21e2d3c5", "address": "fa:16:3e:2e:96:96", "network": {"id": "024fea8e-c1bc-4b21-9965-ac495ab32b25", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1281491819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "464c4d98738c4a58b69e93b15eacda29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bcdec5f-6b", "ovs_interfaceid": "8bcdec5f-6bd8-4afc-8618-284f21e2d3c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-dfa3cf6b-b03e-4d05-bfea-44738c94aad3 req-d188731c-1e9c-4dd7-a00c-d896a27b83ad service nova] Acquired lock "refresh_cache-82116af8-3702-401b-8d00-9291d4caeb03" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG nova.network.neutron [req-dfa3cf6b-b03e-4d05-bfea-44738c94aad3 req-d188731c-1e9c-4dd7-a00c-d896a27b83ad service nova] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Refreshing network info cache for port 8bcdec5f-6bd8-4afc-8618-284f21e2d3c5 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Start _get_guest_xml network_info=[{"id": "8bcdec5f-6bd8-4afc-8618-284f21e2d3c5", "address": "fa:16:3e:2e:96:96", "network": {"id": "024fea8e-c1bc-4b21-9965-ac495ab32b25", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1281491819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "464c4d98738c4a58b69e93b15eacda29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bcdec5f-6b", "ovs_interfaceid": "8bcdec5f-6bd8-4afc-8618-284f21e2d3c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:45:09 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:45:09 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:45:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:45:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1597607562',display_name='tempest-SnapshotDataIntegrityTests-server-1597607562',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1597607562',id=11,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHxPO8LGil8BUJkpe+8ZDhYdxaLZWbxGvYYvgGOuPdgnWgmfh33I91T8iB0MFgEJJfRvOthDXudaMrT/wC+uYbQc7zTrC8bZd99lVyvt5Qn3IGqKBkwMWsE1pT4//IG3vA==',key_name='tempest-keypair-1907358817',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='464c4d98738c4a58b69e93b15eacda29',ramdisk_id='',reservation_id='r-zcpx50y9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-888246672',owner_user_name='tempest-SnapshotDataIntegrityTests-888246672-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:45:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57f64bf571964fb5ab30b6bcf647becc',uuid=82116af8-3702-401b-8d00-9291d4caeb03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8bcdec5f-6bd8-4afc-8618-284f21e2d3c5", "address": "fa:16:3e:2e:96:96", "network": {"id": "024fea8e-c1bc-4b21-9965-ac495ab32b25", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1281491819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "464c4d98738c4a58b69e93b15eacda29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bcdec5f-6b", "ovs_interfaceid": "8bcdec5f-6bd8-4afc-8618-284f21e2d3c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Converting VIF {"id": "8bcdec5f-6bd8-4afc-8618-284f21e2d3c5", "address": "fa:16:3e:2e:96:96", "network": {"id": "024fea8e-c1bc-4b21-9965-ac495ab32b25", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1281491819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "464c4d98738c4a58b69e93b15eacda29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bcdec5f-6b", "ovs_interfaceid": "8bcdec5f-6bd8-4afc-8618-284f21e2d3c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:96:96,bridge_name='br-int',has_traffic_filtering=True,id=8bcdec5f-6bd8-4afc-8618-284f21e2d3c5,network=Network(024fea8e-c1bc-4b21-9965-ac495ab32b25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bcdec5f-6b') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG nova.objects.instance [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lazy-loading 'pci_devices' on Instance uuid 82116af8-3702-401b-8d00-9291d4caeb03 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:45:09 user nova-compute[72239]:   <uuid>82116af8-3702-401b-8d00-9291d4caeb03</uuid>
Jul 31 14:45:09 user nova-compute[72239]:   <name>instance-0000000b</name>
Jul 31 14:45:09 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:45:09 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:45:09 user nova-compute[72239]:   <metadata>
Jul 31 14:45:09 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:45:09 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:45:09 user nova-compute[72239]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1597607562</nova:name>
Jul 31 14:45:09 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:45:09</nova:creationTime>
Jul 31 14:45:09 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:45:09 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:45:09 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:45:09 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:45:09 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:45:09 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:45:09 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:45:09 user nova-compute[72239]:       <nova:owner>
Jul 31 14:45:09 user nova-compute[72239]:         <nova:user uuid="57f64bf571964fb5ab30b6bcf647becc">tempest-SnapshotDataIntegrityTests-888246672-project-member</nova:user>
Jul 31 14:45:09 user nova-compute[72239]:         <nova:project uuid="464c4d98738c4a58b69e93b15eacda29">tempest-SnapshotDataIntegrityTests-888246672</nova:project>
Jul 31 14:45:09 user nova-compute[72239]:       </nova:owner>
Jul 31 14:45:09 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:45:09 user nova-compute[72239]:       <nova:ports>
Jul 31 14:45:09 user nova-compute[72239]:         <nova:port uuid="8bcdec5f-6bd8-4afc-8618-284f21e2d3c5">
Jul 31 14:45:09 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 31 14:45:09 user nova-compute[72239]:         </nova:port>
Jul 31 14:45:09 user nova-compute[72239]:       </nova:ports>
Jul 31 14:45:09 user nova-compute[72239]:     </nova:instance>
Jul 31 14:45:09 user nova-compute[72239]:   </metadata>
Jul 31 14:45:09 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:45:09 user nova-compute[72239]:     <system>
Jul 31 14:45:09 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:45:09 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:45:09 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:45:09 user nova-compute[72239]:       <entry name="serial">82116af8-3702-401b-8d00-9291d4caeb03</entry>
Jul 31 14:45:09 user nova-compute[72239]:       <entry name="uuid">82116af8-3702-401b-8d00-9291d4caeb03</entry>
Jul 31 14:45:09 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:45:09 user nova-compute[72239]:     </system>
Jul 31 14:45:09 user nova-compute[72239]:   </sysinfo>
Jul 31 14:45:09 user nova-compute[72239]:   <os>
Jul 31 14:45:09 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:45:09 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:45:09 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:45:09 user nova-compute[72239]:   </os>
Jul 31 14:45:09 user nova-compute[72239]:   <features>
Jul 31 14:45:09 user nova-compute[72239]:     <acpi/>
Jul 31 14:45:09 user nova-compute[72239]:     <apic/>
Jul 31 14:45:09 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:45:09 user nova-compute[72239]:   </features>
Jul 31 14:45:09 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:45:09 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:45:09 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:45:09 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:45:09 user nova-compute[72239]:   </clock>
Jul 31 14:45:09 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:45:09 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:45:09 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:45:09 user nova-compute[72239]:   </cpu>
Jul 31 14:45:09 user nova-compute[72239]:   <devices>
Jul 31 14:45:09 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:45:09 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:45:09 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03/disk"/>
Jul 31 14:45:09 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:45:09 user nova-compute[72239]:     </disk>
Jul 31 14:45:09 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:45:09 user nova-compute[72239]:       <mac address="fa:16:3e:2e:96:96"/>
Jul 31 14:45:09 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:45:09 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:45:09 user nova-compute[72239]:       <target dev="tap8bcdec5f-6b"/>
Jul 31 14:45:09 user nova-compute[72239]:     </interface>
Jul 31 14:45:09 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:45:09 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03/console.log" append="off"/>
Jul 31 14:45:09 user nova-compute[72239]:     </serial>
Jul 31 14:45:09 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:45:09 user nova-compute[72239]:     <video>
Jul 31 14:45:09 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:45:09 user nova-compute[72239]:     </video>
Jul 31 14:45:09 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:45:09 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:45:09 user nova-compute[72239]:     </rng>
Jul 31 14:45:09 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:45:09 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:45:09 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:45:09 user nova-compute[72239]:     </memballoon>
Jul 31 14:45:09 user nova-compute[72239]:   </devices>
Jul 31 14:45:09 user nova-compute[72239]: </domain>
Jul 31 14:45:09 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:45:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1597607562',display_name='tempest-SnapshotDataIntegrityTests-server-1597607562',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1597607562',id=11,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHxPO8LGil8BUJkpe+8ZDhYdxaLZWbxGvYYvgGOuPdgnWgmfh33I91T8iB0MFgEJJfRvOthDXudaMrT/wC+uYbQc7zTrC8bZd99lVyvt5Qn3IGqKBkwMWsE1pT4//IG3vA==',key_name='tempest-keypair-1907358817',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='464c4d98738c4a58b69e93b15eacda29',ramdisk_id='',reservation_id='r-zcpx50y9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-888246672',owner_user_name='tempest-SnapshotDataIntegrityTests-888246672-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:45:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57f64bf571964fb5ab30b6bcf647becc',uuid=82116af8-3702-401b-8d00-9291d4caeb03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8bcdec5f-6bd8-4afc-8618-284f21e2d3c5", "address": "fa:16:3e:2e:96:96", "network": {"id": "024fea8e-c1bc-4b21-9965-ac495ab32b25", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1281491819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "464c4d98738c4a58b69e93b15eacda29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bcdec5f-6b", "ovs_interfaceid": "8bcdec5f-6bd8-4afc-8618-284f21e2d3c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Converting VIF {"id": "8bcdec5f-6bd8-4afc-8618-284f21e2d3c5", "address": "fa:16:3e:2e:96:96", "network": {"id": "024fea8e-c1bc-4b21-9965-ac495ab32b25", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1281491819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "464c4d98738c4a58b69e93b15eacda29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bcdec5f-6b", "ovs_interfaceid": "8bcdec5f-6bd8-4afc-8618-284f21e2d3c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:96:96,bridge_name='br-int',has_traffic_filtering=True,id=8bcdec5f-6bd8-4afc-8618-284f21e2d3c5,network=Network(024fea8e-c1bc-4b21-9965-ac495ab32b25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bcdec5f-6b') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG os_vif [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:96:96,bridge_name='br-int',has_traffic_filtering=True,id=8bcdec5f-6bd8-4afc-8618-284f21e2d3c5,network=Network(024fea8e-c1bc-4b21-9965-ac495ab32b25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bcdec5f-6b') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8bcdec5f-6b, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8bcdec5f-6b, col_values=(('external_ids', {'iface-id': '8bcdec5f-6bd8-4afc-8618-284f21e2d3c5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:96:96', 'vm-uuid': '82116af8-3702-401b-8d00-9291d4caeb03'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:09 user nova-compute[72239]: INFO os_vif [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:96:96,bridge_name='br-int',has_traffic_filtering=True,id=8bcdec5f-6bd8-4afc-8618-284f21e2d3c5,network=Network(024fea8e-c1bc-4b21-9965-ac495ab32b25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bcdec5f-6b')
Jul 31 14:45:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] No VIF found with MAC fa:16:3e:2e:96:96, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG nova.network.neutron [req-dfa3cf6b-b03e-4d05-bfea-44738c94aad3 req-d188731c-1e9c-4dd7-a00c-d896a27b83ad service nova] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Updated VIF entry in instance network info cache for port 8bcdec5f-6bd8-4afc-8618-284f21e2d3c5. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG nova.network.neutron [req-dfa3cf6b-b03e-4d05-bfea-44738c94aad3 req-d188731c-1e9c-4dd7-a00c-d896a27b83ad service nova] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Updating instance_info_cache with network_info: [{"id": "8bcdec5f-6bd8-4afc-8618-284f21e2d3c5", "address": "fa:16:3e:2e:96:96", "network": {"id": "024fea8e-c1bc-4b21-9965-ac495ab32b25", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1281491819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "464c4d98738c4a58b69e93b15eacda29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bcdec5f-6b", "ovs_interfaceid": "8bcdec5f-6bd8-4afc-8618-284f21e2d3c5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:45:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-dfa3cf6b-b03e-4d05-bfea-44738c94aad3 req-d188731c-1e9c-4dd7-a00c-d896a27b83ad service nova] Releasing lock "refresh_cache-82116af8-3702-401b-8d00-9291d4caeb03" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:45:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:11 user nova-compute[72239]: DEBUG nova.compute.manager [req-b543f0ce-58e2-42c2-8e90-33e65be4d53b req-db2ec1b4-be38-4b65-90ca-5a2afa2bc0bf service nova] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Received event network-vif-plugged-8bcdec5f-6bd8-4afc-8618-284f21e2d3c5 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:45:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b543f0ce-58e2-42c2-8e90-33e65be4d53b req-db2ec1b4-be38-4b65-90ca-5a2afa2bc0bf service nova] Acquiring lock "82116af8-3702-401b-8d00-9291d4caeb03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:45:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b543f0ce-58e2-42c2-8e90-33e65be4d53b req-db2ec1b4-be38-4b65-90ca-5a2afa2bc0bf service nova] Lock "82116af8-3702-401b-8d00-9291d4caeb03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:45:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b543f0ce-58e2-42c2-8e90-33e65be4d53b req-db2ec1b4-be38-4b65-90ca-5a2afa2bc0bf service nova] Lock "82116af8-3702-401b-8d00-9291d4caeb03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:45:11 user nova-compute[72239]: DEBUG nova.compute.manager [req-b543f0ce-58e2-42c2-8e90-33e65be4d53b req-db2ec1b4-be38-4b65-90ca-5a2afa2bc0bf service nova] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] No waiting events found dispatching network-vif-plugged-8bcdec5f-6bd8-4afc-8618-284f21e2d3c5 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:45:11 user nova-compute[72239]: WARNING nova.compute.manager [req-b543f0ce-58e2-42c2-8e90-33e65be4d53b req-db2ec1b4-be38-4b65-90ca-5a2afa2bc0bf service nova] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Received unexpected event network-vif-plugged-8bcdec5f-6bd8-4afc-8618-284f21e2d3c5 for instance with vm_state building and task_state spawning.
Jul 31 14:45:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:12 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814712.9387817, 82116af8-3702-401b-8d00-9291d4caeb03 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:45:12 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] VM Resumed (Lifecycle Event)
Jul 31 14:45:12 user nova-compute[72239]: DEBUG nova.compute.manager [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:45:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 14:45:12 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Instance spawned successfully.
Jul 31 14:45:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 14:45:12 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:45:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:45:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:45:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:45:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:45:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:45:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:45:13 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:45:13 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:45:13 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814712.9400241, 82116af8-3702-401b-8d00-9291d4caeb03 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:45:13 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] VM Started (Lifecycle Event)
Jul 31 14:45:13 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:45:13 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:45:13 user nova-compute[72239]: DEBUG nova.compute.manager [req-107ac9d5-9d7b-4388-8966-b5ef75675497 req-0f6dee96-0c90-40d3-82f5-4d562c1fa56a service nova] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Received event network-vif-plugged-8bcdec5f-6bd8-4afc-8618-284f21e2d3c5 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:45:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-107ac9d5-9d7b-4388-8966-b5ef75675497 req-0f6dee96-0c90-40d3-82f5-4d562c1fa56a service nova] Acquiring lock "82116af8-3702-401b-8d00-9291d4caeb03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:45:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-107ac9d5-9d7b-4388-8966-b5ef75675497 req-0f6dee96-0c90-40d3-82f5-4d562c1fa56a service nova] Lock "82116af8-3702-401b-8d00-9291d4caeb03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:45:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-107ac9d5-9d7b-4388-8966-b5ef75675497 req-0f6dee96-0c90-40d3-82f5-4d562c1fa56a service nova] Lock "82116af8-3702-401b-8d00-9291d4caeb03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:45:13 user nova-compute[72239]: DEBUG nova.compute.manager [req-107ac9d5-9d7b-4388-8966-b5ef75675497 req-0f6dee96-0c90-40d3-82f5-4d562c1fa56a service nova] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] No waiting events found dispatching network-vif-plugged-8bcdec5f-6bd8-4afc-8618-284f21e2d3c5 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:45:13 user nova-compute[72239]: WARNING nova.compute.manager [req-107ac9d5-9d7b-4388-8966-b5ef75675497 req-0f6dee96-0c90-40d3-82f5-4d562c1fa56a service nova] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Received unexpected event network-vif-plugged-8bcdec5f-6bd8-4afc-8618-284f21e2d3c5 for instance with vm_state building and task_state spawning.
Jul 31 14:45:13 user nova-compute[72239]: INFO nova.compute.manager [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Took 6.15 seconds to spawn the instance on the hypervisor.
Jul 31 14:45:13 user nova-compute[72239]: DEBUG nova.compute.manager [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:45:13 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:45:13 user nova-compute[72239]: INFO nova.compute.manager [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Took 7.14 seconds to build instance.
Jul 31 14:45:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7c2276d8-df1e-48ba-a1f3-28cd2ef5f7f3 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "82116af8-3702-401b-8d00-9291d4caeb03" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.252s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:45:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Acquiring lock "9203aeaf-2ae9-4e28-9741-05d33df6c915" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:45:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:45:20 user nova-compute[72239]: DEBUG nova.compute.manager [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 14:45:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:45:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:45:20 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 14:45:20 user nova-compute[72239]: INFO nova.compute.claims [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Claim successful on node user
Jul 31 14:45:20 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:45:20 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:45:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:45:20 user nova-compute[72239]: DEBUG nova.compute.manager [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 14:45:20 user nova-compute[72239]: DEBUG nova.compute.manager [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 14:45:20 user nova-compute[72239]: DEBUG nova.network.neutron [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 14:45:20 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 14:45:20 user nova-compute[72239]: DEBUG nova.compute.manager [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 14:45:20 user nova-compute[72239]: INFO nova.virt.block_device [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Booting with volume cb24618d-3cca-4d31-a104-7684353332d8 at /dev/vda
Jul 31 14:45:20 user nova-compute[72239]: DEBUG nova.policy [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d245935ff53452dbd98fa3c45f0c5b7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0b2f9834cbe42a68ee0db1b04d842ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 14:45:20 user nova-compute[72239]: DEBUG os_brick.utils [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:45:20 user nova-compute[72239]: INFO oslo.privsep.daemon [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp67ve2zhz/privsep.sock']
Jul 31 14:45:21 user sudo[83490]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp67ve2zhz/privsep.sock
Jul 31 14:45:21 user sudo[83490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 31 14:45:21 user nova-compute[72239]: DEBUG nova.network.neutron [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Successfully created port: c6a37c9e-0be0-4c76-bb14-fcdb3c39061c {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:45:22 user nova-compute[72239]: DEBUG nova.network.neutron [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Successfully created port: ba2d5a24-f668-4413-abb1-c51cf2038a1c {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:45:22 user nova-compute[72239]: DEBUG nova.network.neutron [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Successfully created port: c9d1f7e0-c42d-4870-9121-293f57196a09 {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:45:22 user sudo[83490]: pam_unix(sudo:session): session closed for user root
Jul 31 14:45:22 user nova-compute[72239]: INFO oslo.privsep.daemon [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Spawned new privsep daemon via rootwrap
Jul 31 14:45:22 user nova-compute[72239]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 31 14:45:22 user nova-compute[72239]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 31 14:45:22 user nova-compute[72239]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Jul 31 14:45:22 user nova-compute[72239]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83493
Jul 31 14:45:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[549a7277-8706-4a32-910e-b0beda1d1744]: (2,) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c09aef-8926-4ba7-b586-4f5e55effc66]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:23 user nova-compute[72239]: WARNING os_brick.initiator.connectors.nvmeof [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Jul 31 14:45:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5e4fed-593b-4de5-aade-9480ee30279b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf7f650-9e1d-443e-8ea2-5ff8ae154c47]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[96078baa-941f-4619-9ff9-2c0097002a02]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:45:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 14:45:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:45:23 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 14:45:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[06cfe0cf-e82a-4c3c-85a0-9641cee84019]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 14:45:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 14:45:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 14:45:23 user nova-compute[72239]: DEBUG os_brick.utils [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] <== get_connector_properties: return (2168ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:45:23 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Updating existing volume attachment record: e7436cdf-0c65-4d73-a1ed-0d4c271b8b38 {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 14:45:23 user nova-compute[72239]: DEBUG nova.network.neutron [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Successfully created port: eb8f7d6e-9f92-4684-8867-7f8aed33a68c {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:45:23 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:23 user nova-compute[72239]: DEBUG nova.network.neutron [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Successfully created port: 0642e4d3-ade9-425b-9860-f306229034b3 {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:45:24 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:24 user nova-compute[72239]: DEBUG nova.network.neutron [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Successfully updated port: c6a37c9e-0be0-4c76-bb14-fcdb3c39061c {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:45:24 user nova-compute[72239]: DEBUG nova.compute.manager [req-c7b38c7f-9061-4344-b1b9-b0bad8ac2a4f req-1af7dfa0-5492-42e7-aa58-1864ba138421 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-changed-c6a37c9e-0be0-4c76-bb14-fcdb3c39061c {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:45:24 user nova-compute[72239]: DEBUG nova.compute.manager [req-c7b38c7f-9061-4344-b1b9-b0bad8ac2a4f req-1af7dfa0-5492-42e7-aa58-1864ba138421 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Refreshing instance network info cache due to event network-changed-c6a37c9e-0be0-4c76-bb14-fcdb3c39061c. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:45:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-c7b38c7f-9061-4344-b1b9-b0bad8ac2a4f req-1af7dfa0-5492-42e7-aa58-1864ba138421 service nova] Acquiring lock "refresh_cache-9203aeaf-2ae9-4e28-9741-05d33df6c915" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:45:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-c7b38c7f-9061-4344-b1b9-b0bad8ac2a4f req-1af7dfa0-5492-42e7-aa58-1864ba138421 service nova] Acquired lock "refresh_cache-9203aeaf-2ae9-4e28-9741-05d33df6c915" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:45:24 user nova-compute[72239]: DEBUG nova.network.neutron [req-c7b38c7f-9061-4344-b1b9-b0bad8ac2a4f req-1af7dfa0-5492-42e7-aa58-1864ba138421 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Refreshing network info cache for port c6a37c9e-0be0-4c76-bb14-fcdb3c39061c {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:45:24 user nova-compute[72239]: DEBUG nova.network.neutron [req-c7b38c7f-9061-4344-b1b9-b0bad8ac2a4f req-1af7dfa0-5492-42e7-aa58-1864ba138421 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:45:25 user nova-compute[72239]: DEBUG nova.network.neutron [req-c7b38c7f-9061-4344-b1b9-b0bad8ac2a4f req-1af7dfa0-5492-42e7-aa58-1864ba138421 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:45:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-c7b38c7f-9061-4344-b1b9-b0bad8ac2a4f req-1af7dfa0-5492-42e7-aa58-1864ba138421 service nova] Releasing lock "refresh_cache-9203aeaf-2ae9-4e28-9741-05d33df6c915" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:45:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Acquiring lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:45:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:45:25 user nova-compute[72239]: DEBUG nova.compute.manager [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 14:45:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:45:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:45:26 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 14:45:26 user nova-compute[72239]: INFO nova.compute.claims [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Claim successful on node user
Jul 31 14:45:26 user nova-compute[72239]: DEBUG nova.network.neutron [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Successfully updated port: b0ff36fe-c825-4781-a755-951a52252422 {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:45:26 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:45:26 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:45:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.664s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:45:26 user nova-compute[72239]: DEBUG nova.compute.manager [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 14:45:26 user nova-compute[72239]: DEBUG nova.compute.manager [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 14:45:26 user nova-compute[72239]: DEBUG nova.network.neutron [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 14:45:26 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 14:45:26 user nova-compute[72239]: DEBUG nova.compute.manager [req-97fa208a-5ab2-470a-8d71-98764f4f8c54 req-80dd4550-9ddb-447f-9725-699af0819228 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-changed-b0ff36fe-c825-4781-a755-951a52252422 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:45:26 user nova-compute[72239]: DEBUG nova.compute.manager [req-97fa208a-5ab2-470a-8d71-98764f4f8c54 req-80dd4550-9ddb-447f-9725-699af0819228 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Refreshing instance network info cache due to event network-changed-b0ff36fe-c825-4781-a755-951a52252422. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:45:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-97fa208a-5ab2-470a-8d71-98764f4f8c54 req-80dd4550-9ddb-447f-9725-699af0819228 service nova] Acquiring lock "refresh_cache-9203aeaf-2ae9-4e28-9741-05d33df6c915" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:45:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-97fa208a-5ab2-470a-8d71-98764f4f8c54 req-80dd4550-9ddb-447f-9725-699af0819228 service nova] Acquired lock "refresh_cache-9203aeaf-2ae9-4e28-9741-05d33df6c915" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:45:26 user nova-compute[72239]: DEBUG nova.network.neutron [req-97fa208a-5ab2-470a-8d71-98764f4f8c54 req-80dd4550-9ddb-447f-9725-699af0819228 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Refreshing network info cache for port b0ff36fe-c825-4781-a755-951a52252422 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:45:26 user nova-compute[72239]: DEBUG nova.compute.manager [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 14:45:27 user nova-compute[72239]: DEBUG nova.network.neutron [req-97fa208a-5ab2-470a-8d71-98764f4f8c54 req-80dd4550-9ddb-447f-9725-699af0819228 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:45:27 user nova-compute[72239]: INFO nova.virt.block_device [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Booting with volume 9373b07a-291c-4687-9779-41418a02fad7 at /dev/vda
Jul 31 14:45:27 user nova-compute[72239]: DEBUG nova.network.neutron [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Successfully updated port: 8a006aee-3f68-4eb2-b214-6cf76db08ffe {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:45:27 user nova-compute[72239]: DEBUG os_brick.utils [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:45:27 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:27 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:27 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3733f928-8ddf-4536-9081-fc78d63b4fc7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:27 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:27 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:27 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e7fa25-22b3-4d6c-8f36-ddb0dd14412a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:27 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:27 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:27 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6853fe18-5d7b-4080-8048-a2ce3670533c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:27 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[37fd25ec-0f6b-480e-8786-dd3333a55c45]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:27 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:27 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:45:27 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 14:45:27 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:27 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:45:27 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 14:45:27 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73da9e8-2853-4dcd-bc3d-acb8a27aa221]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:27 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 14:45:27 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 14:45:27 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 14:45:27 user nova-compute[72239]: DEBUG os_brick.utils [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:45:27 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Updating existing volume attachment record: 76e84b8c-7d87-4f9f-9fbf-b2dac1388d23 {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 14:45:27 user nova-compute[72239]: DEBUG nova.policy [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b0281b9c87b9459bb375351257cac77b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f63f7e945de84876beec594d5cbb6682', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 14:45:27 user nova-compute[72239]: DEBUG nova.network.neutron [req-97fa208a-5ab2-470a-8d71-98764f4f8c54 req-80dd4550-9ddb-447f-9725-699af0819228 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:45:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-97fa208a-5ab2-470a-8d71-98764f4f8c54 req-80dd4550-9ddb-447f-9725-699af0819228 service nova] Releasing lock "refresh_cache-9203aeaf-2ae9-4e28-9741-05d33df6c915" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:45:28 user nova-compute[72239]: DEBUG nova.network.neutron [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Successfully created port: da58ae48-fdc4-4816-a641-525030c3beb2 {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:45:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:28 user nova-compute[72239]: DEBUG nova.network.neutron [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Successfully updated port: ba2d5a24-f668-4413-abb1-c51cf2038a1c {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:45:28 user nova-compute[72239]: DEBUG nova.compute.manager [req-a9cbe184-b193-4b1e-afa7-d509364caab6 req-fe1d0ab8-7ce4-4787-a3a6-760a90721e24 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-changed-8a006aee-3f68-4eb2-b214-6cf76db08ffe {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:45:28 user nova-compute[72239]: DEBUG nova.compute.manager [req-a9cbe184-b193-4b1e-afa7-d509364caab6 req-fe1d0ab8-7ce4-4787-a3a6-760a90721e24 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Refreshing instance network info cache due to event network-changed-8a006aee-3f68-4eb2-b214-6cf76db08ffe. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:45:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a9cbe184-b193-4b1e-afa7-d509364caab6 req-fe1d0ab8-7ce4-4787-a3a6-760a90721e24 service nova] Acquiring lock "refresh_cache-9203aeaf-2ae9-4e28-9741-05d33df6c915" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:45:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a9cbe184-b193-4b1e-afa7-d509364caab6 req-fe1d0ab8-7ce4-4787-a3a6-760a90721e24 service nova] Acquired lock "refresh_cache-9203aeaf-2ae9-4e28-9741-05d33df6c915" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:45:28 user nova-compute[72239]: DEBUG nova.network.neutron [req-a9cbe184-b193-4b1e-afa7-d509364caab6 req-fe1d0ab8-7ce4-4787-a3a6-760a90721e24 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Refreshing network info cache for port 8a006aee-3f68-4eb2-b214-6cf76db08ffe {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:45:29 user nova-compute[72239]: DEBUG nova.network.neutron [req-a9cbe184-b193-4b1e-afa7-d509364caab6 req-fe1d0ab8-7ce4-4787-a3a6-760a90721e24 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:45:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:29 user nova-compute[72239]: DEBUG nova.network.neutron [req-a9cbe184-b193-4b1e-afa7-d509364caab6 req-fe1d0ab8-7ce4-4787-a3a6-760a90721e24 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:45:29 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a9cbe184-b193-4b1e-afa7-d509364caab6 req-fe1d0ab8-7ce4-4787-a3a6-760a90721e24 service nova] Releasing lock "refresh_cache-9203aeaf-2ae9-4e28-9741-05d33df6c915" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:45:29 user nova-compute[72239]: DEBUG nova.compute.manager [req-a9cbe184-b193-4b1e-afa7-d509364caab6 req-fe1d0ab8-7ce4-4787-a3a6-760a90721e24 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-changed-ba2d5a24-f668-4413-abb1-c51cf2038a1c {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:45:29 user nova-compute[72239]: DEBUG nova.compute.manager [req-a9cbe184-b193-4b1e-afa7-d509364caab6 req-fe1d0ab8-7ce4-4787-a3a6-760a90721e24 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Refreshing instance network info cache due to event network-changed-ba2d5a24-f668-4413-abb1-c51cf2038a1c. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:45:29 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a9cbe184-b193-4b1e-afa7-d509364caab6 req-fe1d0ab8-7ce4-4787-a3a6-760a90721e24 service nova] Acquiring lock "refresh_cache-9203aeaf-2ae9-4e28-9741-05d33df6c915" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:45:29 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a9cbe184-b193-4b1e-afa7-d509364caab6 req-fe1d0ab8-7ce4-4787-a3a6-760a90721e24 service nova] Acquired lock "refresh_cache-9203aeaf-2ae9-4e28-9741-05d33df6c915" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:45:29 user nova-compute[72239]: DEBUG nova.network.neutron [req-a9cbe184-b193-4b1e-afa7-d509364caab6 req-fe1d0ab8-7ce4-4787-a3a6-760a90721e24 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Refreshing network info cache for port ba2d5a24-f668-4413-abb1-c51cf2038a1c {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:45:29 user nova-compute[72239]: DEBUG nova.network.neutron [req-a9cbe184-b193-4b1e-afa7-d509364caab6 req-fe1d0ab8-7ce4-4787-a3a6-760a90721e24 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:45:29 user nova-compute[72239]: DEBUG nova.network.neutron [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Successfully created port: 01e36afb-4b92-42af-a2da-900e447e474e {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:45:29 user nova-compute[72239]: DEBUG nova.network.neutron [req-a9cbe184-b193-4b1e-afa7-d509364caab6 req-fe1d0ab8-7ce4-4787-a3a6-760a90721e24 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:45:29 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a9cbe184-b193-4b1e-afa7-d509364caab6 req-fe1d0ab8-7ce4-4787-a3a6-760a90721e24 service nova] Releasing lock "refresh_cache-9203aeaf-2ae9-4e28-9741-05d33df6c915" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:45:30 user nova-compute[72239]: DEBUG nova.network.neutron [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Successfully updated port: c9d1f7e0-c42d-4870-9121-293f57196a09 {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:45:30 user nova-compute[72239]: DEBUG nova.network.neutron [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Successfully created port: 87d5bb80-ad2c-4137-89f2-03bc494de37d {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:45:30 user nova-compute[72239]: INFO nova.virt.block_device [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Booting with volume 24a7c8cf-bf98-4c59-8ee1-2b371357a051 at /dev/vdb
Jul 31 14:45:31 user nova-compute[72239]: DEBUG os_brick.utils [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:45:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:31 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4019e015-62a5-4584-bd0c-450c46d8c026]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:31 user nova-compute[72239]: DEBUG nova.compute.manager [req-543592f7-7f56-4370-897d-6b591701dd3a req-1975deb8-e8fb-4822-a61c-00b750483370 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-changed-c9d1f7e0-c42d-4870-9121-293f57196a09 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:45:31 user nova-compute[72239]: DEBUG nova.compute.manager [req-543592f7-7f56-4370-897d-6b591701dd3a req-1975deb8-e8fb-4822-a61c-00b750483370 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Refreshing instance network info cache due to event network-changed-c9d1f7e0-c42d-4870-9121-293f57196a09. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:45:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-543592f7-7f56-4370-897d-6b591701dd3a req-1975deb8-e8fb-4822-a61c-00b750483370 service nova] Acquiring lock "refresh_cache-9203aeaf-2ae9-4e28-9741-05d33df6c915" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:45:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-543592f7-7f56-4370-897d-6b591701dd3a req-1975deb8-e8fb-4822-a61c-00b750483370 service nova] Acquired lock "refresh_cache-9203aeaf-2ae9-4e28-9741-05d33df6c915" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:45:31 user nova-compute[72239]: DEBUG nova.network.neutron [req-543592f7-7f56-4370-897d-6b591701dd3a req-1975deb8-e8fb-4822-a61c-00b750483370 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Refreshing network info cache for port c9d1f7e0-c42d-4870-9121-293f57196a09 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:45:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:31 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cceb353a-47ff-4be5-8e18-eeb3c00f5fa2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:31 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[890cae01-8cc6-42c7-95d7-08ac19f2cc70]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:31 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec10190e-617b-4b92-b00f-79769d88fce5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:45:31 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 14:45:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:31 user nova-compute[72239]: DEBUG nova.network.neutron [req-543592f7-7f56-4370-897d-6b591701dd3a req-1975deb8-e8fb-4822-a61c-00b750483370 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:45:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:45:31 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 14:45:31 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cffdd44-c1ed-4395-aa45-e6e8fa866f72]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:31 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 14:45:31 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 14:45:31 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 14:45:31 user nova-compute[72239]: DEBUG os_brick.utils [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:45:31 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Updating existing volume attachment record: 6e5036aa-536f-4ce8-b884-5fed310c9bff {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 14:45:31 user nova-compute[72239]: DEBUG nova.network.neutron [req-543592f7-7f56-4370-897d-6b591701dd3a req-1975deb8-e8fb-4822-a61c-00b750483370 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:45:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-543592f7-7f56-4370-897d-6b591701dd3a req-1975deb8-e8fb-4822-a61c-00b750483370 service nova] Releasing lock "refresh_cache-9203aeaf-2ae9-4e28-9741-05d33df6c915" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:45:31 user nova-compute[72239]: DEBUG nova.network.neutron [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Successfully updated port: eb8f7d6e-9f92-4684-8867-7f8aed33a68c {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:45:31 user nova-compute[72239]: DEBUG nova.network.neutron [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Successfully created port: c330e2c1-2507-406a-b255-6e72d82c689e {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:45:32 user nova-compute[72239]: DEBUG nova.network.neutron [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Successfully created port: 6fba6d4e-0137-4514-9525-29e86356c1eb {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:45:32 user nova-compute[72239]: DEBUG nova.network.neutron [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Successfully updated port: 0642e4d3-ade9-425b-9860-f306229034b3 {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:45:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Acquiring lock "refresh_cache-9203aeaf-2ae9-4e28-9741-05d33df6c915" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:45:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Acquired lock "refresh_cache-9203aeaf-2ae9-4e28-9741-05d33df6c915" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:45:32 user nova-compute[72239]: DEBUG nova.network.neutron [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:45:32 user nova-compute[72239]: DEBUG nova.network.neutron [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:45:33 user nova-compute[72239]: DEBUG nova.compute.manager [req-254d8cf1-c251-41a2-b47d-a434f502d6cd req-84f9d5d8-f74b-46e0-aab9-1eb72fc3786b service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-changed-eb8f7d6e-9f92-4684-8867-7f8aed33a68c {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:45:33 user nova-compute[72239]: DEBUG nova.compute.manager [req-254d8cf1-c251-41a2-b47d-a434f502d6cd req-84f9d5d8-f74b-46e0-aab9-1eb72fc3786b service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Refreshing instance network info cache due to event network-changed-eb8f7d6e-9f92-4684-8867-7f8aed33a68c. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:45:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-254d8cf1-c251-41a2-b47d-a434f502d6cd req-84f9d5d8-f74b-46e0-aab9-1eb72fc3786b service nova] Acquiring lock "refresh_cache-9203aeaf-2ae9-4e28-9741-05d33df6c915" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:45:33 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:34 user nova-compute[72239]: DEBUG nova.network.neutron [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Successfully updated port: da58ae48-fdc4-4816-a641-525030c3beb2 {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:45:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:34 user nova-compute[72239]: INFO nova.virt.block_device [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Booting with volume c6970ccf-414d-409e-8c4d-cf3a5efa487a at /dev/vdb
Jul 31 14:45:34 user nova-compute[72239]: DEBUG os_brick.utils [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:45:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:34 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[111aaf34-e9fd-4fba-a171-5a41e78e0f39]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:34 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40e13ee-5dc3-4213-8aaa-f0cdc0f4b82b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:34 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a088740-00df-4153-bcd4-e105c63604a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:34 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbbdec65-5ac9-4fe4-9cce-681354a593fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:45:34 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 14:45:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:45:34 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 14:45:34 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa8dec8-9021-4a23-8ab9-92f1e47d5a17]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:34 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 14:45:34 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 14:45:34 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 14:45:34 user nova-compute[72239]: DEBUG os_brick.utils [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:45:34 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Updating existing volume attachment record: 2905a107-743d-4db7-9d6a-521bf9274843 {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 14:45:35 user nova-compute[72239]: DEBUG nova.compute.manager [req-20d341c4-f4b1-4dab-ab9b-956f09b4f60c req-627bba65-b5fb-42ae-81bd-30834c43b5e8 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-changed-da58ae48-fdc4-4816-a641-525030c3beb2 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:45:35 user nova-compute[72239]: DEBUG nova.compute.manager [req-20d341c4-f4b1-4dab-ab9b-956f09b4f60c req-627bba65-b5fb-42ae-81bd-30834c43b5e8 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Refreshing instance network info cache due to event network-changed-da58ae48-fdc4-4816-a641-525030c3beb2. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:45:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-20d341c4-f4b1-4dab-ab9b-956f09b4f60c req-627bba65-b5fb-42ae-81bd-30834c43b5e8 service nova] Acquiring lock "refresh_cache-6258dba2-2e73-45d7-99f0-9a4af065ffcc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:45:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-20d341c4-f4b1-4dab-ab9b-956f09b4f60c req-627bba65-b5fb-42ae-81bd-30834c43b5e8 service nova] Acquired lock "refresh_cache-6258dba2-2e73-45d7-99f0-9a4af065ffcc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:45:35 user nova-compute[72239]: DEBUG nova.network.neutron [req-20d341c4-f4b1-4dab-ab9b-956f09b4f60c req-627bba65-b5fb-42ae-81bd-30834c43b5e8 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Refreshing network info cache for port da58ae48-fdc4-4816-a641-525030c3beb2 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:45:35 user nova-compute[72239]: DEBUG nova.network.neutron [req-20d341c4-f4b1-4dab-ab9b-956f09b4f60c req-627bba65-b5fb-42ae-81bd-30834c43b5e8 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:45:35 user nova-compute[72239]: DEBUG nova.network.neutron [req-20d341c4-f4b1-4dab-ab9b-956f09b4f60c req-627bba65-b5fb-42ae-81bd-30834c43b5e8 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:45:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-20d341c4-f4b1-4dab-ab9b-956f09b4f60c req-627bba65-b5fb-42ae-81bd-30834c43b5e8 service nova] Releasing lock "refresh_cache-6258dba2-2e73-45d7-99f0-9a4af065ffcc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:45:35 user nova-compute[72239]: DEBUG nova.network.neutron [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Successfully updated port: 403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:45:36 user nova-compute[72239]: DEBUG nova.network.neutron [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Updating instance_info_cache with network_info: [{"id": "c6a37c9e-0be0-4c76-bb14-fcdb3c39061c", "address": "fa:16:3e:3e:7d:12", "network": {"id": "a5162307-ddc4-4843-a8a1-dbd8f52a9ae7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1082900222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a37c9e-0b", "ovs_interfaceid": "c6a37c9e-0be0-4c76-bb14-fcdb3c39061c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0ff36fe-c825-4781-a755-951a52252422", "address": "fa:16:3e:8f:14:75", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0ff36fe-c8", "ovs_interfaceid": "b0ff36fe-c825-4781-a755-951a52252422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8a006aee-3f68-4eb2-b214-6cf76db08ffe", "address": "fa:16:3e:01:82:d6", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a006aee-3f", "ovs_interfaceid": "8a006aee-3f68-4eb2-b214-6cf76db08ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ba2d5a24-f668-4413-abb1-c51cf2038a1c", "address": "fa:16:3e:6c:f1:44", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba2d5a24-f6", "ovs_interfaceid": "ba2d5a24-f668-4413-abb1-c51cf2038a1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c9d1f7e0-c42d-4870-9121-293f57196a09", "address": "fa:16:3e:31:22:60", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d1f7e0-c4", "ovs_interfaceid": "c9d1f7e0-c42d-4870-9121-293f57196a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb8f7d6e-9f92-4684-8867-7f8aed33a68c", "address": "fa:16:3e:f4:31:a2", "network": {"id": "a3e00fe3-9848-453f-89ef-136074c0524f", "bridge": "br-int", "label": "tempest-device-tagging-net2-758627650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb8f7d6e-9f", "ovs_interfaceid": "eb8f7d6e-9f92-4684-8867-7f8aed33a68c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0642e4d3-ade9-425b-9860-f306229034b3", "address": "fa:16:3e:d0:43:52", "network": {"id": "a3e00fe3-9848-453f-89ef-136074c0524f", "bridge": "br-int", "label": "tempest-device-tagging-net2-758627650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0642e4d3-ad", "ovs_interfaceid": "0642e4d3-ade9-425b-9860-f306229034b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:45:36 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Releasing lock "refresh_cache-9203aeaf-2ae9-4e28-9741-05d33df6c915" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:45:36 user nova-compute[72239]: DEBUG nova.compute.manager [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Instance network_info: |[{"id": "c6a37c9e-0be0-4c76-bb14-fcdb3c39061c", "address": "fa:16:3e:3e:7d:12", "network": {"id": "a5162307-ddc4-4843-a8a1-dbd8f52a9ae7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1082900222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a37c9e-0b", "ovs_interfaceid": "c6a37c9e-0be0-4c76-bb14-fcdb3c39061c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0ff36fe-c825-4781-a755-951a52252422", "address": "fa:16:3e:8f:14:75", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0ff36fe-c8", "ovs_interfaceid": "b0ff36fe-c825-4781-a755-951a52252422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8a006aee-3f68-4eb2-b214-6cf76db08ffe", "address": "fa:16:3e:01:82:d6", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a006aee-3f", "ovs_interfaceid": "8a006aee-3f68-4eb2-b214-6cf76db08ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ba2d5a24-f668-4413-abb1-c51cf2038a1c", "address": "fa:16:3e:6c:f1:44", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba2d5a24-f6", "ovs_interfaceid": "ba2d5a24-f668-4413-abb1-c51cf2038a1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c9d1f7e0-c42d-4870-9121-293f57196a09", "address": "fa:16:3e:31:22:60", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d1f7e0-c4", "ovs_interfaceid": "c9d1f7e0-c42d-4870-9121-293f57196a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb8f7d6e-9f92-4684-8867-7f8aed33a68c", "address": "fa:16:3e:f4:31:a2", "network": {"id": "a3e00fe3-9848-453f-89ef-136074c0524f", "bridge": "br-int", "label": "tempest-device-tagging-net2-758627650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb8f7d6e-9f", "ovs_interfaceid": "eb8f7d6e-9f92-4684-8867-7f8aed33a68c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0642e4d3-ade9-425b-9860-f306229034b3", "address": "fa:16:3e:d0:43:52", "network": {"id": "a3e00fe3-9848-453f-89ef-136074c0524f", "bridge": "br-int", "label": "tempest-device-tagging-net2-758627650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0642e4d3-ad", "ovs_interfaceid": "0642e4d3-ade9-425b-9860-f306229034b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 14:45:36 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-254d8cf1-c251-41a2-b47d-a434f502d6cd req-84f9d5d8-f74b-46e0-aab9-1eb72fc3786b service nova] Acquired lock "refresh_cache-9203aeaf-2ae9-4e28-9741-05d33df6c915" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:45:36 user nova-compute[72239]: DEBUG nova.network.neutron [req-254d8cf1-c251-41a2-b47d-a434f502d6cd req-84f9d5d8-f74b-46e0-aab9-1eb72fc3786b service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Refreshing network info cache for port eb8f7d6e-9f92-4684-8867-7f8aed33a68c {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:45:36 user nova-compute[72239]: DEBUG nova.network.neutron [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Successfully updated port: 57f80e07-cfe0-47a5-9b99-10166cdcf351 {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:45:37 user nova-compute[72239]: DEBUG nova.network.neutron [req-254d8cf1-c251-41a2-b47d-a434f502d6cd req-84f9d5d8-f74b-46e0-aab9-1eb72fc3786b service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Updated VIF entry in instance network info cache for port eb8f7d6e-9f92-4684-8867-7f8aed33a68c. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:45:37 user nova-compute[72239]: DEBUG nova.network.neutron [req-254d8cf1-c251-41a2-b47d-a434f502d6cd req-84f9d5d8-f74b-46e0-aab9-1eb72fc3786b service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Updating instance_info_cache with network_info: [{"id": "c6a37c9e-0be0-4c76-bb14-fcdb3c39061c", "address": "fa:16:3e:3e:7d:12", "network": {"id": "a5162307-ddc4-4843-a8a1-dbd8f52a9ae7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1082900222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a37c9e-0b", "ovs_interfaceid": "c6a37c9e-0be0-4c76-bb14-fcdb3c39061c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0ff36fe-c825-4781-a755-951a52252422", "address": "fa:16:3e:8f:14:75", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0ff36fe-c8", "ovs_interfaceid": "b0ff36fe-c825-4781-a755-951a52252422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8a006aee-3f68-4eb2-b214-6cf76db08ffe", "address": "fa:16:3e:01:82:d6", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a006aee-3f", "ovs_interfaceid": "8a006aee-3f68-4eb2-b214-6cf76db08ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ba2d5a24-f668-4413-abb1-c51cf2038a1c", "address": "fa:16:3e:6c:f1:44", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba2d5a24-f6", "ovs_interfaceid": "ba2d5a24-f668-4413-abb1-c51cf2038a1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c9d1f7e0-c42d-4870-9121-293f57196a09", "address": "fa:16:3e:31:22:60", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d1f7e0-c4", "ovs_interfaceid": "c9d1f7e0-c42d-4870-9121-293f57196a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb8f7d6e-9f92-4684-8867-7f8aed33a68c", "address": "fa:16:3e:f4:31:a2", "network": {"id": "a3e00fe3-9848-453f-89ef-136074c0524f", "bridge": "br-int", "label": "tempest-device-tagging-net2-758627650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb8f7d6e-9f", "ovs_interfaceid": "eb8f7d6e-9f92-4684-8867-7f8aed33a68c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0642e4d3-ade9-425b-9860-f306229034b3", "address": "fa:16:3e:d0:43:52", "network": {"id": "a3e00fe3-9848-453f-89ef-136074c0524f", "bridge": "br-int", "label": "tempest-device-tagging-net2-758627650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0642e4d3-ad", "ovs_interfaceid": "0642e4d3-ade9-425b-9860-f306229034b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:45:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-254d8cf1-c251-41a2-b47d-a434f502d6cd req-84f9d5d8-f74b-46e0-aab9-1eb72fc3786b service nova] Releasing lock "refresh_cache-9203aeaf-2ae9-4e28-9741-05d33df6c915" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:45:37 user nova-compute[72239]: DEBUG nova.compute.manager [req-254d8cf1-c251-41a2-b47d-a434f502d6cd req-84f9d5d8-f74b-46e0-aab9-1eb72fc3786b service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-changed-0642e4d3-ade9-425b-9860-f306229034b3 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:45:37 user nova-compute[72239]: DEBUG nova.compute.manager [req-254d8cf1-c251-41a2-b47d-a434f502d6cd req-84f9d5d8-f74b-46e0-aab9-1eb72fc3786b service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Refreshing instance network info cache due to event network-changed-0642e4d3-ade9-425b-9860-f306229034b3. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:45:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-254d8cf1-c251-41a2-b47d-a434f502d6cd req-84f9d5d8-f74b-46e0-aab9-1eb72fc3786b service nova] Acquiring lock "refresh_cache-9203aeaf-2ae9-4e28-9741-05d33df6c915" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:45:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-254d8cf1-c251-41a2-b47d-a434f502d6cd req-84f9d5d8-f74b-46e0-aab9-1eb72fc3786b service nova] Acquired lock "refresh_cache-9203aeaf-2ae9-4e28-9741-05d33df6c915" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:45:37 user nova-compute[72239]: DEBUG nova.network.neutron [req-254d8cf1-c251-41a2-b47d-a434f502d6cd req-84f9d5d8-f74b-46e0-aab9-1eb72fc3786b service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Refreshing network info cache for port 0642e4d3-ade9-425b-9860-f306229034b3 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:45:37 user nova-compute[72239]: DEBUG nova.compute.manager [req-81e4a48d-af24-4f7d-96cc-09987c8d772a req-798e8cee-e44d-4d33-9bc6-7f60f2dfeff3 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-changed-403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:45:37 user nova-compute[72239]: DEBUG nova.compute.manager [req-81e4a48d-af24-4f7d-96cc-09987c8d772a req-798e8cee-e44d-4d33-9bc6-7f60f2dfeff3 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Refreshing instance network info cache due to event network-changed-403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:45:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-81e4a48d-af24-4f7d-96cc-09987c8d772a req-798e8cee-e44d-4d33-9bc6-7f60f2dfeff3 service nova] Acquiring lock "refresh_cache-6258dba2-2e73-45d7-99f0-9a4af065ffcc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:45:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-81e4a48d-af24-4f7d-96cc-09987c8d772a req-798e8cee-e44d-4d33-9bc6-7f60f2dfeff3 service nova] Acquired lock "refresh_cache-6258dba2-2e73-45d7-99f0-9a4af065ffcc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:45:37 user nova-compute[72239]: DEBUG nova.network.neutron [req-81e4a48d-af24-4f7d-96cc-09987c8d772a req-798e8cee-e44d-4d33-9bc6-7f60f2dfeff3 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Refreshing network info cache for port 403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:45:37 user nova-compute[72239]: DEBUG nova.network.neutron [req-81e4a48d-af24-4f7d-96cc-09987c8d772a req-798e8cee-e44d-4d33-9bc6-7f60f2dfeff3 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:45:37 user nova-compute[72239]: DEBUG nova.network.neutron [req-254d8cf1-c251-41a2-b47d-a434f502d6cd req-84f9d5d8-f74b-46e0-aab9-1eb72fc3786b service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Updated VIF entry in instance network info cache for port 0642e4d3-ade9-425b-9860-f306229034b3. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:45:37 user nova-compute[72239]: DEBUG nova.network.neutron [req-254d8cf1-c251-41a2-b47d-a434f502d6cd req-84f9d5d8-f74b-46e0-aab9-1eb72fc3786b service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Updating instance_info_cache with network_info: [{"id": "c6a37c9e-0be0-4c76-bb14-fcdb3c39061c", "address": "fa:16:3e:3e:7d:12", "network": {"id": "a5162307-ddc4-4843-a8a1-dbd8f52a9ae7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1082900222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a37c9e-0b", "ovs_interfaceid": "c6a37c9e-0be0-4c76-bb14-fcdb3c39061c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0ff36fe-c825-4781-a755-951a52252422", "address": "fa:16:3e:8f:14:75", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0ff36fe-c8", "ovs_interfaceid": "b0ff36fe-c825-4781-a755-951a52252422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8a006aee-3f68-4eb2-b214-6cf76db08ffe", "address": "fa:16:3e:01:82:d6", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a006aee-3f", "ovs_interfaceid": "8a006aee-3f68-4eb2-b214-6cf76db08ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ba2d5a24-f668-4413-abb1-c51cf2038a1c", "address": "fa:16:3e:6c:f1:44", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba2d5a24-f6", "ovs_interfaceid": "ba2d5a24-f668-4413-abb1-c51cf2038a1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c9d1f7e0-c42d-4870-9121-293f57196a09", "address": "fa:16:3e:31:22:60", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d1f7e0-c4", "ovs_interfaceid": "c9d1f7e0-c42d-4870-9121-293f57196a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb8f7d6e-9f92-4684-8867-7f8aed33a68c", "address": "fa:16:3e:f4:31:a2", "network": {"id": "a3e00fe3-9848-453f-89ef-136074c0524f", "bridge": "br-int", "label": "tempest-device-tagging-net2-758627650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb8f7d6e-9f", "ovs_interfaceid": "eb8f7d6e-9f92-4684-8867-7f8aed33a68c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0642e4d3-ade9-425b-9860-f306229034b3", "address": "fa:16:3e:d0:43:52", "network": {"id": "a3e00fe3-9848-453f-89ef-136074c0524f", "bridge": "br-int", "label": "tempest-device-tagging-net2-758627650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0642e4d3-ad", "ovs_interfaceid": "0642e4d3-ade9-425b-9860-f306229034b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:45:37 user nova-compute[72239]: DEBUG nova.network.neutron [req-81e4a48d-af24-4f7d-96cc-09987c8d772a req-798e8cee-e44d-4d33-9bc6-7f60f2dfeff3 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:45:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-254d8cf1-c251-41a2-b47d-a434f502d6cd req-84f9d5d8-f74b-46e0-aab9-1eb72fc3786b service nova] Releasing lock "refresh_cache-9203aeaf-2ae9-4e28-9741-05d33df6c915" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:45:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-81e4a48d-af24-4f7d-96cc-09987c8d772a req-798e8cee-e44d-4d33-9bc6-7f60f2dfeff3 service nova] Releasing lock "refresh_cache-6258dba2-2e73-45d7-99f0-9a4af065ffcc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:45:37 user nova-compute[72239]: DEBUG nova.compute.manager [req-81e4a48d-af24-4f7d-96cc-09987c8d772a req-798e8cee-e44d-4d33-9bc6-7f60f2dfeff3 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-changed-57f80e07-cfe0-47a5-9b99-10166cdcf351 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:45:37 user nova-compute[72239]: DEBUG nova.compute.manager [req-81e4a48d-af24-4f7d-96cc-09987c8d772a req-798e8cee-e44d-4d33-9bc6-7f60f2dfeff3 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Refreshing instance network info cache due to event network-changed-57f80e07-cfe0-47a5-9b99-10166cdcf351. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:45:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-81e4a48d-af24-4f7d-96cc-09987c8d772a req-798e8cee-e44d-4d33-9bc6-7f60f2dfeff3 service nova] Acquiring lock "refresh_cache-6258dba2-2e73-45d7-99f0-9a4af065ffcc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:45:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-81e4a48d-af24-4f7d-96cc-09987c8d772a req-798e8cee-e44d-4d33-9bc6-7f60f2dfeff3 service nova] Acquired lock "refresh_cache-6258dba2-2e73-45d7-99f0-9a4af065ffcc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:45:37 user nova-compute[72239]: DEBUG nova.network.neutron [req-81e4a48d-af24-4f7d-96cc-09987c8d772a req-798e8cee-e44d-4d33-9bc6-7f60f2dfeff3 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Refreshing network info cache for port 57f80e07-cfe0-47a5-9b99-10166cdcf351 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:45:37 user nova-compute[72239]: DEBUG nova.network.neutron [req-81e4a48d-af24-4f7d-96cc-09987c8d772a req-798e8cee-e44d-4d33-9bc6-7f60f2dfeff3 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:45:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:37 user nova-compute[72239]: DEBUG nova.network.neutron [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Successfully updated port: 01e36afb-4b92-42af-a2da-900e447e474e {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:45:37 user nova-compute[72239]: DEBUG nova.network.neutron [req-81e4a48d-af24-4f7d-96cc-09987c8d772a req-798e8cee-e44d-4d33-9bc6-7f60f2dfeff3 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:45:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-81e4a48d-af24-4f7d-96cc-09987c8d772a req-798e8cee-e44d-4d33-9bc6-7f60f2dfeff3 service nova] Releasing lock "refresh_cache-6258dba2-2e73-45d7-99f0-9a4af065ffcc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:45:38 user nova-compute[72239]: INFO nova.virt.block_device [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Booting with volume d75c85fd-3eb9-43a3-b677-2d8b157b8406 at /dev/vdc
Jul 31 14:45:38 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:38 user nova-compute[72239]: DEBUG os_brick.utils [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:45:38 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:38 user nova-compute[72239]: DEBUG nova.network.neutron [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Successfully updated port: 87d5bb80-ad2c-4137-89f2-03bc494de37d {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:45:38 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:38 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd88103-91aa-4327-9934-7e5bf205ca19]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:38 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:38 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:38 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1658e801-e65e-4024-9c24-0c520f93ccc9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:38 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:38 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:38 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc847d46-616b-4701-95c3-3134d9920379]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:38 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e3c82bd-ab6d-4240-8a30-6901802e2d8d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:38 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:38 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:45:38 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 14:45:38 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:38 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:45:38 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 14:45:38 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[799afe13-fdc6-4c62-86f2-de0db589b016]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:38 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 14:45:38 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 14:45:38 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 14:45:38 user nova-compute[72239]: DEBUG os_brick.utils [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:45:38 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Updating existing volume attachment record: 9b89475d-4d7e-467f-b1b1-19b7ae4ecedc {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 14:45:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:39 user nova-compute[72239]: DEBUG nova.compute.manager [req-5431feb9-5dfd-447e-86de-12745e9083bf req-76a6a9c7-493f-4ddc-82bf-53d5d5752189 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-changed-01e36afb-4b92-42af-a2da-900e447e474e {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:45:39 user nova-compute[72239]: DEBUG nova.compute.manager [req-5431feb9-5dfd-447e-86de-12745e9083bf req-76a6a9c7-493f-4ddc-82bf-53d5d5752189 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Refreshing instance network info cache due to event network-changed-01e36afb-4b92-42af-a2da-900e447e474e. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:45:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5431feb9-5dfd-447e-86de-12745e9083bf req-76a6a9c7-493f-4ddc-82bf-53d5d5752189 service nova] Acquiring lock "refresh_cache-6258dba2-2e73-45d7-99f0-9a4af065ffcc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:45:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5431feb9-5dfd-447e-86de-12745e9083bf req-76a6a9c7-493f-4ddc-82bf-53d5d5752189 service nova] Acquired lock "refresh_cache-6258dba2-2e73-45d7-99f0-9a4af065ffcc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:45:39 user nova-compute[72239]: DEBUG nova.network.neutron [req-5431feb9-5dfd-447e-86de-12745e9083bf req-76a6a9c7-493f-4ddc-82bf-53d5d5752189 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Refreshing network info cache for port 01e36afb-4b92-42af-a2da-900e447e474e {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:45:39 user nova-compute[72239]: DEBUG nova.network.neutron [req-5431feb9-5dfd-447e-86de-12745e9083bf req-76a6a9c7-493f-4ddc-82bf-53d5d5752189 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:45:39 user nova-compute[72239]: DEBUG nova.network.neutron [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Successfully updated port: c330e2c1-2507-406a-b255-6e72d82c689e {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:45:39 user nova-compute[72239]: DEBUG nova.network.neutron [req-5431feb9-5dfd-447e-86de-12745e9083bf req-76a6a9c7-493f-4ddc-82bf-53d5d5752189 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:45:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5431feb9-5dfd-447e-86de-12745e9083bf req-76a6a9c7-493f-4ddc-82bf-53d5d5752189 service nova] Releasing lock "refresh_cache-6258dba2-2e73-45d7-99f0-9a4af065ffcc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:45:39 user nova-compute[72239]: DEBUG nova.compute.manager [req-5431feb9-5dfd-447e-86de-12745e9083bf req-76a6a9c7-493f-4ddc-82bf-53d5d5752189 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-changed-87d5bb80-ad2c-4137-89f2-03bc494de37d {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:45:39 user nova-compute[72239]: DEBUG nova.compute.manager [req-5431feb9-5dfd-447e-86de-12745e9083bf req-76a6a9c7-493f-4ddc-82bf-53d5d5752189 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Refreshing instance network info cache due to event network-changed-87d5bb80-ad2c-4137-89f2-03bc494de37d. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:45:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5431feb9-5dfd-447e-86de-12745e9083bf req-76a6a9c7-493f-4ddc-82bf-53d5d5752189 service nova] Acquiring lock "refresh_cache-6258dba2-2e73-45d7-99f0-9a4af065ffcc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:45:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5431feb9-5dfd-447e-86de-12745e9083bf req-76a6a9c7-493f-4ddc-82bf-53d5d5752189 service nova] Acquired lock "refresh_cache-6258dba2-2e73-45d7-99f0-9a4af065ffcc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:45:39 user nova-compute[72239]: DEBUG nova.network.neutron [req-5431feb9-5dfd-447e-86de-12745e9083bf req-76a6a9c7-493f-4ddc-82bf-53d5d5752189 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Refreshing network info cache for port 87d5bb80-ad2c-4137-89f2-03bc494de37d {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:45:39 user nova-compute[72239]: DEBUG nova.network.neutron [req-5431feb9-5dfd-447e-86de-12745e9083bf req-76a6a9c7-493f-4ddc-82bf-53d5d5752189 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:45:40 user nova-compute[72239]: DEBUG nova.network.neutron [req-5431feb9-5dfd-447e-86de-12745e9083bf req-76a6a9c7-493f-4ddc-82bf-53d5d5752189 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:45:40 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5431feb9-5dfd-447e-86de-12745e9083bf req-76a6a9c7-493f-4ddc-82bf-53d5d5752189 service nova] Releasing lock "refresh_cache-6258dba2-2e73-45d7-99f0-9a4af065ffcc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:45:40 user nova-compute[72239]: DEBUG nova.network.neutron [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Successfully updated port: 6fba6d4e-0137-4514-9525-29e86356c1eb {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:45:40 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Acquiring lock "refresh_cache-6258dba2-2e73-45d7-99f0-9a4af065ffcc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:45:40 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Acquired lock "refresh_cache-6258dba2-2e73-45d7-99f0-9a4af065ffcc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:45:40 user nova-compute[72239]: DEBUG nova.network.neutron [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:45:40 user nova-compute[72239]: DEBUG nova.network.neutron [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:45:41 user nova-compute[72239]: DEBUG nova.compute.manager [req-15a6d4b3-b7ba-48ab-a374-a00ee80a0560 req-e5a4693a-7631-48df-876f-9c7b44429f29 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-changed-c330e2c1-2507-406a-b255-6e72d82c689e {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:45:41 user nova-compute[72239]: DEBUG nova.compute.manager [req-15a6d4b3-b7ba-48ab-a374-a00ee80a0560 req-e5a4693a-7631-48df-876f-9c7b44429f29 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Refreshing instance network info cache due to event network-changed-c330e2c1-2507-406a-b255-6e72d82c689e. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:45:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-15a6d4b3-b7ba-48ab-a374-a00ee80a0560 req-e5a4693a-7631-48df-876f-9c7b44429f29 service nova] Acquiring lock "refresh_cache-6258dba2-2e73-45d7-99f0-9a4af065ffcc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:45:42 user nova-compute[72239]: DEBUG nova.network.neutron [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Updating instance_info_cache with network_info: [{"id": "da58ae48-fdc4-4816-a641-525030c3beb2", "address": "fa:16:3e:9e:5d:97", "network": {"id": "245d91f7-48d7-400e-80a3-b6d5b3aae4c8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-368247279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda58ae48-fd", "ovs_interfaceid": "da58ae48-fdc4-4816-a641-525030c3beb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd", "address": "fa:16:3e:22:52:9b", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap403cc6d2-3c", "ovs_interfaceid": "403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "57f80e07-cfe0-47a5-9b99-10166cdcf351", "address": "fa:16:3e:81:bd:5b", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f80e07-cf", "ovs_interfaceid": "57f80e07-cfe0-47a5-9b99-10166cdcf351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01e36afb-4b92-42af-a2da-900e447e474e", "address": "fa:16:3e:10:e1:8d", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e36afb-4b", "ovs_interfaceid": "01e36afb-4b92-42af-a2da-900e447e474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87d5bb80-ad2c-4137-89f2-03bc494de37d", "address": "fa:16:3e:9e:00:eb", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87d5bb80-ad", "ovs_interfaceid": "87d5bb80-ad2c-4137-89f2-03bc494de37d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c330e2c1-2507-406a-b255-6e72d82c689e", "address": "fa:16:3e:1d:8b:68", "network": {"id": "6ffbd985-4f07-4813-901c-fa0af7d3588b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1064713526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc330e2c1-25", "ovs_interfaceid": "c330e2c1-2507-406a-b255-6e72d82c689e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6fba6d4e-0137-4514-9525-29e86356c1eb", "address": "fa:16:3e:87:eb:18", "network": {"id": "6ffbd985-4f07-4813-901c-fa0af7d3588b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1064713526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fba6d4e-01", "ovs_interfaceid": "6fba6d4e-0137-4514-9525-29e86356c1eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:45:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Releasing lock "refresh_cache-6258dba2-2e73-45d7-99f0-9a4af065ffcc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:45:42 user nova-compute[72239]: DEBUG nova.compute.manager [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Instance network_info: |[{"id": "da58ae48-fdc4-4816-a641-525030c3beb2", "address": "fa:16:3e:9e:5d:97", "network": {"id": "245d91f7-48d7-400e-80a3-b6d5b3aae4c8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-368247279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda58ae48-fd", "ovs_interfaceid": "da58ae48-fdc4-4816-a641-525030c3beb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd", "address": "fa:16:3e:22:52:9b", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap403cc6d2-3c", "ovs_interfaceid": "403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "57f80e07-cfe0-47a5-9b99-10166cdcf351", "address": "fa:16:3e:81:bd:5b", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f80e07-cf", "ovs_interfaceid": "57f80e07-cfe0-47a5-9b99-10166cdcf351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01e36afb-4b92-42af-a2da-900e447e474e", "address": "fa:16:3e:10:e1:8d", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e36afb-4b", "ovs_interfaceid": "01e36afb-4b92-42af-a2da-900e447e474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87d5bb80-ad2c-4137-89f2-03bc494de37d", "address": "fa:16:3e:9e:00:eb", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87d5bb80-ad", "ovs_interfaceid": "87d5bb80-ad2c-4137-89f2-03bc494de37d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c330e2c1-2507-406a-b255-6e72d82c689e", "address": "fa:16:3e:1d:8b:68", "network": {"id": "6ffbd985-4f07-4813-901c-fa0af7d3588b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1064713526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc330e2c1-25", "ovs_interfaceid": "c330e2c1-2507-406a-b255-6e72d82c689e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6fba6d4e-0137-4514-9525-29e86356c1eb", "address": "fa:16:3e:87:eb:18", "network": {"id": "6ffbd985-4f07-4813-901c-fa0af7d3588b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1064713526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fba6d4e-01", "ovs_interfaceid": "6fba6d4e-0137-4514-9525-29e86356c1eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 14:45:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-15a6d4b3-b7ba-48ab-a374-a00ee80a0560 req-e5a4693a-7631-48df-876f-9c7b44429f29 service nova] Acquired lock "refresh_cache-6258dba2-2e73-45d7-99f0-9a4af065ffcc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:45:42 user nova-compute[72239]: DEBUG nova.network.neutron [req-15a6d4b3-b7ba-48ab-a374-a00ee80a0560 req-e5a4693a-7631-48df-876f-9c7b44429f29 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Refreshing network info cache for port c330e2c1-2507-406a-b255-6e72d82c689e {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:45:42 user nova-compute[72239]: INFO nova.virt.block_device [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Booting with volume aac36111-3590-450f-a7c0-5d37ab6004f4 at /dev/vdc
Jul 31 14:45:42 user nova-compute[72239]: DEBUG os_brick.utils [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:45:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[758d11fa-f5f4-4cf6-9ec8-544097d44fe6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5da8394-5e28-4f90-b44f-ea40aa03dae4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc084ae-4255-4e5a-9c2e-bb2476a5f257]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e1d090-afa6-4c44-96dd-18b1d13151fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:45:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 14:45:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:45:42 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 14:45:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf14a70-62f2-4182-bff7-82f1691fea85]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 14:45:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 14:45:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 14:45:42 user nova-compute[72239]: DEBUG os_brick.utils [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:45:42 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Updating existing volume attachment record: 22c1fd0a-696c-4b7e-9bde-ef07c15520f2 {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 14:45:42 user nova-compute[72239]: DEBUG nova.network.neutron [req-15a6d4b3-b7ba-48ab-a374-a00ee80a0560 req-e5a4693a-7631-48df-876f-9c7b44429f29 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Updated VIF entry in instance network info cache for port c330e2c1-2507-406a-b255-6e72d82c689e. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:45:42 user nova-compute[72239]: DEBUG nova.network.neutron [req-15a6d4b3-b7ba-48ab-a374-a00ee80a0560 req-e5a4693a-7631-48df-876f-9c7b44429f29 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Updating instance_info_cache with network_info: [{"id": "da58ae48-fdc4-4816-a641-525030c3beb2", "address": "fa:16:3e:9e:5d:97", "network": {"id": "245d91f7-48d7-400e-80a3-b6d5b3aae4c8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-368247279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda58ae48-fd", "ovs_interfaceid": "da58ae48-fdc4-4816-a641-525030c3beb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd", "address": "fa:16:3e:22:52:9b", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap403cc6d2-3c", "ovs_interfaceid": "403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "57f80e07-cfe0-47a5-9b99-10166cdcf351", "address": "fa:16:3e:81:bd:5b", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f80e07-cf", "ovs_interfaceid": "57f80e07-cfe0-47a5-9b99-10166cdcf351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01e36afb-4b92-42af-a2da-900e447e474e", "address": "fa:16:3e:10:e1:8d", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e36afb-4b", "ovs_interfaceid": "01e36afb-4b92-42af-a2da-900e447e474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87d5bb80-ad2c-4137-89f2-03bc494de37d", "address": "fa:16:3e:9e:00:eb", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87d5bb80-ad", "ovs_interfaceid": "87d5bb80-ad2c-4137-89f2-03bc494de37d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c330e2c1-2507-406a-b255-6e72d82c689e", "address": "fa:16:3e:1d:8b:68", "network": {"id": "6ffbd985-4f07-4813-901c-fa0af7d3588b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1064713526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc330e2c1-25", "ovs_interfaceid": "c330e2c1-2507-406a-b255-6e72d82c689e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6fba6d4e-0137-4514-9525-29e86356c1eb", "address": "fa:16:3e:87:eb:18", "network": {"id": "6ffbd985-4f07-4813-901c-fa0af7d3588b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1064713526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fba6d4e-01", "ovs_interfaceid": "6fba6d4e-0137-4514-9525-29e86356c1eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:45:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-15a6d4b3-b7ba-48ab-a374-a00ee80a0560 req-e5a4693a-7631-48df-876f-9c7b44429f29 service nova] Releasing lock "refresh_cache-6258dba2-2e73-45d7-99f0-9a4af065ffcc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:45:42 user nova-compute[72239]: DEBUG nova.compute.manager [req-15a6d4b3-b7ba-48ab-a374-a00ee80a0560 req-e5a4693a-7631-48df-876f-9c7b44429f29 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-changed-6fba6d4e-0137-4514-9525-29e86356c1eb {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:45:42 user nova-compute[72239]: DEBUG nova.compute.manager [req-15a6d4b3-b7ba-48ab-a374-a00ee80a0560 req-e5a4693a-7631-48df-876f-9c7b44429f29 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Refreshing instance network info cache due to event network-changed-6fba6d4e-0137-4514-9525-29e86356c1eb. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:45:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-15a6d4b3-b7ba-48ab-a374-a00ee80a0560 req-e5a4693a-7631-48df-876f-9c7b44429f29 service nova] Acquiring lock "refresh_cache-6258dba2-2e73-45d7-99f0-9a4af065ffcc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:45:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-15a6d4b3-b7ba-48ab-a374-a00ee80a0560 req-e5a4693a-7631-48df-876f-9c7b44429f29 service nova] Acquired lock "refresh_cache-6258dba2-2e73-45d7-99f0-9a4af065ffcc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:45:42 user nova-compute[72239]: DEBUG nova.network.neutron [req-15a6d4b3-b7ba-48ab-a374-a00ee80a0560 req-e5a4693a-7631-48df-876f-9c7b44429f29 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Refreshing network info cache for port 6fba6d4e-0137-4514-9525-29e86356c1eb {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:45:43 user nova-compute[72239]: DEBUG nova.network.neutron [req-15a6d4b3-b7ba-48ab-a374-a00ee80a0560 req-e5a4693a-7631-48df-876f-9c7b44429f29 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Updated VIF entry in instance network info cache for port 6fba6d4e-0137-4514-9525-29e86356c1eb. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:45:43 user nova-compute[72239]: DEBUG nova.network.neutron [req-15a6d4b3-b7ba-48ab-a374-a00ee80a0560 req-e5a4693a-7631-48df-876f-9c7b44429f29 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Updating instance_info_cache with network_info: [{"id": "da58ae48-fdc4-4816-a641-525030c3beb2", "address": "fa:16:3e:9e:5d:97", "network": {"id": "245d91f7-48d7-400e-80a3-b6d5b3aae4c8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-368247279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda58ae48-fd", "ovs_interfaceid": "da58ae48-fdc4-4816-a641-525030c3beb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd", "address": "fa:16:3e:22:52:9b", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap403cc6d2-3c", "ovs_interfaceid": "403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "57f80e07-cfe0-47a5-9b99-10166cdcf351", "address": "fa:16:3e:81:bd:5b", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f80e07-cf", "ovs_interfaceid": "57f80e07-cfe0-47a5-9b99-10166cdcf351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01e36afb-4b92-42af-a2da-900e447e474e", "address": "fa:16:3e:10:e1:8d", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e36afb-4b", "ovs_interfaceid": "01e36afb-4b92-42af-a2da-900e447e474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87d5bb80-ad2c-4137-89f2-03bc494de37d", "address": "fa:16:3e:9e:00:eb", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87d5bb80-ad", "ovs_interfaceid": "87d5bb80-ad2c-4137-89f2-03bc494de37d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c330e2c1-2507-406a-b255-6e72d82c689e", "address": "fa:16:3e:1d:8b:68", "network": {"id": "6ffbd985-4f07-4813-901c-fa0af7d3588b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1064713526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc330e2c1-25", "ovs_interfaceid": "c330e2c1-2507-406a-b255-6e72d82c689e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6fba6d4e-0137-4514-9525-29e86356c1eb", "address": "fa:16:3e:87:eb:18", "network": {"id": "6ffbd985-4f07-4813-901c-fa0af7d3588b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1064713526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fba6d4e-01", "ovs_interfaceid": "6fba6d4e-0137-4514-9525-29e86356c1eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:45:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-15a6d4b3-b7ba-48ab-a374-a00ee80a0560 req-e5a4693a-7631-48df-876f-9c7b44429f29 service nova] Releasing lock "refresh_cache-6258dba2-2e73-45d7-99f0-9a4af065ffcc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:45:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG nova.compute.manager [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 14:45:46 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Creating image(s)
Jul 31 14:45:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Did not create local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Ensure instance console log exists: /opt/stack/data/nova/instances/9203aeaf-2ae9-4e28-9741-05d33df6c915/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Start _get_guest_xml network_info=[{"id": "c6a37c9e-0be0-4c76-bb14-fcdb3c39061c", "address": "fa:16:3e:3e:7d:12", "network": {"id": "a5162307-ddc4-4843-a8a1-dbd8f52a9ae7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1082900222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a37c9e-0b", "ovs_interfaceid": "c6a37c9e-0be0-4c76-bb14-fcdb3c39061c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0ff36fe-c825-4781-a755-951a52252422", "address": "fa:16:3e:8f:14:75", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0ff36fe-c8", "ovs_interfaceid": "b0ff36fe-c825-4781-a755-951a52252422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8a006aee-3f68-4eb2-b214-6cf76db08ffe", "address": "fa:16:3e:01:82:d6", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a006aee-3f", "ovs_interfaceid": "8a006aee-3f68-4eb2-b214-6cf76db08ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ba2d5a24-f668-4413-abb1-c51cf2038a1c", "address": "fa:16:3e:6c:f1:44", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba2d5a24-f6", "ovs_interfaceid": "ba2d5a24-f668-4413-abb1-c51cf2038a1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c9d1f7e0-c42d-4870-9121-293f57196a09", "address": "fa:16:3e:31:22:60", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d1f7e0-c4", "ovs_interfaceid": "c9d1f7e0-c42d-4870-9121-293f57196a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb8f7d6e-9f92-4684-8867-7f8aed33a68c", "address": "fa:16:3e:f4:31:a2", "network": {"id": "a3e00fe3-9848-453f-89ef-136074c0524f", "bridge": "br-int", "label": "tempest-device-tagging-net2-758627650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb8f7d6e-9f", "ovs_interfaceid": "eb8f7d6e-9f92-4684-8867-7f8aed33a68c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0642e4d3-ade9-425b-9860-f306229034b3", "address": "fa:16:3e:d0:43:52", "network": {"id": "a3e00fe3-9848-453f-89ef-136074c0524f", "bridge": "br-int", "label": "tempest-device-tagging-net2-758627650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0642e4d3-ad", "ovs_interfaceid": "0642e4d3-ade9-425b-9860-f306229034b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'e7436cdf-0c65-4d73-a1ed-0d4c271b8b38', 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IcgDofRQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9203aeaf-2ae9-4e28-9741-05d33df6c915', 'attached_at': '', 'detached_at': '', 'volume_id': 'cb24618d-3cca-4d31-a104-7684353332d8', 'serial': 'cb24618d-3cca-4d31-a104-7684353332d8'}, 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}, {'boot_index': 1, 'attachment_id': '6e5036aa-536f-4ce8-b884-5fed310c9bff', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MxRKqpOL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9203aeaf-2ae9-4e28-9741-05d33df6c915', 'attached_at': '', 'detached_at': '', 'volume_id': '24a7c8cf-bf98-4c59-8ee1-2b371357a051', 'serial': '24a7c8cf-bf98-4c59-8ee1-2b371357a051'}, 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}, {'boot_index': 2, 'attachment_id': '9b89475d-4d7e-467f-b1b1-19b7ae4ecedc', 'device_type': 'disk', 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EfFSLqya', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9203aeaf-2ae9-4e28-9741-05d33df6c915', 'attached_at': '', 'detached_at': '', 'volume_id': 'd75c85fd-3eb9-43a3-b677-2d8b157b8406', 'serial': 'd75c85fd-3eb9-43a3-b677-2d8b157b8406'}, 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:45:46 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:45:46 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:45:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG os_brick.initiator.connector [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Factory for ISCSI on None {{(pid=72239) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IcgDofRQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:45:46 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:45:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:45:46 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:45:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:45:46 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 14:45:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8b54d9-7e94-42f8-a501-57085f5e8d06]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 14:45:46 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7230504-c4fd-4691-a280-d94f8efb03c0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8] added
Jul 31 14:45:46 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b241c188-7fab-45a2-9625-1d82f496ff95]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b302c85c-63a9-4e26-a66a-94ef6540e8c4]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IcgDofRQ {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IcgDofRQ" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5c6bb7-e55b-443d-ac49-79240784fcd3]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IcgDofRQ'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1632d144-f5d2-4082-b836-17bb8fc394d4]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[466cd5fb-14ed-4eda-a02b-65f29a47e583]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 14:45:46 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 14:45:46 user nova-compute[72239]:  {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:45:46 user nova-compute[72239]: WARNING os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 14:45:46 user nova-compute[72239]: 
Jul 31 14:45:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[07262340-8486-4e4c-beed-9e6df023e00d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8, portal: 172.16.0.220,3260]
Jul 31 14:45:46 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8, portal: 172.16.0.220,3260] successful.
Jul 31 14:45:46 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3092d195-81f9-4e8f-ba8e-05207477b643]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3716a5ba-f048-44a5-8754-116f9fdac052]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:45:46 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:45:46 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[db90a2d0-ea4f-47e2-b808-8d4ee69e0668]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:45:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IcgDofRQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 14:45:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:45:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '23762356133666636', 'path': '/dev/sdb'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:45:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762356133666636', 'path': '/dev/sdb'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 14:45:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 14:45:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MxRKqpOL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:45:47 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:45:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:45:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:45:47 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:45:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:45:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:45:47 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 14:45:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:47 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d247265b-6c4d-4bce-8dc5-8dcbad39a24c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 14:45:47 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:47 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a17c254-bd71-41fa-a466-9515ca5029c4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051] added
Jul 31 14:45:47 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:47 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c77eba0-2a7d-43fb-a958-54b8ae5e1aba]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:47 user nova-compute[72239]: DEBUG nova.compute.manager [None req-668b0cc8-4fac-4103-95cf-7bec512acfcb tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:45:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:47 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[37db1c10-f535-488b-a559-f26398502c79]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MxRKqpOL {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MxRKqpOL" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:47 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb20153-88d0-4868-a970-c007e3c00f96]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MxRKqpOL'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:47 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf77e4d0-5443-4cfe-b9b2-56ecc1d00ccc]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:47 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e7c91d-5572-493f-9598-351cf21501c8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:45:47 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:45:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:45:48 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:45:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:48 user nova-compute[72239]: INFO nova.compute.manager [None req-668b0cc8-4fac-4103-95cf-7bec512acfcb tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] instance snapshotting
Jul 31 14:45:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:48 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2e603d-f141-40b7-bbe1-82541d56f493]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051, portal: 172.16.0.220,3260]
Jul 31 14:45:48 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051, portal: 172.16.0.220,3260] successful.
Jul 31 14:45:48 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:48 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a79a96ba-78fd-4549-a5f8-7be042b421eb]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:48 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-668b0cc8-4fac-4103-95cf-7bec512acfcb tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Beginning live snapshot process
Jul 31 14:45:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:48 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cb184e-b5ef-4fd9-a0a6-3c3e5dc80545]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:45:48 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:45:48 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:45:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:45:48 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:45:48 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:45:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:45:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 14:45:48 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 14:45:48 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 14:45:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:48 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22ec554-6f6d-4e34-a437-fb288a3976ae]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:48 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:45:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MxRKqpOL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 14:45:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-668b0cc8-4fac-4103-95cf-7bec512acfcb tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json -f qcow2 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-668b0cc8-4fac-4103-95cf-7bec512acfcb tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json -f qcow2" returned: 0 in 0.137s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-668b0cc8-4fac-4103-95cf-7bec512acfcb tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json -f qcow2 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-668b0cc8-4fac-4103-95cf-7bec512acfcb tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json -f qcow2" returned: 0 in 0.131s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-668b0cc8-4fac-4103-95cf-7bec512acfcb tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-668b0cc8-4fac-4103-95cf-7bec512acfcb tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.132s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-668b0cc8-4fac-4103-95cf-7bec512acfcb tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp93wl3m1c/27594a64ff46434fb17e5d25c9bd81ba.delta 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-668b0cc8-4fac-4103-95cf-7bec512acfcb tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp93wl3m1c/27594a64ff46434fb17e5d25c9bd81ba.delta 1073741824" returned: 0 in 0.045s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:48 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-668b0cc8-4fac-4103-95cf-7bec512acfcb tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 31 14:45:48 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-668b0cc8-4fac-4103-95cf-7bec512acfcb tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Checking UEFI support for host arch (x86_64) {{(pid=72239) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Jul 31 14:45:48 user nova-compute[72239]: INFO nova.virt.libvirt.host [None req-668b0cc8-4fac-4103-95cf-7bec512acfcb tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] UEFI support detected
Jul 31 14:45:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.304s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26332323964626436', 'path': '/dev/sdc'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332323964626436', 'path': '/dev/sdc'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EfFSLqya', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:45:49 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:45:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:45:49 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:45:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:45:49 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 14:45:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc70394-4317-429b-8872-88a92084ad36]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 14:45:49 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31b6331-1f25-45b0-b831-14af91ff3fd3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406] added
Jul 31 14:45:49 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff20eb9-5e49-40ed-8b0b-a10adc2b2b4b]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6262fd78-0248-467e-891b-b3f1582294bb]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EfFSLqya {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EfFSLqya" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2ff81b-a13b-4cbb-914f-28b44cac2997]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EfFSLqya'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd39d7a9-7965-4f81-a5b0-c76cb389d4e2]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d704d1b9-0a29-4430-b50d-89f79f63a9bf]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:45:49 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:45:49 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:45:49 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:45:49 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b899f490-d696-4e54-a37a-c521eaa1fdbb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406, portal: 172.16.0.220,3260]
Jul 31 14:45:49 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406, portal: 172.16.0.220,3260] successful.
Jul 31 14:45:49 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.048s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99b3c87-a9a5-4723-a805-10ddf563845b]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-668b0cc8-4fac-4103-95cf-7bec512acfcb tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] COPY block job progress, current cursor: 327680 final cursor: 75497472 {{(pid=72239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9766ca-c8e6-42d1-8b2b-2ada1a151172]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:45:49 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:45:49 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:45:49 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:45:49 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:45:49 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:45:49 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[476f0b6e-dd03-4154-85d1-ad9591d3786c]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EfFSLqya', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 14:45:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-668b0cc8-4fac-4103-95cf-7bec512acfcb tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 14:45:49 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-668b0cc8-4fac-4103-95cf-7bec512acfcb tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.privsep.utils [None req-668b0cc8-4fac-4103-95cf-7bec512acfcb tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72239) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-668b0cc8-4fac-4103-95cf-7bec512acfcb tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp93wl3m1c/27594a64ff46434fb17e5d25c9bd81ba.delta /opt/stack/data/nova/instances/snapshots/tmp93wl3m1c/27594a64ff46434fb17e5d25c9bd81ba {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.compute.manager [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 14:45:50 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Creating image(s)
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Did not create local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Ensure instance console log exists: /opt/stack/data/nova/instances/6258dba2-2e73-45d7-99f0-9a4af065ffcc/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Start _get_guest_xml network_info=[{"id": "da58ae48-fdc4-4816-a641-525030c3beb2", "address": "fa:16:3e:9e:5d:97", "network": {"id": "245d91f7-48d7-400e-80a3-b6d5b3aae4c8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-368247279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda58ae48-fd", "ovs_interfaceid": "da58ae48-fdc4-4816-a641-525030c3beb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd", "address": "fa:16:3e:22:52:9b", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap403cc6d2-3c", "ovs_interfaceid": "403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "57f80e07-cfe0-47a5-9b99-10166cdcf351", "address": "fa:16:3e:81:bd:5b", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f80e07-cf", "ovs_interfaceid": "57f80e07-cfe0-47a5-9b99-10166cdcf351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01e36afb-4b92-42af-a2da-900e447e474e", "address": "fa:16:3e:10:e1:8d", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e36afb-4b", "ovs_interfaceid": "01e36afb-4b92-42af-a2da-900e447e474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87d5bb80-ad2c-4137-89f2-03bc494de37d", "address": "fa:16:3e:9e:00:eb", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87d5bb80-ad", "ovs_interfaceid": "87d5bb80-ad2c-4137-89f2-03bc494de37d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c330e2c1-2507-406a-b255-6e72d82c689e", "address": "fa:16:3e:1d:8b:68", "network": {"id": "6ffbd985-4f07-4813-901c-fa0af7d3588b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1064713526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc330e2c1-25", "ovs_interfaceid": "c330e2c1-2507-406a-b255-6e72d82c689e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6fba6d4e-0137-4514-9525-29e86356c1eb", "address": "fa:16:3e:87:eb:18", "network": {"id": "6ffbd985-4f07-4813-901c-fa0af7d3588b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1064713526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fba6d4e-01", "ovs_interfaceid": "6fba6d4e-0137-4514-9525-29e86356c1eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '76e84b8c-7d87-4f9f-9fbf-b2dac1388d23', 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'McwxSsyt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6258dba2-2e73-45d7-99f0-9a4af065ffcc', 'attached_at': '', 'detached_at': '', 'volume_id': '9373b07a-291c-4687-9779-41418a02fad7', 'serial': '9373b07a-291c-4687-9779-41418a02fad7'}, 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}, {'boot_index': 1, 'attachment_id': '2905a107-743d-4db7-9d6a-521bf9274843', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TVREJrtD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6258dba2-2e73-45d7-99f0-9a4af065ffcc', 'attached_at': '', 'detached_at': '', 'volume_id': 'c6970ccf-414d-409e-8c4d-cf3a5efa487a', 'serial': 'c6970ccf-414d-409e-8c4d-cf3a5efa487a'}, 'delete_on_termination': False, 'guest_format': None, 'volume_type': None}, {'boot_index': 2, 'attachment_id': '22c1fd0a-696c-4b7e-9bde-ef07c15520f2', 'device_type': 'disk', 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LlexnRAa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6258dba2-2e73-45d7-99f0-9a4af065ffcc', 'attached_at': '', 'detached_at': '', 'volume_id': 'aac36111-3590-450f-a7c0-5d37ab6004f4', 'serial': 'aac36111-3590-450f-a7c0-5d37ab6004f4'}, 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:45:50 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:45:50 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'McwxSsyt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:45:50 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:45:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-668b0cc8-4fac-4103-95cf-7bec512acfcb tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp93wl3m1c/27594a64ff46434fb17e5d25c9bd81ba.delta /opt/stack/data/nova/instances/snapshots/tmp93wl3m1c/27594a64ff46434fb17e5d25c9bd81ba" returned: 0 in 0.256s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:50 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-668b0cc8-4fac-4103-95cf-7bec512acfcb tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Snapshot extracted, beginning image upload
Jul 31 14:45:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23264653334613265', 'path': '/dev/sdd'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264653334613265', 'path': '/dev/sdd'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.244s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:45:50 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:45:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:45:50 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 14:45:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1510454801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1510454801',id=12,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj91NKpHCG6YAcTFuL1E1sIYEk6UEjzcW4uiWf7wJ4UIXs0zlsKhy6oi1xz+Wxei0QYcAxUEjMiBpf7nXPNrwTw/ni1DTL7Cx3bEOOrKrK1r6MSmIKCGfXhsl93me04jA==',key_name='tempest-keypair-1897128663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0b2f9834cbe42a68ee0db1b04d842ae',ramdisk_id='',reservation_id='r-6ineiaxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-503086043',owner_user_name='tempest-TaggedBootDevicesTest-503086043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:45:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d245935ff53452dbd98fa3c45f0c5b7',uuid=9203aeaf-2ae9-4e28-9741-05d33df6c915,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6a37c9e-0be0-4c76-bb14-fcdb3c39061c", "address": "fa:16:3e:3e:7d:12", "network": {"id": "a5162307-ddc4-4843-a8a1-dbd8f52a9ae7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1082900222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a37c9e-0b", "ovs_interfaceid": "c6a37c9e-0be0-4c76-bb14-fcdb3c39061c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converting VIF {"id": "c6a37c9e-0be0-4c76-bb14-fcdb3c39061c", "address": "fa:16:3e:3e:7d:12", "network": {"id": "a5162307-ddc4-4843-a8a1-dbd8f52a9ae7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1082900222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a37c9e-0b", "ovs_interfaceid": "c6a37c9e-0be0-4c76-bb14-fcdb3c39061c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:7d:12,bridge_name='br-int',has_traffic_filtering=True,id=c6a37c9e-0be0-4c76-bb14-fcdb3c39061c,network=Network(a5162307-ddc4-4843-a8a1-dbd8f52a9ae7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6a37c9e-0b') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1510454801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1510454801',id=12,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj91NKpHCG6YAcTFuL1E1sIYEk6UEjzcW4uiWf7wJ4UIXs0zlsKhy6oi1xz+Wxei0QYcAxUEjMiBpf7nXPNrwTw/ni1DTL7Cx3bEOOrKrK1r6MSmIKCGfXhsl93me04jA==',key_name='tempest-keypair-1897128663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0b2f9834cbe42a68ee0db1b04d842ae',ramdisk_id='',reservation_id='r-6ineiaxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-503086043',owner_user_name='tempest-TaggedBootDevicesTest-503086043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:45:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d245935ff53452dbd98fa3c45f0c5b7',uuid=9203aeaf-2ae9-4e28-9741-05d33df6c915,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0ff36fe-c825-4781-a755-951a52252422", "address": "fa:16:3e:8f:14:75", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0ff36fe-c8", "ovs_interfaceid": "b0ff36fe-c825-4781-a755-951a52252422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converting VIF {"id": "b0ff36fe-c825-4781-a755-951a52252422", "address": "fa:16:3e:8f:14:75", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0ff36fe-c8", "ovs_interfaceid": "b0ff36fe-c825-4781-a755-951a52252422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:14:75,bridge_name='br-int',has_traffic_filtering=True,id=b0ff36fe-c825-4781-a755-951a52252422,network=Network(fd06ec07-887e-47f8-9d06-277094ea6a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb0ff36fe-c8') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1510454801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1510454801',id=12,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj91NKpHCG6YAcTFuL1E1sIYEk6UEjzcW4uiWf7wJ4UIXs0zlsKhy6oi1xz+Wxei0QYcAxUEjMiBpf7nXPNrwTw/ni1DTL7Cx3bEOOrKrK1r6MSmIKCGfXhsl93me04jA==',key_name='tempest-keypair-1897128663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0b2f9834cbe42a68ee0db1b04d842ae',ramdisk_id='',reservation_id='r-6ineiaxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-503086043',owner_user_name='tempest-TaggedBootDevicesTest-503086043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:45:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d245935ff53452dbd98fa3c45f0c5b7',uuid=9203aeaf-2ae9-4e28-9741-05d33df6c915,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a006aee-3f68-4eb2-b214-6cf76db08ffe", "address": "fa:16:3e:01:82:d6", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a006aee-3f", "ovs_interfaceid": "8a006aee-3f68-4eb2-b214-6cf76db08ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converting VIF {"id": "8a006aee-3f68-4eb2-b214-6cf76db08ffe", "address": "fa:16:3e:01:82:d6", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a006aee-3f", "ovs_interfaceid": "8a006aee-3f68-4eb2-b214-6cf76db08ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:82:d6,bridge_name='br-int',has_traffic_filtering=True,id=8a006aee-3f68-4eb2-b214-6cf76db08ffe,network=Network(fd06ec07-887e-47f8-9d06-277094ea6a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8a006aee-3f') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1510454801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1510454801',id=12,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj91NKpHCG6YAcTFuL1E1sIYEk6UEjzcW4uiWf7wJ4UIXs0zlsKhy6oi1xz+Wxei0QYcAxUEjMiBpf7nXPNrwTw/ni1DTL7Cx3bEOOrKrK1r6MSmIKCGfXhsl93me04jA==',key_name='tempest-keypair-1897128663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0b2f9834cbe42a68ee0db1b04d842ae',ramdisk_id='',reservation_id='r-6ineiaxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-503086043',owner_user_name='tempest-TaggedBootDevicesTest-503086043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:45:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d245935ff53452dbd98fa3c45f0c5b7',uuid=9203aeaf-2ae9-4e28-9741-05d33df6c915,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba2d5a24-f668-4413-abb1-c51cf2038a1c", "address": "fa:16:3e:6c:f1:44", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba2d5a24-f6", "ovs_interfaceid": "ba2d5a24-f668-4413-abb1-c51cf2038a1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converting VIF {"id": "ba2d5a24-f668-4413-abb1-c51cf2038a1c", "address": "fa:16:3e:6c:f1:44", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba2d5a24-f6", "ovs_interfaceid": "ba2d5a24-f668-4413-abb1-c51cf2038a1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:f1:44,bridge_name='br-int',has_traffic_filtering=True,id=ba2d5a24-f668-4413-abb1-c51cf2038a1c,network=Network(fd06ec07-887e-47f8-9d06-277094ea6a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba2d5a24-f6') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1510454801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1510454801',id=12,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj91NKpHCG6YAcTFuL1E1sIYEk6UEjzcW4uiWf7wJ4UIXs0zlsKhy6oi1xz+Wxei0QYcAxUEjMiBpf7nXPNrwTw/ni1DTL7Cx3bEOOrKrK1r6MSmIKCGfXhsl93me04jA==',key_name='tempest-keypair-1897128663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0b2f9834cbe42a68ee0db1b04d842ae',ramdisk_id='',reservation_id='r-6ineiaxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-503086043',owner_user_name='tempest-TaggedBootDevicesTest-503086043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:45:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d245935ff53452dbd98fa3c45f0c5b7',uuid=9203aeaf-2ae9-4e28-9741-05d33df6c915,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9d1f7e0-c42d-4870-9121-293f57196a09", "address": "fa:16:3e:31:22:60", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d1f7e0-c4", "ovs_interfaceid": "c9d1f7e0-c42d-4870-9121-293f57196a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converting VIF {"id": "c9d1f7e0-c42d-4870-9121-293f57196a09", "address": "fa:16:3e:31:22:60", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d1f7e0-c4", "ovs_interfaceid": "c9d1f7e0-c42d-4870-9121-293f57196a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:22:60,bridge_name='br-int',has_traffic_filtering=True,id=c9d1f7e0-c42d-4870-9121-293f57196a09,network=Network(fd06ec07-887e-47f8-9d06-277094ea6a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9d1f7e0-c4') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1510454801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1510454801',id=12,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj91NKpHCG6YAcTFuL1E1sIYEk6UEjzcW4uiWf7wJ4UIXs0zlsKhy6oi1xz+Wxei0QYcAxUEjMiBpf7nXPNrwTw/ni1DTL7Cx3bEOOrKrK1r6MSmIKCGfXhsl93me04jA==',key_name='tempest-keypair-1897128663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0b2f9834cbe42a68ee0db1b04d842ae',ramdisk_id='',reservation_id='r-6ineiaxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-503086043',owner_user_name='tempest-TaggedBootDevicesTest-503086043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:45:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d245935ff53452dbd98fa3c45f0c5b7',uuid=9203aeaf-2ae9-4e28-9741-05d33df6c915,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb8f7d6e-9f92-4684-8867-7f8aed33a68c", "address": "fa:16:3e:f4:31:a2", "network": {"id": "a3e00fe3-9848-453f-89ef-136074c0524f", "bridge": "br-int", "label": "tempest-device-tagging-net2-758627650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb8f7d6e-9f", "ovs_interfaceid": "eb8f7d6e-9f92-4684-8867-7f8aed33a68c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converting VIF {"id": "eb8f7d6e-9f92-4684-8867-7f8aed33a68c", "address": "fa:16:3e:f4:31:a2", "network": {"id": "a3e00fe3-9848-453f-89ef-136074c0524f", "bridge": "br-int", "label": "tempest-device-tagging-net2-758627650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb8f7d6e-9f", "ovs_interfaceid": "eb8f7d6e-9f92-4684-8867-7f8aed33a68c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:31:a2,bridge_name='br-int',has_traffic_filtering=True,id=eb8f7d6e-9f92-4684-8867-7f8aed33a68c,network=Network(a3e00fe3-9848-453f-89ef-136074c0524f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb8f7d6e-9f') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1510454801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1510454801',id=12,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj91NKpHCG6YAcTFuL1E1sIYEk6UEjzcW4uiWf7wJ4UIXs0zlsKhy6oi1xz+Wxei0QYcAxUEjMiBpf7nXPNrwTw/ni1DTL7Cx3bEOOrKrK1r6MSmIKCGfXhsl93me04jA==',key_name='tempest-keypair-1897128663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0b2f9834cbe42a68ee0db1b04d842ae',ramdisk_id='',reservation_id='r-6ineiaxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-503086043',owner_user_name='tempest-TaggedBootDevicesTest-503086043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:45:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d245935ff53452dbd98fa3c45f0c5b7',uuid=9203aeaf-2ae9-4e28-9741-05d33df6c915,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0642e4d3-ade9-425b-9860-f306229034b3", "address": "fa:16:3e:d0:43:52", "network": {"id": "a3e00fe3-9848-453f-89ef-136074c0524f", "bridge": "br-int", "label": "tempest-device-tagging-net2-758627650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0642e4d3-ad", "ovs_interfaceid": "0642e4d3-ade9-425b-9860-f306229034b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converting VIF {"id": "0642e4d3-ade9-425b-9860-f306229034b3", "address": "fa:16:3e:d0:43:52", "network": {"id": "a3e00fe3-9848-453f-89ef-136074c0524f", "bridge": "br-int", "label": "tempest-device-tagging-net2-758627650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0642e4d3-ad", "ovs_interfaceid": "0642e4d3-ade9-425b-9860-f306229034b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:43:52,bridge_name='br-int',has_traffic_filtering=True,id=0642e4d3-ade9-425b-9860-f306229034b3,network=Network(a3e00fe3-9848-453f-89ef-136074c0524f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0642e4d3-ad') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.objects.instance [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Lazy-loading 'pci_devices' on Instance uuid 9203aeaf-2ae9-4e28-9741-05d33df6c915 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f44c7d-de11-4ef8-ad02-d360d7e442dd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 14:45:50 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:45:50 user nova-compute[72239]:   <uuid>9203aeaf-2ae9-4e28-9741-05d33df6c915</uuid>
Jul 31 14:45:50 user nova-compute[72239]:   <name>instance-0000000c</name>
Jul 31 14:45:50 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:45:50 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:45:50 user nova-compute[72239]:   <metadata>
Jul 31 14:45:50 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:45:50 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:45:50 user nova-compute[72239]:       <nova:name>tempest-device-tagging-server-1510454801</nova:name>
Jul 31 14:45:50 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:45:46</nova:creationTime>
Jul 31 14:45:50 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:45:50 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:45:50 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:45:50 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:45:50 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:45:50 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:45:50 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:45:50 user nova-compute[72239]:       <nova:owner>
Jul 31 14:45:50 user nova-compute[72239]:         <nova:user uuid="3d245935ff53452dbd98fa3c45f0c5b7">tempest-TaggedBootDevicesTest-503086043-project-member</nova:user>
Jul 31 14:45:50 user nova-compute[72239]:         <nova:project uuid="b0b2f9834cbe42a68ee0db1b04d842ae">tempest-TaggedBootDevicesTest-503086043</nova:project>
Jul 31 14:45:50 user nova-compute[72239]:       </nova:owner>
Jul 31 14:45:50 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:45:50 user nova-compute[72239]:       <nova:ports>
Jul 31 14:45:50 user nova-compute[72239]:         <nova:port uuid="c6a37c9e-0be0-4c76-bb14-fcdb3c39061c">
Jul 31 14:45:50 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 31 14:45:50 user nova-compute[72239]:         </nova:port>
Jul 31 14:45:50 user nova-compute[72239]:         <nova:port uuid="b0ff36fe-c825-4781-a755-951a52252422">
Jul 31 14:45:50 user nova-compute[72239]:           <nova:ip type="fixed" address="10.1.1.40" ipVersion="4"/>
Jul 31 14:45:50 user nova-compute[72239]:         </nova:port>
Jul 31 14:45:50 user nova-compute[72239]:         <nova:port uuid="8a006aee-3f68-4eb2-b214-6cf76db08ffe">
Jul 31 14:45:50 user nova-compute[72239]:           <nova:ip type="fixed" address="10.1.1.57" ipVersion="4"/>
Jul 31 14:45:50 user nova-compute[72239]:         </nova:port>
Jul 31 14:45:50 user nova-compute[72239]:         <nova:port uuid="ba2d5a24-f668-4413-abb1-c51cf2038a1c">
Jul 31 14:45:50 user nova-compute[72239]:           <nova:ip type="fixed" address="10.1.1.205" ipVersion="4"/>
Jul 31 14:45:50 user nova-compute[72239]:         </nova:port>
Jul 31 14:45:50 user nova-compute[72239]:         <nova:port uuid="c9d1f7e0-c42d-4870-9121-293f57196a09">
Jul 31 14:45:50 user nova-compute[72239]:           <nova:ip type="fixed" address="10.1.1.126" ipVersion="4"/>
Jul 31 14:45:50 user nova-compute[72239]:         </nova:port>
Jul 31 14:45:50 user nova-compute[72239]:         <nova:port uuid="eb8f7d6e-9f92-4684-8867-7f8aed33a68c">
Jul 31 14:45:50 user nova-compute[72239]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jul 31 14:45:50 user nova-compute[72239]:         </nova:port>
Jul 31 14:45:50 user nova-compute[72239]:         <nova:port uuid="0642e4d3-ade9-425b-9860-f306229034b3">
Jul 31 14:45:50 user nova-compute[72239]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jul 31 14:45:50 user nova-compute[72239]:         </nova:port>
Jul 31 14:45:50 user nova-compute[72239]:       </nova:ports>
Jul 31 14:45:50 user nova-compute[72239]:     </nova:instance>
Jul 31 14:45:50 user nova-compute[72239]:   </metadata>
Jul 31 14:45:50 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:45:50 user nova-compute[72239]:     <system>
Jul 31 14:45:50 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:45:50 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:45:50 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:45:50 user nova-compute[72239]:       <entry name="serial">9203aeaf-2ae9-4e28-9741-05d33df6c915</entry>
Jul 31 14:45:50 user nova-compute[72239]:       <entry name="uuid">9203aeaf-2ae9-4e28-9741-05d33df6c915</entry>
Jul 31 14:45:50 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:45:50 user nova-compute[72239]:     </system>
Jul 31 14:45:50 user nova-compute[72239]:   </sysinfo>
Jul 31 14:45:50 user nova-compute[72239]:   <os>
Jul 31 14:45:50 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:45:50 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:45:50 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:45:50 user nova-compute[72239]:   </os>
Jul 31 14:45:50 user nova-compute[72239]:   <features>
Jul 31 14:45:50 user nova-compute[72239]:     <acpi/>
Jul 31 14:45:50 user nova-compute[72239]:     <apic/>
Jul 31 14:45:50 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:45:50 user nova-compute[72239]:   </features>
Jul 31 14:45:50 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:45:50 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:45:50 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:45:50 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:45:50 user nova-compute[72239]:   </clock>
Jul 31 14:45:50 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:45:50 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:45:50 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:45:50 user nova-compute[72239]:   </cpu>
Jul 31 14:45:50 user nova-compute[72239]:   <devices>
Jul 31 14:45:50 user nova-compute[72239]:     <disk type="file" device="cdrom">
Jul 31 14:45:50 user nova-compute[72239]:       <driver name="qemu" type="raw" cache="none"/>
Jul 31 14:45:50 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/9203aeaf-2ae9-4e28-9741-05d33df6c915/disk.config"/>
Jul 31 14:45:50 user nova-compute[72239]:       <target dev="hda" bus="ide"/>
Jul 31 14:45:50 user nova-compute[72239]:     </disk>
Jul 31 14:45:50 user nova-compute[72239]:     <disk type="block" device="disk">
Jul 31 14:45:50 user nova-compute[72239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:45:50 user nova-compute[72239]:       <source dev="/dev/sdb"/>
Jul 31 14:45:50 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:45:50 user nova-compute[72239]:       <serial>cb24618d-3cca-4d31-a104-7684353332d8</serial>
Jul 31 14:45:50 user nova-compute[72239]:     </disk>
Jul 31 14:45:50 user nova-compute[72239]:     <disk type="block" device="disk">
Jul 31 14:45:50 user nova-compute[72239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:45:50 user nova-compute[72239]:       <source dev="/dev/sdc"/>
Jul 31 14:45:50 user nova-compute[72239]:       <target dev="vdb" bus="virtio"/>
Jul 31 14:45:50 user nova-compute[72239]:       <serial>24a7c8cf-bf98-4c59-8ee1-2b371357a051</serial>
Jul 31 14:45:50 user nova-compute[72239]:     </disk>
Jul 31 14:45:50 user nova-compute[72239]:     <disk type="block" device="disk">
Jul 31 14:45:50 user nova-compute[72239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:45:50 user nova-compute[72239]:       <source dev="/dev/sdd"/>
Jul 31 14:45:50 user nova-compute[72239]:       <target dev="vdc" bus="virtio"/>
Jul 31 14:45:50 user nova-compute[72239]:       <serial>d75c85fd-3eb9-43a3-b677-2d8b157b8406</serial>
Jul 31 14:45:50 user nova-compute[72239]:     </disk>
Jul 31 14:45:50 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:45:50 user nova-compute[72239]:       <mac address="fa:16:3e:3e:7d:12"/>
Jul 31 14:45:50 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:45:50 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:45:50 user nova-compute[72239]:       <target dev="tapc6a37c9e-0b"/>
Jul 31 14:45:50 user nova-compute[72239]:     </interface>
Jul 31 14:45:50 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:45:50 user nova-compute[72239]:       <mac address="fa:16:3e:8f:14:75"/>
Jul 31 14:45:50 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:45:50 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:45:50 user nova-compute[72239]:       <target dev="tapb0ff36fe-c8"/>
Jul 31 14:45:50 user nova-compute[72239]:     </interface>
Jul 31 14:45:50 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:45:50 user nova-compute[72239]:       <mac address="fa:16:3e:01:82:d6"/>
Jul 31 14:45:50 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:45:50 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:45:50 user nova-compute[72239]:       <target dev="tap8a006aee-3f"/>
Jul 31 14:45:50 user nova-compute[72239]:     </interface>
Jul 31 14:45:50 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:45:50 user nova-compute[72239]:       <mac address="fa:16:3e:6c:f1:44"/>
Jul 31 14:45:50 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:45:50 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:45:50 user nova-compute[72239]:       <target dev="tapba2d5a24-f6"/>
Jul 31 14:45:50 user nova-compute[72239]:     </interface>
Jul 31 14:45:50 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:45:50 user nova-compute[72239]:       <mac address="fa:16:3e:31:22:60"/>
Jul 31 14:45:50 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:45:50 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:45:50 user nova-compute[72239]:       <target dev="tapc9d1f7e0-c4"/>
Jul 31 14:45:50 user nova-compute[72239]:     </interface>
Jul 31 14:45:50 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:45:50 user nova-compute[72239]:       <mac address="fa:16:3e:f4:31:a2"/>
Jul 31 14:45:50 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:45:50 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:45:50 user nova-compute[72239]:       <target dev="tapeb8f7d6e-9f"/>
Jul 31 14:45:50 user nova-compute[72239]:     </interface>
Jul 31 14:45:50 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:45:50 user nova-compute[72239]:       <mac address="fa:16:3e:d0:43:52"/>
Jul 31 14:45:50 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:45:50 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:45:50 user nova-compute[72239]:       <target dev="tap0642e4d3-ad"/>
Jul 31 14:45:50 user nova-compute[72239]:     </interface>
Jul 31 14:45:50 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:45:50 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/9203aeaf-2ae9-4e28-9741-05d33df6c915/console.log" append="off"/>
Jul 31 14:45:50 user nova-compute[72239]:     </serial>
Jul 31 14:45:50 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:45:50 user nova-compute[72239]:     <video>
Jul 31 14:45:50 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:45:50 user nova-compute[72239]:     </video>
Jul 31 14:45:50 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:45:50 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:45:50 user nova-compute[72239]:     </rng>
Jul 31 14:45:50 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:45:50 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:45:50 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:45:50 user nova-compute[72239]:     </memballoon>
Jul 31 14:45:50 user nova-compute[72239]:   </devices>
Jul 31 14:45:50 user nova-compute[72239]: </domain>
Jul 31 14:45:50 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1510454801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1510454801',id=12,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj91NKpHCG6YAcTFuL1E1sIYEk6UEjzcW4uiWf7wJ4UIXs0zlsKhy6oi1xz+Wxei0QYcAxUEjMiBpf7nXPNrwTw/ni1DTL7Cx3bEOOrKrK1r6MSmIKCGfXhsl93me04jA==',key_name='tempest-keypair-1897128663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0b2f9834cbe42a68ee0db1b04d842ae',ramdisk_id='',reservation_id='r-6ineiaxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-503086043',owner_user_name='tempest-TaggedBootDevicesTest-503086043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:45:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d245935ff53452dbd98fa3c45f0c5b7',uuid=9203aeaf-2ae9-4e28-9741-05d33df6c915,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6a37c9e-0be0-4c76-bb14-fcdb3c39061c", "address": "fa:16:3e:3e:7d:12", "network": {"id": "a5162307-ddc4-4843-a8a1-dbd8f52a9ae7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1082900222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a37c9e-0b", "ovs_interfaceid": "c6a37c9e-0be0-4c76-bb14-fcdb3c39061c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converting VIF {"id": "c6a37c9e-0be0-4c76-bb14-fcdb3c39061c", "address": "fa:16:3e:3e:7d:12", "network": {"id": "a5162307-ddc4-4843-a8a1-dbd8f52a9ae7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1082900222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a37c9e-0b", "ovs_interfaceid": "c6a37c9e-0be0-4c76-bb14-fcdb3c39061c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:7d:12,bridge_name='br-int',has_traffic_filtering=True,id=c6a37c9e-0be0-4c76-bb14-fcdb3c39061c,network=Network(a5162307-ddc4-4843-a8a1-dbd8f52a9ae7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6a37c9e-0b') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG os_vif [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:7d:12,bridge_name='br-int',has_traffic_filtering=True,id=c6a37c9e-0be0-4c76-bb14-fcdb3c39061c,network=Network(a5162307-ddc4-4843-a8a1-dbd8f52a9ae7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6a37c9e-0b') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc6a37c9e-0b, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc6a37c9e-0b, col_values=(('external_ids', {'iface-id': 'c6a37c9e-0be0-4c76-bb14-fcdb3c39061c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:7d:12', 'vm-uuid': '9203aeaf-2ae9-4e28-9741-05d33df6c915'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ba2168-61e6-439e-9df2-5c328a53219a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7] added
Jul 31 14:45:50 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:50 user nova-compute[72239]: INFO os_vif [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:7d:12,bridge_name='br-int',has_traffic_filtering=True,id=c6a37c9e-0be0-4c76-bb14-fcdb3c39061c,network=Network(a5162307-ddc4-4843-a8a1-dbd8f52a9ae7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6a37c9e-0b')
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1510454801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1510454801',id=12,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj91NKpHCG6YAcTFuL1E1sIYEk6UEjzcW4uiWf7wJ4UIXs0zlsKhy6oi1xz+Wxei0QYcAxUEjMiBpf7nXPNrwTw/ni1DTL7Cx3bEOOrKrK1r6MSmIKCGfXhsl93me04jA==',key_name='tempest-keypair-1897128663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0b2f9834cbe42a68ee0db1b04d842ae',ramdisk_id='',reservation_id='r-6ineiaxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-503086043',owner_user_name='tempest-TaggedBootDevicesTest-503086043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:45:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d245935ff53452dbd98fa3c45f0c5b7',uuid=9203aeaf-2ae9-4e28-9741-05d33df6c915,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b0ff36fe-c825-4781-a755-951a52252422", "address": "fa:16:3e:8f:14:75", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0ff36fe-c8", "ovs_interfaceid": "b0ff36fe-c825-4781-a755-951a52252422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converting VIF {"id": "b0ff36fe-c825-4781-a755-951a52252422", "address": "fa:16:3e:8f:14:75", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0ff36fe-c8", "ovs_interfaceid": "b0ff36fe-c825-4781-a755-951a52252422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:14:75,bridge_name='br-int',has_traffic_filtering=True,id=b0ff36fe-c825-4781-a755-951a52252422,network=Network(fd06ec07-887e-47f8-9d06-277094ea6a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb0ff36fe-c8') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG os_vif [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:14:75,bridge_name='br-int',has_traffic_filtering=True,id=b0ff36fe-c825-4781-a755-951a52252422,network=Network(fd06ec07-887e-47f8-9d06-277094ea6a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb0ff36fe-c8') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb0ff36fe-c8, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb0ff36fe-c8, col_values=(('external_ids', {'iface-id': 'b0ff36fe-c825-4781-a755-951a52252422', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:14:75', 'vm-uuid': '9203aeaf-2ae9-4e28-9741-05d33df6c915'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8612accc-d6d7-466e-8537-405d70a0d6ce]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:50 user nova-compute[72239]: INFO os_vif [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:14:75,bridge_name='br-int',has_traffic_filtering=True,id=b0ff36fe-c825-4781-a755-951a52252422,network=Network(fd06ec07-887e-47f8-9d06-277094ea6a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb0ff36fe-c8')
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1510454801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1510454801',id=12,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj91NKpHCG6YAcTFuL1E1sIYEk6UEjzcW4uiWf7wJ4UIXs0zlsKhy6oi1xz+Wxei0QYcAxUEjMiBpf7nXPNrwTw/ni1DTL7Cx3bEOOrKrK1r6MSmIKCGfXhsl93me04jA==',key_name='tempest-keypair-1897128663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0b2f9834cbe42a68ee0db1b04d842ae',ramdisk_id='',reservation_id='r-6ineiaxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-503086043',owner_user_name='tempest-TaggedBootDevicesTest-503086043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:45:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d245935ff53452dbd98fa3c45f0c5b7',uuid=9203aeaf-2ae9-4e28-9741-05d33df6c915,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a006aee-3f68-4eb2-b214-6cf76db08ffe", "address": "fa:16:3e:01:82:d6", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a006aee-3f", "ovs_interfaceid": "8a006aee-3f68-4eb2-b214-6cf76db08ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converting VIF {"id": "8a006aee-3f68-4eb2-b214-6cf76db08ffe", "address": "fa:16:3e:01:82:d6", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a006aee-3f", "ovs_interfaceid": "8a006aee-3f68-4eb2-b214-6cf76db08ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:82:d6,bridge_name='br-int',has_traffic_filtering=True,id=8a006aee-3f68-4eb2-b214-6cf76db08ffe,network=Network(fd06ec07-887e-47f8-9d06-277094ea6a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8a006aee-3f') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG os_vif [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:82:d6,bridge_name='br-int',has_traffic_filtering=True,id=8a006aee-3f68-4eb2-b214-6cf76db08ffe,network=Network(fd06ec07-887e-47f8-9d06-277094ea6a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8a006aee-3f') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[203f83ad-eb44-49ab-8ed6-27a19957a2d5]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v McwxSsyt {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a006aee-3f, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8a006aee-3f, col_values=(('external_ids', {'iface-id': '8a006aee-3f68-4eb2-b214-6cf76db08ffe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:82:d6', 'vm-uuid': '9203aeaf-2ae9-4e28-9741-05d33df6c915'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v McwxSsyt" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[747f9d76-b0c0-4f11-93b3-c1409c0d752e]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'McwxSsyt'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:50 user nova-compute[72239]: INFO os_vif [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:82:d6,bridge_name='br-int',has_traffic_filtering=True,id=8a006aee-3f68-4eb2-b214-6cf76db08ffe,network=Network(fd06ec07-887e-47f8-9d06-277094ea6a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8a006aee-3f')
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1510454801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1510454801',id=12,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj91NKpHCG6YAcTFuL1E1sIYEk6UEjzcW4uiWf7wJ4UIXs0zlsKhy6oi1xz+Wxei0QYcAxUEjMiBpf7nXPNrwTw/ni1DTL7Cx3bEOOrKrK1r6MSmIKCGfXhsl93me04jA==',key_name='tempest-keypair-1897128663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0b2f9834cbe42a68ee0db1b04d842ae',ramdisk_id='',reservation_id='r-6ineiaxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-503086043',owner_user_name='tempest-TaggedBootDevicesTest-503086043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:45:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d245935ff53452dbd98fa3c45f0c5b7',uuid=9203aeaf-2ae9-4e28-9741-05d33df6c915,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba2d5a24-f668-4413-abb1-c51cf2038a1c", "address": "fa:16:3e:6c:f1:44", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba2d5a24-f6", "ovs_interfaceid": "ba2d5a24-f668-4413-abb1-c51cf2038a1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converting VIF {"id": "ba2d5a24-f668-4413-abb1-c51cf2038a1c", "address": "fa:16:3e:6c:f1:44", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba2d5a24-f6", "ovs_interfaceid": "ba2d5a24-f668-4413-abb1-c51cf2038a1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:f1:44,bridge_name='br-int',has_traffic_filtering=True,id=ba2d5a24-f668-4413-abb1-c51cf2038a1c,network=Network(fd06ec07-887e-47f8-9d06-277094ea6a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba2d5a24-f6') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG os_vif [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:f1:44,bridge_name='br-int',has_traffic_filtering=True,id=ba2d5a24-f668-4413-abb1-c51cf2038a1c,network=Network(fd06ec07-887e-47f8-9d06-277094ea6a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba2d5a24-f6') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fbe469-3dee-402d-a82e-c4a81fbea1a9]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba2d5a24-f6, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapba2d5a24-f6, col_values=(('external_ids', {'iface-id': 'ba2d5a24-f668-4413-abb1-c51cf2038a1c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6c:f1:44', 'vm-uuid': '9203aeaf-2ae9-4e28-9741-05d33df6c915'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1351df4-5367-425d-ad44-e440ccbbc758]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:45:50 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:45:50 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:45:50 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:45:50 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:45:50 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:45:50 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:50 user nova-compute[72239]: INFO os_vif [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:f1:44,bridge_name='br-int',has_traffic_filtering=True,id=ba2d5a24-f668-4413-abb1-c51cf2038a1c,network=Network(fd06ec07-887e-47f8-9d06-277094ea6a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba2d5a24-f6')
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1510454801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1510454801',id=12,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj91NKpHCG6YAcTFuL1E1sIYEk6UEjzcW4uiWf7wJ4UIXs0zlsKhy6oi1xz+Wxei0QYcAxUEjMiBpf7nXPNrwTw/ni1DTL7Cx3bEOOrKrK1r6MSmIKCGfXhsl93me04jA==',key_name='tempest-keypair-1897128663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0b2f9834cbe42a68ee0db1b04d842ae',ramdisk_id='',reservation_id='r-6ineiaxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-503086043',owner_user_name='tempest-TaggedBootDevicesTest-503086043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:45:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d245935ff53452dbd98fa3c45f0c5b7',uuid=9203aeaf-2ae9-4e28-9741-05d33df6c915,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9d1f7e0-c42d-4870-9121-293f57196a09", "address": "fa:16:3e:31:22:60", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d1f7e0-c4", "ovs_interfaceid": "c9d1f7e0-c42d-4870-9121-293f57196a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converting VIF {"id": "c9d1f7e0-c42d-4870-9121-293f57196a09", "address": "fa:16:3e:31:22:60", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d1f7e0-c4", "ovs_interfaceid": "c9d1f7e0-c42d-4870-9121-293f57196a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:22:60,bridge_name='br-int',has_traffic_filtering=True,id=c9d1f7e0-c42d-4870-9121-293f57196a09,network=Network(fd06ec07-887e-47f8-9d06-277094ea6a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9d1f7e0-c4') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG os_vif [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:22:60,bridge_name='br-int',has_traffic_filtering=True,id=c9d1f7e0-c42d-4870-9121-293f57196a09,network=Network(fd06ec07-887e-47f8-9d06-277094ea6a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9d1f7e0-c4') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9d1f7e0-c4, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc9d1f7e0-c4, col_values=(('external_ids', {'iface-id': 'c9d1f7e0-c42d-4870-9121-293f57196a09', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:22:60', 'vm-uuid': '9203aeaf-2ae9-4e28-9741-05d33df6c915'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[79496ffc-12b8-4831-a6e7-1f4ac9c949b9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7, portal: 172.16.0.220,3260]
Jul 31 14:45:50 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7, portal: 172.16.0.220,3260] successful.
Jul 31 14:45:50 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:50 user nova-compute[72239]: INFO os_vif [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:22:60,bridge_name='br-int',has_traffic_filtering=True,id=c9d1f7e0-c42d-4870-9121-293f57196a09,network=Network(fd06ec07-887e-47f8-9d06-277094ea6a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9d1f7e0-c4')
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1510454801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1510454801',id=12,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj91NKpHCG6YAcTFuL1E1sIYEk6UEjzcW4uiWf7wJ4UIXs0zlsKhy6oi1xz+Wxei0QYcAxUEjMiBpf7nXPNrwTw/ni1DTL7Cx3bEOOrKrK1r6MSmIKCGfXhsl93me04jA==',key_name='tempest-keypair-1897128663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0b2f9834cbe42a68ee0db1b04d842ae',ramdisk_id='',reservation_id='r-6ineiaxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-503086043',owner_user_name='tempest-TaggedBootDevicesTest-503086043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:45:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d245935ff53452dbd98fa3c45f0c5b7',uuid=9203aeaf-2ae9-4e28-9741-05d33df6c915,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eb8f7d6e-9f92-4684-8867-7f8aed33a68c", "address": "fa:16:3e:f4:31:a2", "network": {"id": "a3e00fe3-9848-453f-89ef-136074c0524f", "bridge": "br-int", "label": "tempest-device-tagging-net2-758627650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb8f7d6e-9f", "ovs_interfaceid": "eb8f7d6e-9f92-4684-8867-7f8aed33a68c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converting VIF {"id": "eb8f7d6e-9f92-4684-8867-7f8aed33a68c", "address": "fa:16:3e:f4:31:a2", "network": {"id": "a3e00fe3-9848-453f-89ef-136074c0524f", "bridge": "br-int", "label": "tempest-device-tagging-net2-758627650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb8f7d6e-9f", "ovs_interfaceid": "eb8f7d6e-9f92-4684-8867-7f8aed33a68c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:31:a2,bridge_name='br-int',has_traffic_filtering=True,id=eb8f7d6e-9f92-4684-8867-7f8aed33a68c,network=Network(a3e00fe3-9848-453f-89ef-136074c0524f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb8f7d6e-9f') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG os_vif [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:31:a2,bridge_name='br-int',has_traffic_filtering=True,id=eb8f7d6e-9f92-4684-8867-7f8aed33a68c,network=Network(a3e00fe3-9848-453f-89ef-136074c0524f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb8f7d6e-9f') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21076bf-e58b-47c7-b0c6-7a3fd649ec96]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb8f7d6e-9f, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeb8f7d6e-9f, col_values=(('external_ids', {'iface-id': 'eb8f7d6e-9f92-4684-8867-7f8aed33a68c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:31:a2', 'vm-uuid': '9203aeaf-2ae9-4e28-9741-05d33df6c915'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd889110-85d7-4c9b-954e-67a7adf5d06a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:45:50 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:45:50 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:45:50 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:45:50 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:45:50 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:45:50 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:45:50 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:45:50 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c776d0c0-1bce-4d32-8095-ae3165459f29]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'McwxSsyt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:50 user nova-compute[72239]: INFO os_vif [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:31:a2,bridge_name='br-int',has_traffic_filtering=True,id=eb8f7d6e-9f92-4684-8867-7f8aed33a68c,network=Network(a3e00fe3-9848-453f-89ef-136074c0524f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb8f7d6e-9f')
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1510454801',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1510454801',id=12,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj91NKpHCG6YAcTFuL1E1sIYEk6UEjzcW4uiWf7wJ4UIXs0zlsKhy6oi1xz+Wxei0QYcAxUEjMiBpf7nXPNrwTw/ni1DTL7Cx3bEOOrKrK1r6MSmIKCGfXhsl93me04jA==',key_name='tempest-keypair-1897128663',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0b2f9834cbe42a68ee0db1b04d842ae',ramdisk_id='',reservation_id='r-6ineiaxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-503086043',owner_user_name='tempest-TaggedBootDevicesTest-503086043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:45:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d245935ff53452dbd98fa3c45f0c5b7',uuid=9203aeaf-2ae9-4e28-9741-05d33df6c915,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0642e4d3-ade9-425b-9860-f306229034b3", "address": "fa:16:3e:d0:43:52", "network": {"id": "a3e00fe3-9848-453f-89ef-136074c0524f", "bridge": "br-int", "label": "tempest-device-tagging-net2-758627650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0642e4d3-ad", "ovs_interfaceid": "0642e4d3-ade9-425b-9860-f306229034b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converting VIF {"id": "0642e4d3-ade9-425b-9860-f306229034b3", "address": "fa:16:3e:d0:43:52", "network": {"id": "a3e00fe3-9848-453f-89ef-136074c0524f", "bridge": "br-int", "label": "tempest-device-tagging-net2-758627650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0642e4d3-ad", "ovs_interfaceid": "0642e4d3-ade9-425b-9860-f306229034b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:43:52,bridge_name='br-int',has_traffic_filtering=True,id=0642e4d3-ade9-425b-9860-f306229034b3,network=Network(a3e00fe3-9848-453f-89ef-136074c0524f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0642e4d3-ad') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG os_vif [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:43:52,bridge_name='br-int',has_traffic_filtering=True,id=0642e4d3-ade9-425b-9860-f306229034b3,network=Network(a3e00fe3-9848-453f-89ef-136074c0524f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0642e4d3-ad') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0642e4d3-ad, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0642e4d3-ad, col_values=(('external_ids', {'iface-id': '0642e4d3-ade9-425b-9860-f306229034b3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:43:52', 'vm-uuid': '9203aeaf-2ae9-4e28-9741-05d33df6c915'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:45:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:50 user nova-compute[72239]: INFO os_vif [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:43:52,bridge_name='br-int',has_traffic_filtering=True,id=0642e4d3-ade9-425b-9860-f306229034b3,network=Network(a3e00fe3-9848-453f-89ef-136074c0524f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0642e4d3-ad')
Jul 31 14:45:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] No BDM found with device name hda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:45:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:45:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] No VIF found with MAC fa:16:3e:3e:7d:12, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:45:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] No VIF found with MAC fa:16:3e:31:22:60, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:45:51 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Using config drive
Jul 31 14:45:51 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Creating config drive at /opt/stack/data/nova/instances/9203aeaf-2ae9-4e28-9741-05d33df6c915/disk.config
Jul 31 14:45:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/9203aeaf-2ae9-4e28-9741-05d33df6c915/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpork1y6wu {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/9203aeaf-2ae9-4e28-9741-05d33df6c915/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpork1y6wu" returned: 0 in 0.057s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:51 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:45:51 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] <== connect_volume: return (1627ms) {'type': 'block', 'scsi_wwn': '26464363732663536', 'path': '/dev/sde'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:45:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464363732663536', 'path': '/dev/sde'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 14:45:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 14:45:51 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TVREJrtD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:45:51 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:45:51 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:45:51 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:45:51 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:45:51 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:45:51 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:45:51 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 14:45:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ac0c56-c985-4ff5-9212-fe37d0ecb16d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 14:45:52 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[120edaff-0a52-4a2c-91df-326c923d21f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a] added
Jul 31 14:45:52 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[06786737-4111-439d-a757-24e2be3a0c01]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a188c89-36ce-45f5-985b-e901169c3824]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TVREJrtD {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TVREJrtD" returned: 0 in 0.034s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[328f8193-4122-4712-8496-a58e4b4bdf7f]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TVREJrtD'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.100s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[12cb0b29-d458-47f4-b6a1-ad2d385d7d4d]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a82969-cee5-497c-9add-c1e25ae09923]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:45:52 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:45:52 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:45:52 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:45:52 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:45:52 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:45:52 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:45:52 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:45:52 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a -p 172.16.0.220:3260 --login" returned: 0 in 0.314s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e5f3bf-2274-4b33-b5fc-11b334ef255c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a, portal: 172.16.0.220,3260]
Jul 31 14:45:52 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a, portal: 172.16.0.220,3260] successful.
Jul 31 14:45:52 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9c184b-ed3f-4aee-93b1-83e236bab6bd]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5069bb5c-5d5b-488a-b993-78c7198af596]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:45:52 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:45:52 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:45:52 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:45:52 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:45:52 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:45:52 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:45:52 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:45:52 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:45:52 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:45:52 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.907s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b332b938-044e-4e0e-a57e-934bdca38ffd]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: None {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:45:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:52 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-668b0cc8-4fac-4103-95cf-7bec512acfcb tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Snapshot image upload complete
Jul 31 14:45:52 user nova-compute[72239]: INFO nova.compute.manager [None req-668b0cc8-4fac-4103-95cf-7bec512acfcb tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Took 4.96 seconds to snapshot the instance on the hypervisor.
Jul 31 14:45:53 user nova-compute[72239]: DEBUG nova.compute.manager [req-edfd020a-6b28-4e54-b0cc-ad453afee888 req-c69690d5-c1d5-4c5e-a58d-a0f37a7a3fe1 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-vif-plugged-c6a37c9e-0be0-4c76-bb14-fcdb3c39061c {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-edfd020a-6b28-4e54-b0cc-ad453afee888 req-c69690d5-c1d5-4c5e-a58d-a0f37a7a3fe1 service nova] Acquiring lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-edfd020a-6b28-4e54-b0cc-ad453afee888 req-c69690d5-c1d5-4c5e-a58d-a0f37a7a3fe1 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-edfd020a-6b28-4e54-b0cc-ad453afee888 req-c69690d5-c1d5-4c5e-a58d-a0f37a7a3fe1 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG nova.compute.manager [req-edfd020a-6b28-4e54-b0cc-ad453afee888 req-c69690d5-c1d5-4c5e-a58d-a0f37a7a3fe1 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] No waiting events found dispatching network-vif-plugged-c6a37c9e-0be0-4c76-bb14-fcdb3c39061c {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:45:53 user nova-compute[72239]: WARNING nova.compute.manager [req-edfd020a-6b28-4e54-b0cc-ad453afee888 req-c69690d5-c1d5-4c5e-a58d-a0f37a7a3fe1 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received unexpected event network-vif-plugged-c6a37c9e-0be0-4c76-bb14-fcdb3c39061c for instance with vm_state building and task_state spawning.
Jul 31 14:45:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Acquiring lock "6716534f-ae47-4b7d-bfd8-10f94ea8a182" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Lock "6716534f-ae47-4b7d-bfd8-10f94ea8a182" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG nova.objects.instance [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Lazy-loading 'flavor' on Instance uuid 6716534f-ae47-4b7d-bfd8-10f94ea8a182 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Lock "6716534f-ae47-4b7d-bfd8-10f94ea8a182" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.095s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Acquiring lock "6716534f-ae47-4b7d-bfd8-10f94ea8a182" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Lock "6716534f-ae47-4b7d-bfd8-10f94ea8a182" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:45:53 user nova-compute[72239]: INFO nova.compute.manager [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Attaching volume 216c5321-d877-48e1-9b2d-bfe47ab51700 to /dev/vdb
Jul 31 14:45:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG os_brick.utils [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bdd2be-71a0-4400-8ecb-55cfe0df49a9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed5195b-48b3-4cb3-a71a-a59264d50054]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc00d8b0-3fe8-4760-b0e6-16c5be0319e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed3e4a0-ea33-440c-a0bf-fc12e6b948dd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:45:53 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 14:45:53 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b77c16-c98f-4b59-b866-eaed083ce875]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG os_brick.utils [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Updating existing volume attachment record: 89f8c5f5-338a-486a-a087-b3bc234a2688 {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TVREJrtD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.946s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] <== connect_volume: return (1947ms) {'type': 'block', 'scsi_wwn': '26539656336333432', 'path': '/dev/sdf'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539656336333432', 'path': '/dev/sdf'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG nova.compute.manager [req-8f49e7e8-dc2a-498f-b149-9294ea6522fc req-de1e2b74-647c-4f57-9a78-050179dcf494 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-vif-plugged-8a006aee-3f68-4eb2-b214-6cf76db08ffe {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-8f49e7e8-dc2a-498f-b149-9294ea6522fc req-de1e2b74-647c-4f57-9a78-050179dcf494 service nova] Acquiring lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-8f49e7e8-dc2a-498f-b149-9294ea6522fc req-de1e2b74-647c-4f57-9a78-050179dcf494 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-8f49e7e8-dc2a-498f-b149-9294ea6522fc req-de1e2b74-647c-4f57-9a78-050179dcf494 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG nova.compute.manager [req-8f49e7e8-dc2a-498f-b149-9294ea6522fc req-de1e2b74-647c-4f57-9a78-050179dcf494 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] No waiting events found dispatching network-vif-plugged-8a006aee-3f68-4eb2-b214-6cf76db08ffe {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:45:53 user nova-compute[72239]: WARNING nova.compute.manager [req-8f49e7e8-dc2a-498f-b149-9294ea6522fc req-de1e2b74-647c-4f57-9a78-050179dcf494 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received unexpected event network-vif-plugged-8a006aee-3f68-4eb2-b214-6cf76db08ffe for instance with vm_state building and task_state spawning.
Jul 31 14:45:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 14:45:53 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LlexnRAa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:45:54 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:45:54 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:45:54 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:45:54 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:45:54 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 14:45:54 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e43bcec-95a5-4c60-919c-55babd261c83]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 14:45:54 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b088c9-0562-46f2-a093-ed5dc88df110]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4] added
Jul 31 14:45:54 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[700877ea-4d41-43ea-b01a-18d25847a142]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bdac15f-6f5c-4462-bdc7-a3f06d472562]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LlexnRAa {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LlexnRAa" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4382b2e-fbf3-487a-a732-977f438a4cde]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LlexnRAa'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[790e11ff-bf2e-44d9-a484-8c17d3dfc129]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[778620bd-92c6-4e5e-8a38-1a618e3b5601]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:45:54 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:45:54 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:45:54 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:45:54 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:45:54 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:45:54 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:45:54 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:45:54 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:45:54 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:45:54 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba0009b-53a6-4275-84c4-30ecc8a4fccd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4, portal: 172.16.0.220,3260]
Jul 31 14:45:54 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4, portal: 172.16.0.220,3260] successful.
Jul 31 14:45:54 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3606d9a-002e-4c44-a543-7e21466e8f99]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb05f7b2-2ea6-42ab-a71f-0a90d4ac96df]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:45:54 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:45:54 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:45:54 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:45:54 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:45:54 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:45:54 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:45:54 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:45:54 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:45:54 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:45:54 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:45:54 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:45:54 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.356s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] HCTL ('38', '-', '-', 0) found on session 7 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d86c7b3-773c-4576-a407-afeb07e3a2bc]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Searching for a device in session 7 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LlexnRAa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.compute.manager [req-1637aa58-e2d8-41df-9b69-cbcb799cad21 req-fe0a4884-142c-4555-b4e2-fdb989a533e4 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-vif-plugged-c6a37c9e-0be0-4c76-bb14-fcdb3c39061c {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-1637aa58-e2d8-41df-9b69-cbcb799cad21 req-fe0a4884-142c-4555-b4e2-fdb989a533e4 service nova] Acquiring lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-1637aa58-e2d8-41df-9b69-cbcb799cad21 req-fe0a4884-142c-4555-b4e2-fdb989a533e4 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-1637aa58-e2d8-41df-9b69-cbcb799cad21 req-fe0a4884-142c-4555-b4e2-fdb989a533e4 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.compute.manager [req-1637aa58-e2d8-41df-9b69-cbcb799cad21 req-fe0a4884-142c-4555-b4e2-fdb989a533e4 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] No waiting events found dispatching network-vif-plugged-c6a37c9e-0be0-4c76-bb14-fcdb3c39061c {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:45:55 user nova-compute[72239]: WARNING nova.compute.manager [req-1637aa58-e2d8-41df-9b69-cbcb799cad21 req-fe0a4884-142c-4555-b4e2-fdb989a533e4 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received unexpected event network-vif-plugged-c6a37c9e-0be0-4c76-bb14-fcdb3c39061c for instance with vm_state building and task_state spawning.
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.compute.manager [req-1637aa58-e2d8-41df-9b69-cbcb799cad21 req-fe0a4884-142c-4555-b4e2-fdb989a533e4 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-vif-plugged-b0ff36fe-c825-4781-a755-951a52252422 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-1637aa58-e2d8-41df-9b69-cbcb799cad21 req-fe0a4884-142c-4555-b4e2-fdb989a533e4 service nova] Acquiring lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-1637aa58-e2d8-41df-9b69-cbcb799cad21 req-fe0a4884-142c-4555-b4e2-fdb989a533e4 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-1637aa58-e2d8-41df-9b69-cbcb799cad21 req-fe0a4884-142c-4555-b4e2-fdb989a533e4 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.compute.manager [req-1637aa58-e2d8-41df-9b69-cbcb799cad21 req-fe0a4884-142c-4555-b4e2-fdb989a533e4 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] No waiting events found dispatching network-vif-plugged-b0ff36fe-c825-4781-a755-951a52252422 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:45:55 user nova-compute[72239]: WARNING nova.compute.manager [req-1637aa58-e2d8-41df-9b69-cbcb799cad21 req-fe0a4884-142c-4555-b4e2-fdb989a533e4 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received unexpected event network-vif-plugged-b0ff36fe-c825-4781-a755-951a52252422 for instance with vm_state building and task_state spawning.
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.compute.manager [req-1637aa58-e2d8-41df-9b69-cbcb799cad21 req-fe0a4884-142c-4555-b4e2-fdb989a533e4 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-vif-plugged-b0ff36fe-c825-4781-a755-951a52252422 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-1637aa58-e2d8-41df-9b69-cbcb799cad21 req-fe0a4884-142c-4555-b4e2-fdb989a533e4 service nova] Acquiring lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-1637aa58-e2d8-41df-9b69-cbcb799cad21 req-fe0a4884-142c-4555-b4e2-fdb989a533e4 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-1637aa58-e2d8-41df-9b69-cbcb799cad21 req-fe0a4884-142c-4555-b4e2-fdb989a533e4 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.compute.manager [req-1637aa58-e2d8-41df-9b69-cbcb799cad21 req-fe0a4884-142c-4555-b4e2-fdb989a533e4 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] No waiting events found dispatching network-vif-plugged-b0ff36fe-c825-4781-a755-951a52252422 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:45:55 user nova-compute[72239]: WARNING nova.compute.manager [req-1637aa58-e2d8-41df-9b69-cbcb799cad21 req-fe0a4884-142c-4555-b4e2-fdb989a533e4 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received unexpected event network-vif-plugged-b0ff36fe-c825-4781-a755-951a52252422 for instance with vm_state building and task_state spawning.
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.compute.manager [req-1637aa58-e2d8-41df-9b69-cbcb799cad21 req-fe0a4884-142c-4555-b4e2-fdb989a533e4 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-vif-plugged-c9d1f7e0-c42d-4870-9121-293f57196a09 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-1637aa58-e2d8-41df-9b69-cbcb799cad21 req-fe0a4884-142c-4555-b4e2-fdb989a533e4 service nova] Acquiring lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-1637aa58-e2d8-41df-9b69-cbcb799cad21 req-fe0a4884-142c-4555-b4e2-fdb989a533e4 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-1637aa58-e2d8-41df-9b69-cbcb799cad21 req-fe0a4884-142c-4555-b4e2-fdb989a533e4 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.compute.manager [req-1637aa58-e2d8-41df-9b69-cbcb799cad21 req-fe0a4884-142c-4555-b4e2-fdb989a533e4 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] No waiting events found dispatching network-vif-plugged-c9d1f7e0-c42d-4870-9121-293f57196a09 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:45:55 user nova-compute[72239]: WARNING nova.compute.manager [req-1637aa58-e2d8-41df-9b69-cbcb799cad21 req-fe0a4884-142c-4555-b4e2-fdb989a533e4 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received unexpected event network-vif-plugged-c9d1f7e0-c42d-4870-9121-293f57196a09 for instance with vm_state building and task_state spawning.
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.compute.manager [req-1637aa58-e2d8-41df-9b69-cbcb799cad21 req-fe0a4884-142c-4555-b4e2-fdb989a533e4 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-vif-plugged-c9d1f7e0-c42d-4870-9121-293f57196a09 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-1637aa58-e2d8-41df-9b69-cbcb799cad21 req-fe0a4884-142c-4555-b4e2-fdb989a533e4 service nova] Acquiring lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-1637aa58-e2d8-41df-9b69-cbcb799cad21 req-fe0a4884-142c-4555-b4e2-fdb989a533e4 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-1637aa58-e2d8-41df-9b69-cbcb799cad21 req-fe0a4884-142c-4555-b4e2-fdb989a533e4 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.compute.manager [req-1637aa58-e2d8-41df-9b69-cbcb799cad21 req-fe0a4884-142c-4555-b4e2-fdb989a533e4 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] No waiting events found dispatching network-vif-plugged-c9d1f7e0-c42d-4870-9121-293f57196a09 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:45:55 user nova-compute[72239]: WARNING nova.compute.manager [req-1637aa58-e2d8-41df-9b69-cbcb799cad21 req-fe0a4884-142c-4555-b4e2-fdb989a533e4 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received unexpected event network-vif-plugged-c9d1f7e0-c42d-4870-9121-293f57196a09 for instance with vm_state building and task_state spawning.
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.compute.manager [req-1637aa58-e2d8-41df-9b69-cbcb799cad21 req-fe0a4884-142c-4555-b4e2-fdb989a533e4 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-vif-plugged-eb8f7d6e-9f92-4684-8867-7f8aed33a68c {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-1637aa58-e2d8-41df-9b69-cbcb799cad21 req-fe0a4884-142c-4555-b4e2-fdb989a533e4 service nova] Acquiring lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-1637aa58-e2d8-41df-9b69-cbcb799cad21 req-fe0a4884-142c-4555-b4e2-fdb989a533e4 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-1637aa58-e2d8-41df-9b69-cbcb799cad21 req-fe0a4884-142c-4555-b4e2-fdb989a533e4 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.compute.manager [req-1637aa58-e2d8-41df-9b69-cbcb799cad21 req-fe0a4884-142c-4555-b4e2-fdb989a533e4 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] No waiting events found dispatching network-vif-plugged-eb8f7d6e-9f92-4684-8867-7f8aed33a68c {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:45:55 user nova-compute[72239]: WARNING nova.compute.manager [req-1637aa58-e2d8-41df-9b69-cbcb799cad21 req-fe0a4884-142c-4555-b4e2-fdb989a533e4 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received unexpected event network-vif-plugged-eb8f7d6e-9f92-4684-8867-7f8aed33a68c for instance with vm_state building and task_state spawning.
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.402s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '23139373862643230', 'path': '/dev/sdg'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139373862643230', 'path': '/dev/sdg'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605782098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605782098',id=13,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpKbTGDD8BwGgSdEXNFU/kgZ4CS7lBrgW9p330ZYVzRoXQCuSG9mbPl9ey2qy8JUlwoQ9iLL4YkyPBXWoTWqF5sScqhisosAmfWBywL1scHiKs+813BAmNo37qXdI9tpQ==',key_name='tempest-keypair-1210180061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f63f7e945de84876beec594d5cbb6682',ramdisk_id='',reservation_id='r-jm590dnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-686662005',owner_user_name='tempest-TaggedBootDevicesTest_v242-686662005-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:45:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0281b9c87b9459bb375351257cac77b',uuid=6258dba2-2e73-45d7-99f0-9a4af065ffcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da58ae48-fdc4-4816-a641-525030c3beb2", "address": "fa:16:3e:9e:5d:97", "network": {"id": "245d91f7-48d7-400e-80a3-b6d5b3aae4c8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-368247279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda58ae48-fd", "ovs_interfaceid": "da58ae48-fdc4-4816-a641-525030c3beb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converting VIF {"id": "da58ae48-fdc4-4816-a641-525030c3beb2", "address": "fa:16:3e:9e:5d:97", "network": {"id": "245d91f7-48d7-400e-80a3-b6d5b3aae4c8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-368247279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda58ae48-fd", "ovs_interfaceid": "da58ae48-fdc4-4816-a641-525030c3beb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:5d:97,bridge_name='br-int',has_traffic_filtering=True,id=da58ae48-fdc4-4816-a641-525030c3beb2,network=Network(245d91f7-48d7-400e-80a3-b6d5b3aae4c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda58ae48-fd') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605782098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605782098',id=13,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpKbTGDD8BwGgSdEXNFU/kgZ4CS7lBrgW9p330ZYVzRoXQCuSG9mbPl9ey2qy8JUlwoQ9iLL4YkyPBXWoTWqF5sScqhisosAmfWBywL1scHiKs+813BAmNo37qXdI9tpQ==',key_name='tempest-keypair-1210180061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f63f7e945de84876beec594d5cbb6682',ramdisk_id='',reservation_id='r-jm590dnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-686662005',owner_user_name='tempest-TaggedBootDevicesTest_v242-686662005-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:45:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0281b9c87b9459bb375351257cac77b',uuid=6258dba2-2e73-45d7-99f0-9a4af065ffcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd", "address": "fa:16:3e:22:52:9b", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap403cc6d2-3c", "ovs_interfaceid": "403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converting VIF {"id": "403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd", "address": "fa:16:3e:22:52:9b", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap403cc6d2-3c", "ovs_interfaceid": "403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:52:9b,bridge_name='br-int',has_traffic_filtering=True,id=403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd,network=Network(422a5380-ec3d-4faf-b208-5146c95093fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap403cc6d2-3c') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605782098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605782098',id=13,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpKbTGDD8BwGgSdEXNFU/kgZ4CS7lBrgW9p330ZYVzRoXQCuSG9mbPl9ey2qy8JUlwoQ9iLL4YkyPBXWoTWqF5sScqhisosAmfWBywL1scHiKs+813BAmNo37qXdI9tpQ==',key_name='tempest-keypair-1210180061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f63f7e945de84876beec594d5cbb6682',ramdisk_id='',reservation_id='r-jm590dnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-686662005',owner_user_name='tempest-TaggedBootDevicesTest_v242-686662005-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:45:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0281b9c87b9459bb375351257cac77b',uuid=6258dba2-2e73-45d7-99f0-9a4af065ffcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57f80e07-cfe0-47a5-9b99-10166cdcf351", "address": "fa:16:3e:81:bd:5b", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f80e07-cf", "ovs_interfaceid": "57f80e07-cfe0-47a5-9b99-10166cdcf351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converting VIF {"id": "57f80e07-cfe0-47a5-9b99-10166cdcf351", "address": "fa:16:3e:81:bd:5b", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f80e07-cf", "ovs_interfaceid": "57f80e07-cfe0-47a5-9b99-10166cdcf351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:bd:5b,bridge_name='br-int',has_traffic_filtering=True,id=57f80e07-cfe0-47a5-9b99-10166cdcf351,network=Network(422a5380-ec3d-4faf-b208-5146c95093fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap57f80e07-cf') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605782098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605782098',id=13,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpKbTGDD8BwGgSdEXNFU/kgZ4CS7lBrgW9p330ZYVzRoXQCuSG9mbPl9ey2qy8JUlwoQ9iLL4YkyPBXWoTWqF5sScqhisosAmfWBywL1scHiKs+813BAmNo37qXdI9tpQ==',key_name='tempest-keypair-1210180061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f63f7e945de84876beec594d5cbb6682',ramdisk_id='',reservation_id='r-jm590dnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-686662005',owner_user_name='tempest-TaggedBootDevicesTest_v242-686662005-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:45:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0281b9c87b9459bb375351257cac77b',uuid=6258dba2-2e73-45d7-99f0-9a4af065ffcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01e36afb-4b92-42af-a2da-900e447e474e", "address": "fa:16:3e:10:e1:8d", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e36afb-4b", "ovs_interfaceid": "01e36afb-4b92-42af-a2da-900e447e474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converting VIF {"id": "01e36afb-4b92-42af-a2da-900e447e474e", "address": "fa:16:3e:10:e1:8d", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e36afb-4b", "ovs_interfaceid": "01e36afb-4b92-42af-a2da-900e447e474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:e1:8d,bridge_name='br-int',has_traffic_filtering=True,id=01e36afb-4b92-42af-a2da-900e447e474e,network=Network(422a5380-ec3d-4faf-b208-5146c95093fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01e36afb-4b') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605782098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605782098',id=13,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpKbTGDD8BwGgSdEXNFU/kgZ4CS7lBrgW9p330ZYVzRoXQCuSG9mbPl9ey2qy8JUlwoQ9iLL4YkyPBXWoTWqF5sScqhisosAmfWBywL1scHiKs+813BAmNo37qXdI9tpQ==',key_name='tempest-keypair-1210180061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f63f7e945de84876beec594d5cbb6682',ramdisk_id='',reservation_id='r-jm590dnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-686662005',owner_user_name='tempest-TaggedBootDevicesTest_v242-686662005-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:45:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0281b9c87b9459bb375351257cac77b',uuid=6258dba2-2e73-45d7-99f0-9a4af065ffcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87d5bb80-ad2c-4137-89f2-03bc494de37d", "address": "fa:16:3e:9e:00:eb", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87d5bb80-ad", "ovs_interfaceid": "87d5bb80-ad2c-4137-89f2-03bc494de37d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converting VIF {"id": "87d5bb80-ad2c-4137-89f2-03bc494de37d", "address": "fa:16:3e:9e:00:eb", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87d5bb80-ad", "ovs_interfaceid": "87d5bb80-ad2c-4137-89f2-03bc494de37d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:00:eb,bridge_name='br-int',has_traffic_filtering=True,id=87d5bb80-ad2c-4137-89f2-03bc494de37d,network=Network(422a5380-ec3d-4faf-b208-5146c95093fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87d5bb80-ad') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605782098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605782098',id=13,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpKbTGDD8BwGgSdEXNFU/kgZ4CS7lBrgW9p330ZYVzRoXQCuSG9mbPl9ey2qy8JUlwoQ9iLL4YkyPBXWoTWqF5sScqhisosAmfWBywL1scHiKs+813BAmNo37qXdI9tpQ==',key_name='tempest-keypair-1210180061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f63f7e945de84876beec594d5cbb6682',ramdisk_id='',reservation_id='r-jm590dnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-686662005',owner_user_name='tempest-TaggedBootDevicesTest_v242-686662005-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:45:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0281b9c87b9459bb375351257cac77b',uuid=6258dba2-2e73-45d7-99f0-9a4af065ffcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c330e2c1-2507-406a-b255-6e72d82c689e", "address": "fa:16:3e:1d:8b:68", "network": {"id": "6ffbd985-4f07-4813-901c-fa0af7d3588b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1064713526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc330e2c1-25", "ovs_interfaceid": "c330e2c1-2507-406a-b255-6e72d82c689e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converting VIF {"id": "c330e2c1-2507-406a-b255-6e72d82c689e", "address": "fa:16:3e:1d:8b:68", "network": {"id": "6ffbd985-4f07-4813-901c-fa0af7d3588b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1064713526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc330e2c1-25", "ovs_interfaceid": "c330e2c1-2507-406a-b255-6e72d82c689e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:8b:68,bridge_name='br-int',has_traffic_filtering=True,id=c330e2c1-2507-406a-b255-6e72d82c689e,network=Network(6ffbd985-4f07-4813-901c-fa0af7d3588b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc330e2c1-25') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605782098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605782098',id=13,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpKbTGDD8BwGgSdEXNFU/kgZ4CS7lBrgW9p330ZYVzRoXQCuSG9mbPl9ey2qy8JUlwoQ9iLL4YkyPBXWoTWqF5sScqhisosAmfWBywL1scHiKs+813BAmNo37qXdI9tpQ==',key_name='tempest-keypair-1210180061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f63f7e945de84876beec594d5cbb6682',ramdisk_id='',reservation_id='r-jm590dnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-686662005',owner_user_name='tempest-TaggedBootDevicesTest_v242-686662005-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:45:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0281b9c87b9459bb375351257cac77b',uuid=6258dba2-2e73-45d7-99f0-9a4af065ffcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fba6d4e-0137-4514-9525-29e86356c1eb", "address": "fa:16:3e:87:eb:18", "network": {"id": "6ffbd985-4f07-4813-901c-fa0af7d3588b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1064713526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fba6d4e-01", "ovs_interfaceid": "6fba6d4e-0137-4514-9525-29e86356c1eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converting VIF {"id": "6fba6d4e-0137-4514-9525-29e86356c1eb", "address": "fa:16:3e:87:eb:18", "network": {"id": "6ffbd985-4f07-4813-901c-fa0af7d3588b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1064713526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fba6d4e-01", "ovs_interfaceid": "6fba6d4e-0137-4514-9525-29e86356c1eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:eb:18,bridge_name='br-int',has_traffic_filtering=True,id=6fba6d4e-0137-4514-9525-29e86356c1eb,network=Network(6ffbd985-4f07-4813-901c-fa0af7d3588b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fba6d4e-01') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.objects.instance [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Lazy-loading 'pci_devices' on Instance uuid 6258dba2-2e73-45d7-99f0-9a4af065ffcc {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:45:55 user nova-compute[72239]:   <uuid>6258dba2-2e73-45d7-99f0-9a4af065ffcc</uuid>
Jul 31 14:45:55 user nova-compute[72239]:   <name>instance-0000000d</name>
Jul 31 14:45:55 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:45:55 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:45:55 user nova-compute[72239]:   <metadata>
Jul 31 14:45:55 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:45:55 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:45:55 user nova-compute[72239]:       <nova:name>tempest-device-tagging-server-605782098</nova:name>
Jul 31 14:45:55 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:45:50</nova:creationTime>
Jul 31 14:45:55 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:45:55 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:45:55 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:45:55 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:45:55 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:45:55 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:45:55 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:45:55 user nova-compute[72239]:       <nova:owner>
Jul 31 14:45:55 user nova-compute[72239]:         <nova:user uuid="b0281b9c87b9459bb375351257cac77b">tempest-TaggedBootDevicesTest_v242-686662005-project-member</nova:user>
Jul 31 14:45:55 user nova-compute[72239]:         <nova:project uuid="f63f7e945de84876beec594d5cbb6682">tempest-TaggedBootDevicesTest_v242-686662005</nova:project>
Jul 31 14:45:55 user nova-compute[72239]:       </nova:owner>
Jul 31 14:45:55 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:45:55 user nova-compute[72239]:       <nova:ports>
Jul 31 14:45:55 user nova-compute[72239]:         <nova:port uuid="da58ae48-fdc4-4816-a641-525030c3beb2">
Jul 31 14:45:55 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 31 14:45:55 user nova-compute[72239]:         </nova:port>
Jul 31 14:45:55 user nova-compute[72239]:         <nova:port uuid="403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd">
Jul 31 14:45:55 user nova-compute[72239]:           <nova:ip type="fixed" address="10.1.1.32" ipVersion="4"/>
Jul 31 14:45:55 user nova-compute[72239]:         </nova:port>
Jul 31 14:45:55 user nova-compute[72239]:         <nova:port uuid="57f80e07-cfe0-47a5-9b99-10166cdcf351">
Jul 31 14:45:55 user nova-compute[72239]:           <nova:ip type="fixed" address="10.1.1.221" ipVersion="4"/>
Jul 31 14:45:55 user nova-compute[72239]:         </nova:port>
Jul 31 14:45:55 user nova-compute[72239]:         <nova:port uuid="01e36afb-4b92-42af-a2da-900e447e474e">
Jul 31 14:45:55 user nova-compute[72239]:           <nova:ip type="fixed" address="10.1.1.185" ipVersion="4"/>
Jul 31 14:45:55 user nova-compute[72239]:         </nova:port>
Jul 31 14:45:55 user nova-compute[72239]:         <nova:port uuid="87d5bb80-ad2c-4137-89f2-03bc494de37d">
Jul 31 14:45:55 user nova-compute[72239]:           <nova:ip type="fixed" address="10.1.1.216" ipVersion="4"/>
Jul 31 14:45:55 user nova-compute[72239]:         </nova:port>
Jul 31 14:45:55 user nova-compute[72239]:         <nova:port uuid="c330e2c1-2507-406a-b255-6e72d82c689e">
Jul 31 14:45:55 user nova-compute[72239]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jul 31 14:45:55 user nova-compute[72239]:         </nova:port>
Jul 31 14:45:55 user nova-compute[72239]:         <nova:port uuid="6fba6d4e-0137-4514-9525-29e86356c1eb">
Jul 31 14:45:55 user nova-compute[72239]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jul 31 14:45:55 user nova-compute[72239]:         </nova:port>
Jul 31 14:45:55 user nova-compute[72239]:       </nova:ports>
Jul 31 14:45:55 user nova-compute[72239]:     </nova:instance>
Jul 31 14:45:55 user nova-compute[72239]:   </metadata>
Jul 31 14:45:55 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:45:55 user nova-compute[72239]:     <system>
Jul 31 14:45:55 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:45:55 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:45:55 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:45:55 user nova-compute[72239]:       <entry name="serial">6258dba2-2e73-45d7-99f0-9a4af065ffcc</entry>
Jul 31 14:45:55 user nova-compute[72239]:       <entry name="uuid">6258dba2-2e73-45d7-99f0-9a4af065ffcc</entry>
Jul 31 14:45:55 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:45:55 user nova-compute[72239]:     </system>
Jul 31 14:45:55 user nova-compute[72239]:   </sysinfo>
Jul 31 14:45:55 user nova-compute[72239]:   <os>
Jul 31 14:45:55 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:45:55 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:45:55 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:45:55 user nova-compute[72239]:   </os>
Jul 31 14:45:55 user nova-compute[72239]:   <features>
Jul 31 14:45:55 user nova-compute[72239]:     <acpi/>
Jul 31 14:45:55 user nova-compute[72239]:     <apic/>
Jul 31 14:45:55 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:45:55 user nova-compute[72239]:   </features>
Jul 31 14:45:55 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:45:55 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:45:55 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:45:55 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:45:55 user nova-compute[72239]:   </clock>
Jul 31 14:45:55 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:45:55 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:45:55 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:45:55 user nova-compute[72239]:   </cpu>
Jul 31 14:45:55 user nova-compute[72239]:   <devices>
Jul 31 14:45:55 user nova-compute[72239]:     <disk type="file" device="cdrom">
Jul 31 14:45:55 user nova-compute[72239]:       <driver name="qemu" type="raw" cache="none"/>
Jul 31 14:45:55 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/6258dba2-2e73-45d7-99f0-9a4af065ffcc/disk.config"/>
Jul 31 14:45:55 user nova-compute[72239]:       <target dev="hda" bus="ide"/>
Jul 31 14:45:55 user nova-compute[72239]:     </disk>
Jul 31 14:45:55 user nova-compute[72239]:     <disk type="block" device="disk">
Jul 31 14:45:55 user nova-compute[72239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:45:55 user nova-compute[72239]:       <source dev="/dev/sde"/>
Jul 31 14:45:55 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:45:55 user nova-compute[72239]:       <serial>9373b07a-291c-4687-9779-41418a02fad7</serial>
Jul 31 14:45:55 user nova-compute[72239]:     </disk>
Jul 31 14:45:55 user nova-compute[72239]:     <disk type="block" device="disk">
Jul 31 14:45:55 user nova-compute[72239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:45:55 user nova-compute[72239]:       <source dev="/dev/sdf"/>
Jul 31 14:45:55 user nova-compute[72239]:       <target dev="vdb" bus="virtio"/>
Jul 31 14:45:55 user nova-compute[72239]:       <serial>c6970ccf-414d-409e-8c4d-cf3a5efa487a</serial>
Jul 31 14:45:55 user nova-compute[72239]:     </disk>
Jul 31 14:45:55 user nova-compute[72239]:     <disk type="block" device="disk">
Jul 31 14:45:55 user nova-compute[72239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:45:55 user nova-compute[72239]:       <source dev="/dev/sdg"/>
Jul 31 14:45:55 user nova-compute[72239]:       <target dev="vdc" bus="virtio"/>
Jul 31 14:45:55 user nova-compute[72239]:       <serial>aac36111-3590-450f-a7c0-5d37ab6004f4</serial>
Jul 31 14:45:55 user nova-compute[72239]:     </disk>
Jul 31 14:45:55 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:45:55 user nova-compute[72239]:       <mac address="fa:16:3e:9e:5d:97"/>
Jul 31 14:45:55 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:45:55 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:45:55 user nova-compute[72239]:       <target dev="tapda58ae48-fd"/>
Jul 31 14:45:55 user nova-compute[72239]:     </interface>
Jul 31 14:45:55 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:45:55 user nova-compute[72239]:       <mac address="fa:16:3e:22:52:9b"/>
Jul 31 14:45:55 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:45:55 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:45:55 user nova-compute[72239]:       <target dev="tap403cc6d2-3c"/>
Jul 31 14:45:55 user nova-compute[72239]:     </interface>
Jul 31 14:45:55 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:45:55 user nova-compute[72239]:       <mac address="fa:16:3e:81:bd:5b"/>
Jul 31 14:45:55 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:45:55 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:45:55 user nova-compute[72239]:       <target dev="tap57f80e07-cf"/>
Jul 31 14:45:55 user nova-compute[72239]:     </interface>
Jul 31 14:45:55 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:45:55 user nova-compute[72239]:       <mac address="fa:16:3e:10:e1:8d"/>
Jul 31 14:45:55 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:45:55 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:45:55 user nova-compute[72239]:       <target dev="tap01e36afb-4b"/>
Jul 31 14:45:55 user nova-compute[72239]:     </interface>
Jul 31 14:45:55 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:45:55 user nova-compute[72239]:       <mac address="fa:16:3e:9e:00:eb"/>
Jul 31 14:45:55 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:45:55 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:45:55 user nova-compute[72239]:       <target dev="tap87d5bb80-ad"/>
Jul 31 14:45:55 user nova-compute[72239]:     </interface>
Jul 31 14:45:55 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:45:55 user nova-compute[72239]:       <mac address="fa:16:3e:1d:8b:68"/>
Jul 31 14:45:55 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:45:55 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:45:55 user nova-compute[72239]:       <target dev="tapc330e2c1-25"/>
Jul 31 14:45:55 user nova-compute[72239]:     </interface>
Jul 31 14:45:55 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:45:55 user nova-compute[72239]:       <mac address="fa:16:3e:87:eb:18"/>
Jul 31 14:45:55 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:45:55 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:45:55 user nova-compute[72239]:       <target dev="tap6fba6d4e-01"/>
Jul 31 14:45:55 user nova-compute[72239]:     </interface>
Jul 31 14:45:55 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:45:55 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/6258dba2-2e73-45d7-99f0-9a4af065ffcc/console.log" append="off"/>
Jul 31 14:45:55 user nova-compute[72239]:     </serial>
Jul 31 14:45:55 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:45:55 user nova-compute[72239]:     <video>
Jul 31 14:45:55 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:45:55 user nova-compute[72239]:     </video>
Jul 31 14:45:55 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:45:55 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:45:55 user nova-compute[72239]:     </rng>
Jul 31 14:45:55 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:45:55 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:45:55 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:45:55 user nova-compute[72239]:     </memballoon>
Jul 31 14:45:55 user nova-compute[72239]:   </devices>
Jul 31 14:45:55 user nova-compute[72239]: </domain>
Jul 31 14:45:55 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605782098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605782098',id=13,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpKbTGDD8BwGgSdEXNFU/kgZ4CS7lBrgW9p330ZYVzRoXQCuSG9mbPl9ey2qy8JUlwoQ9iLL4YkyPBXWoTWqF5sScqhisosAmfWBywL1scHiKs+813BAmNo37qXdI9tpQ==',key_name='tempest-keypair-1210180061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f63f7e945de84876beec594d5cbb6682',ramdisk_id='',reservation_id='r-jm590dnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-686662005',owner_user_name='tempest-TaggedBootDevicesTest_v242-686662005-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:45:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0281b9c87b9459bb375351257cac77b',uuid=6258dba2-2e73-45d7-99f0-9a4af065ffcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da58ae48-fdc4-4816-a641-525030c3beb2", "address": "fa:16:3e:9e:5d:97", "network": {"id": "245d91f7-48d7-400e-80a3-b6d5b3aae4c8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-368247279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda58ae48-fd", "ovs_interfaceid": "da58ae48-fdc4-4816-a641-525030c3beb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converting VIF {"id": "da58ae48-fdc4-4816-a641-525030c3beb2", "address": "fa:16:3e:9e:5d:97", "network": {"id": "245d91f7-48d7-400e-80a3-b6d5b3aae4c8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-368247279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda58ae48-fd", "ovs_interfaceid": "da58ae48-fdc4-4816-a641-525030c3beb2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:5d:97,bridge_name='br-int',has_traffic_filtering=True,id=da58ae48-fdc4-4816-a641-525030c3beb2,network=Network(245d91f7-48d7-400e-80a3-b6d5b3aae4c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda58ae48-fd') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG os_vif [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:5d:97,bridge_name='br-int',has_traffic_filtering=True,id=da58ae48-fdc4-4816-a641-525030c3beb2,network=Network(245d91f7-48d7-400e-80a3-b6d5b3aae4c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda58ae48-fd') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda58ae48-fd, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapda58ae48-fd, col_values=(('external_ids', {'iface-id': 'da58ae48-fdc4-4816-a641-525030c3beb2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:5d:97', 'vm-uuid': '6258dba2-2e73-45d7-99f0-9a4af065ffcc'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:55 user nova-compute[72239]: INFO os_vif [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:5d:97,bridge_name='br-int',has_traffic_filtering=True,id=da58ae48-fdc4-4816-a641-525030c3beb2,network=Network(245d91f7-48d7-400e-80a3-b6d5b3aae4c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda58ae48-fd')
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605782098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605782098',id=13,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpKbTGDD8BwGgSdEXNFU/kgZ4CS7lBrgW9p330ZYVzRoXQCuSG9mbPl9ey2qy8JUlwoQ9iLL4YkyPBXWoTWqF5sScqhisosAmfWBywL1scHiKs+813BAmNo37qXdI9tpQ==',key_name='tempest-keypair-1210180061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f63f7e945de84876beec594d5cbb6682',ramdisk_id='',reservation_id='r-jm590dnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-686662005',owner_user_name='tempest-TaggedBootDevicesTest_v242-686662005-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:45:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0281b9c87b9459bb375351257cac77b',uuid=6258dba2-2e73-45d7-99f0-9a4af065ffcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd", "address": "fa:16:3e:22:52:9b", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap403cc6d2-3c", "ovs_interfaceid": "403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converting VIF {"id": "403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd", "address": "fa:16:3e:22:52:9b", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap403cc6d2-3c", "ovs_interfaceid": "403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:52:9b,bridge_name='br-int',has_traffic_filtering=True,id=403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd,network=Network(422a5380-ec3d-4faf-b208-5146c95093fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap403cc6d2-3c') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG os_vif [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:52:9b,bridge_name='br-int',has_traffic_filtering=True,id=403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd,network=Network(422a5380-ec3d-4faf-b208-5146c95093fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap403cc6d2-3c') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap403cc6d2-3c, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap403cc6d2-3c, col_values=(('external_ids', {'iface-id': '403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:52:9b', 'vm-uuid': '6258dba2-2e73-45d7-99f0-9a4af065ffcc'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:55 user nova-compute[72239]: INFO os_vif [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:52:9b,bridge_name='br-int',has_traffic_filtering=True,id=403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd,network=Network(422a5380-ec3d-4faf-b208-5146c95093fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap403cc6d2-3c')
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605782098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605782098',id=13,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpKbTGDD8BwGgSdEXNFU/kgZ4CS7lBrgW9p330ZYVzRoXQCuSG9mbPl9ey2qy8JUlwoQ9iLL4YkyPBXWoTWqF5sScqhisosAmfWBywL1scHiKs+813BAmNo37qXdI9tpQ==',key_name='tempest-keypair-1210180061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f63f7e945de84876beec594d5cbb6682',ramdisk_id='',reservation_id='r-jm590dnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-686662005',owner_user_name='tempest-TaggedBootDevicesTest_v242-686662005-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:45:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0281b9c87b9459bb375351257cac77b',uuid=6258dba2-2e73-45d7-99f0-9a4af065ffcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57f80e07-cfe0-47a5-9b99-10166cdcf351", "address": "fa:16:3e:81:bd:5b", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f80e07-cf", "ovs_interfaceid": "57f80e07-cfe0-47a5-9b99-10166cdcf351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converting VIF {"id": "57f80e07-cfe0-47a5-9b99-10166cdcf351", "address": "fa:16:3e:81:bd:5b", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f80e07-cf", "ovs_interfaceid": "57f80e07-cfe0-47a5-9b99-10166cdcf351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:bd:5b,bridge_name='br-int',has_traffic_filtering=True,id=57f80e07-cfe0-47a5-9b99-10166cdcf351,network=Network(422a5380-ec3d-4faf-b208-5146c95093fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap57f80e07-cf') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG os_vif [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:bd:5b,bridge_name='br-int',has_traffic_filtering=True,id=57f80e07-cfe0-47a5-9b99-10166cdcf351,network=Network(422a5380-ec3d-4faf-b208-5146c95093fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap57f80e07-cf') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57f80e07-cf, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap57f80e07-cf, col_values=(('external_ids', {'iface-id': '57f80e07-cfe0-47a5-9b99-10166cdcf351', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:bd:5b', 'vm-uuid': '6258dba2-2e73-45d7-99f0-9a4af065ffcc'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:55 user nova-compute[72239]: INFO os_vif [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:bd:5b,bridge_name='br-int',has_traffic_filtering=True,id=57f80e07-cfe0-47a5-9b99-10166cdcf351,network=Network(422a5380-ec3d-4faf-b208-5146c95093fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap57f80e07-cf')
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605782098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605782098',id=13,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpKbTGDD8BwGgSdEXNFU/kgZ4CS7lBrgW9p330ZYVzRoXQCuSG9mbPl9ey2qy8JUlwoQ9iLL4YkyPBXWoTWqF5sScqhisosAmfWBywL1scHiKs+813BAmNo37qXdI9tpQ==',key_name='tempest-keypair-1210180061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f63f7e945de84876beec594d5cbb6682',ramdisk_id='',reservation_id='r-jm590dnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-686662005',owner_user_name='tempest-TaggedBootDevicesTest_v242-686662005-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:45:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0281b9c87b9459bb375351257cac77b',uuid=6258dba2-2e73-45d7-99f0-9a4af065ffcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "01e36afb-4b92-42af-a2da-900e447e474e", "address": "fa:16:3e:10:e1:8d", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e36afb-4b", "ovs_interfaceid": "01e36afb-4b92-42af-a2da-900e447e474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converting VIF {"id": "01e36afb-4b92-42af-a2da-900e447e474e", "address": "fa:16:3e:10:e1:8d", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e36afb-4b", "ovs_interfaceid": "01e36afb-4b92-42af-a2da-900e447e474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:e1:8d,bridge_name='br-int',has_traffic_filtering=True,id=01e36afb-4b92-42af-a2da-900e447e474e,network=Network(422a5380-ec3d-4faf-b208-5146c95093fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01e36afb-4b') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG os_vif [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:e1:8d,bridge_name='br-int',has_traffic_filtering=True,id=01e36afb-4b92-42af-a2da-900e447e474e,network=Network(422a5380-ec3d-4faf-b208-5146c95093fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01e36afb-4b') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap01e36afb-4b, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap01e36afb-4b, col_values=(('external_ids', {'iface-id': '01e36afb-4b92-42af-a2da-900e447e474e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:10:e1:8d', 'vm-uuid': '6258dba2-2e73-45d7-99f0-9a4af065ffcc'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:55 user nova-compute[72239]: INFO os_vif [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:e1:8d,bridge_name='br-int',has_traffic_filtering=True,id=01e36afb-4b92-42af-a2da-900e447e474e,network=Network(422a5380-ec3d-4faf-b208-5146c95093fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01e36afb-4b')
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605782098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605782098',id=13,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpKbTGDD8BwGgSdEXNFU/kgZ4CS7lBrgW9p330ZYVzRoXQCuSG9mbPl9ey2qy8JUlwoQ9iLL4YkyPBXWoTWqF5sScqhisosAmfWBywL1scHiKs+813BAmNo37qXdI9tpQ==',key_name='tempest-keypair-1210180061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f63f7e945de84876beec594d5cbb6682',ramdisk_id='',reservation_id='r-jm590dnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-686662005',owner_user_name='tempest-TaggedBootDevicesTest_v242-686662005-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:45:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0281b9c87b9459bb375351257cac77b',uuid=6258dba2-2e73-45d7-99f0-9a4af065ffcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87d5bb80-ad2c-4137-89f2-03bc494de37d", "address": "fa:16:3e:9e:00:eb", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87d5bb80-ad", "ovs_interfaceid": "87d5bb80-ad2c-4137-89f2-03bc494de37d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converting VIF {"id": "87d5bb80-ad2c-4137-89f2-03bc494de37d", "address": "fa:16:3e:9e:00:eb", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87d5bb80-ad", "ovs_interfaceid": "87d5bb80-ad2c-4137-89f2-03bc494de37d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:00:eb,bridge_name='br-int',has_traffic_filtering=True,id=87d5bb80-ad2c-4137-89f2-03bc494de37d,network=Network(422a5380-ec3d-4faf-b208-5146c95093fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87d5bb80-ad') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG os_vif [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:00:eb,bridge_name='br-int',has_traffic_filtering=True,id=87d5bb80-ad2c-4137-89f2-03bc494de37d,network=Network(422a5380-ec3d-4faf-b208-5146c95093fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87d5bb80-ad') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap87d5bb80-ad, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap87d5bb80-ad, col_values=(('external_ids', {'iface-id': '87d5bb80-ad2c-4137-89f2-03bc494de37d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:00:eb', 'vm-uuid': '6258dba2-2e73-45d7-99f0-9a4af065ffcc'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:55 user nova-compute[72239]: INFO os_vif [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:00:eb,bridge_name='br-int',has_traffic_filtering=True,id=87d5bb80-ad2c-4137-89f2-03bc494de37d,network=Network(422a5380-ec3d-4faf-b208-5146c95093fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87d5bb80-ad')
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605782098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605782098',id=13,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpKbTGDD8BwGgSdEXNFU/kgZ4CS7lBrgW9p330ZYVzRoXQCuSG9mbPl9ey2qy8JUlwoQ9iLL4YkyPBXWoTWqF5sScqhisosAmfWBywL1scHiKs+813BAmNo37qXdI9tpQ==',key_name='tempest-keypair-1210180061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f63f7e945de84876beec594d5cbb6682',ramdisk_id='',reservation_id='r-jm590dnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-686662005',owner_user_name='tempest-TaggedBootDevicesTest_v242-686662005-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:45:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0281b9c87b9459bb375351257cac77b',uuid=6258dba2-2e73-45d7-99f0-9a4af065ffcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c330e2c1-2507-406a-b255-6e72d82c689e", "address": "fa:16:3e:1d:8b:68", "network": {"id": "6ffbd985-4f07-4813-901c-fa0af7d3588b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1064713526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc330e2c1-25", "ovs_interfaceid": "c330e2c1-2507-406a-b255-6e72d82c689e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converting VIF {"id": "c330e2c1-2507-406a-b255-6e72d82c689e", "address": "fa:16:3e:1d:8b:68", "network": {"id": "6ffbd985-4f07-4813-901c-fa0af7d3588b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1064713526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc330e2c1-25", "ovs_interfaceid": "c330e2c1-2507-406a-b255-6e72d82c689e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:8b:68,bridge_name='br-int',has_traffic_filtering=True,id=c330e2c1-2507-406a-b255-6e72d82c689e,network=Network(6ffbd985-4f07-4813-901c-fa0af7d3588b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc330e2c1-25') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG os_vif [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:8b:68,bridge_name='br-int',has_traffic_filtering=True,id=c330e2c1-2507-406a-b255-6e72d82c689e,network=Network(6ffbd985-4f07-4813-901c-fa0af7d3588b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc330e2c1-25') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc330e2c1-25, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc330e2c1-25, col_values=(('external_ids', {'iface-id': 'c330e2c1-2507-406a-b255-6e72d82c689e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1d:8b:68', 'vm-uuid': '6258dba2-2e73-45d7-99f0-9a4af065ffcc'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:55 user nova-compute[72239]: INFO os_vif [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:8b:68,bridge_name='br-int',has_traffic_filtering=True,id=c330e2c1-2507-406a-b255-6e72d82c689e,network=Network(6ffbd985-4f07-4813-901c-fa0af7d3588b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc330e2c1-25')
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605782098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605782098',id=13,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpKbTGDD8BwGgSdEXNFU/kgZ4CS7lBrgW9p330ZYVzRoXQCuSG9mbPl9ey2qy8JUlwoQ9iLL4YkyPBXWoTWqF5sScqhisosAmfWBywL1scHiKs+813BAmNo37qXdI9tpQ==',key_name='tempest-keypair-1210180061',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f63f7e945de84876beec594d5cbb6682',ramdisk_id='',reservation_id='r-jm590dnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-686662005',owner_user_name='tempest-TaggedBootDevicesTest_v242-686662005-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:45:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0281b9c87b9459bb375351257cac77b',uuid=6258dba2-2e73-45d7-99f0-9a4af065ffcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fba6d4e-0137-4514-9525-29e86356c1eb", "address": "fa:16:3e:87:eb:18", "network": {"id": "6ffbd985-4f07-4813-901c-fa0af7d3588b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1064713526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fba6d4e-01", "ovs_interfaceid": "6fba6d4e-0137-4514-9525-29e86356c1eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converting VIF {"id": "6fba6d4e-0137-4514-9525-29e86356c1eb", "address": "fa:16:3e:87:eb:18", "network": {"id": "6ffbd985-4f07-4813-901c-fa0af7d3588b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1064713526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fba6d4e-01", "ovs_interfaceid": "6fba6d4e-0137-4514-9525-29e86356c1eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:eb:18,bridge_name='br-int',has_traffic_filtering=True,id=6fba6d4e-0137-4514-9525-29e86356c1eb,network=Network(6ffbd985-4f07-4813-901c-fa0af7d3588b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fba6d4e-01') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG os_vif [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:eb:18,bridge_name='br-int',has_traffic_filtering=True,id=6fba6d4e-0137-4514-9525-29e86356c1eb,network=Network(6ffbd985-4f07-4813-901c-fa0af7d3588b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fba6d4e-01') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6fba6d4e-01, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6fba6d4e-01, col_values=(('external_ids', {'iface-id': '6fba6d4e-0137-4514-9525-29e86356c1eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:eb:18', 'vm-uuid': '6258dba2-2e73-45d7-99f0-9a4af065ffcc'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:45:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:56 user nova-compute[72239]: INFO os_vif [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:eb:18,bridge_name='br-int',has_traffic_filtering=True,id=6fba6d4e-0137-4514-9525-29e86356c1eb,network=Network(6ffbd985-4f07-4813-901c-fa0af7d3588b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fba6d4e-01')
Jul 31 14:45:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:56 user nova-compute[72239]: DEBUG nova.compute.manager [req-e20762c7-247c-4712-8381-2760eee5f270 req-96df39d5-1301-4593-b68c-30dc80ffe9f5 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-vif-plugged-8a006aee-3f68-4eb2-b214-6cf76db08ffe {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:45:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e20762c7-247c-4712-8381-2760eee5f270 req-96df39d5-1301-4593-b68c-30dc80ffe9f5 service nova] Acquiring lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:45:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e20762c7-247c-4712-8381-2760eee5f270 req-96df39d5-1301-4593-b68c-30dc80ffe9f5 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:45:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e20762c7-247c-4712-8381-2760eee5f270 req-96df39d5-1301-4593-b68c-30dc80ffe9f5 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:45:56 user nova-compute[72239]: DEBUG nova.compute.manager [req-e20762c7-247c-4712-8381-2760eee5f270 req-96df39d5-1301-4593-b68c-30dc80ffe9f5 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] No waiting events found dispatching network-vif-plugged-8a006aee-3f68-4eb2-b214-6cf76db08ffe {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:45:56 user nova-compute[72239]: WARNING nova.compute.manager [req-e20762c7-247c-4712-8381-2760eee5f270 req-96df39d5-1301-4593-b68c-30dc80ffe9f5 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received unexpected event network-vif-plugged-8a006aee-3f68-4eb2-b214-6cf76db08ffe for instance with vm_state building and task_state spawning.
Jul 31 14:45:56 user nova-compute[72239]: DEBUG nova.compute.manager [req-e20762c7-247c-4712-8381-2760eee5f270 req-96df39d5-1301-4593-b68c-30dc80ffe9f5 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-vif-plugged-ba2d5a24-f668-4413-abb1-c51cf2038a1c {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:45:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e20762c7-247c-4712-8381-2760eee5f270 req-96df39d5-1301-4593-b68c-30dc80ffe9f5 service nova] Acquiring lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:45:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e20762c7-247c-4712-8381-2760eee5f270 req-96df39d5-1301-4593-b68c-30dc80ffe9f5 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:45:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e20762c7-247c-4712-8381-2760eee5f270 req-96df39d5-1301-4593-b68c-30dc80ffe9f5 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:45:56 user nova-compute[72239]: DEBUG nova.compute.manager [req-e20762c7-247c-4712-8381-2760eee5f270 req-96df39d5-1301-4593-b68c-30dc80ffe9f5 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] No waiting events found dispatching network-vif-plugged-ba2d5a24-f668-4413-abb1-c51cf2038a1c {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:45:56 user nova-compute[72239]: WARNING nova.compute.manager [req-e20762c7-247c-4712-8381-2760eee5f270 req-96df39d5-1301-4593-b68c-30dc80ffe9f5 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received unexpected event network-vif-plugged-ba2d5a24-f668-4413-abb1-c51cf2038a1c for instance with vm_state building and task_state spawning.
Jul 31 14:45:56 user nova-compute[72239]: DEBUG nova.compute.manager [req-e20762c7-247c-4712-8381-2760eee5f270 req-96df39d5-1301-4593-b68c-30dc80ffe9f5 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-vif-plugged-ba2d5a24-f668-4413-abb1-c51cf2038a1c {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:45:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e20762c7-247c-4712-8381-2760eee5f270 req-96df39d5-1301-4593-b68c-30dc80ffe9f5 service nova] Acquiring lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:45:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e20762c7-247c-4712-8381-2760eee5f270 req-96df39d5-1301-4593-b68c-30dc80ffe9f5 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:45:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e20762c7-247c-4712-8381-2760eee5f270 req-96df39d5-1301-4593-b68c-30dc80ffe9f5 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:45:56 user nova-compute[72239]: DEBUG nova.compute.manager [req-e20762c7-247c-4712-8381-2760eee5f270 req-96df39d5-1301-4593-b68c-30dc80ffe9f5 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] No waiting events found dispatching network-vif-plugged-ba2d5a24-f668-4413-abb1-c51cf2038a1c {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:45:56 user nova-compute[72239]: WARNING nova.compute.manager [req-e20762c7-247c-4712-8381-2760eee5f270 req-96df39d5-1301-4593-b68c-30dc80ffe9f5 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received unexpected event network-vif-plugged-ba2d5a24-f668-4413-abb1-c51cf2038a1c for instance with vm_state building and task_state spawning.
Jul 31 14:45:56 user nova-compute[72239]: DEBUG nova.compute.manager [req-e20762c7-247c-4712-8381-2760eee5f270 req-96df39d5-1301-4593-b68c-30dc80ffe9f5 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-vif-plugged-0642e4d3-ade9-425b-9860-f306229034b3 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:45:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e20762c7-247c-4712-8381-2760eee5f270 req-96df39d5-1301-4593-b68c-30dc80ffe9f5 service nova] Acquiring lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:45:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e20762c7-247c-4712-8381-2760eee5f270 req-96df39d5-1301-4593-b68c-30dc80ffe9f5 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:45:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e20762c7-247c-4712-8381-2760eee5f270 req-96df39d5-1301-4593-b68c-30dc80ffe9f5 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:45:56 user nova-compute[72239]: DEBUG nova.compute.manager [req-e20762c7-247c-4712-8381-2760eee5f270 req-96df39d5-1301-4593-b68c-30dc80ffe9f5 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] No waiting events found dispatching network-vif-plugged-0642e4d3-ade9-425b-9860-f306229034b3 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:45:56 user nova-compute[72239]: WARNING nova.compute.manager [req-e20762c7-247c-4712-8381-2760eee5f270 req-96df39d5-1301-4593-b68c-30dc80ffe9f5 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received unexpected event network-vif-plugged-0642e4d3-ade9-425b-9860-f306229034b3 for instance with vm_state building and task_state spawning.
Jul 31 14:45:56 user nova-compute[72239]: DEBUG nova.compute.manager [req-e20762c7-247c-4712-8381-2760eee5f270 req-96df39d5-1301-4593-b68c-30dc80ffe9f5 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-vif-plugged-0642e4d3-ade9-425b-9860-f306229034b3 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:45:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e20762c7-247c-4712-8381-2760eee5f270 req-96df39d5-1301-4593-b68c-30dc80ffe9f5 service nova] Acquiring lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:45:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e20762c7-247c-4712-8381-2760eee5f270 req-96df39d5-1301-4593-b68c-30dc80ffe9f5 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:45:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e20762c7-247c-4712-8381-2760eee5f270 req-96df39d5-1301-4593-b68c-30dc80ffe9f5 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:45:56 user nova-compute[72239]: DEBUG nova.compute.manager [req-e20762c7-247c-4712-8381-2760eee5f270 req-96df39d5-1301-4593-b68c-30dc80ffe9f5 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] No waiting events found dispatching network-vif-plugged-0642e4d3-ade9-425b-9860-f306229034b3 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:45:56 user nova-compute[72239]: WARNING nova.compute.manager [req-e20762c7-247c-4712-8381-2760eee5f270 req-96df39d5-1301-4593-b68c-30dc80ffe9f5 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received unexpected event network-vif-plugged-0642e4d3-ade9-425b-9860-f306229034b3 for instance with vm_state building and task_state spawning.
Jul 31 14:45:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:56 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] No BDM found with device name hda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:45:56 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:45:56 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] No VIF found with MAC fa:16:3e:9e:5d:97, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:45:56 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] No VIF found with MAC fa:16:3e:9e:00:eb, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:45:56 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Using config drive
Jul 31 14:45:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:56 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Creating config drive at /opt/stack/data/nova/instances/6258dba2-2e73-45d7-99f0-9a4af065ffcc/disk.config
Jul 31 14:45:56 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/6258dba2-2e73-45d7-99f0-9a4af065ffcc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpupp9xxxj {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:56 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/6258dba2-2e73-45d7-99f0-9a4af065ffcc/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpupp9xxxj" returned: 0 in 0.077s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:57 user nova-compute[72239]: DEBUG nova.compute.manager [req-c547dac0-5e54-40df-a1d3-646d3324528c req-df80bb7b-fbf7-4b15-9b54-a2621833cf7c service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-vif-plugged-eb8f7d6e-9f92-4684-8867-7f8aed33a68c {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:45:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-c547dac0-5e54-40df-a1d3-646d3324528c req-df80bb7b-fbf7-4b15-9b54-a2621833cf7c service nova] Acquiring lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:45:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-c547dac0-5e54-40df-a1d3-646d3324528c req-df80bb7b-fbf7-4b15-9b54-a2621833cf7c service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:45:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-c547dac0-5e54-40df-a1d3-646d3324528c req-df80bb7b-fbf7-4b15-9b54-a2621833cf7c service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:45:57 user nova-compute[72239]: DEBUG nova.compute.manager [req-c547dac0-5e54-40df-a1d3-646d3324528c req-df80bb7b-fbf7-4b15-9b54-a2621833cf7c service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] No waiting events found dispatching network-vif-plugged-eb8f7d6e-9f92-4684-8867-7f8aed33a68c {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:45:57 user nova-compute[72239]: WARNING nova.compute.manager [req-c547dac0-5e54-40df-a1d3-646d3324528c req-df80bb7b-fbf7-4b15-9b54-a2621833cf7c service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received unexpected event network-vif-plugged-eb8f7d6e-9f92-4684-8867-7f8aed33a68c for instance with vm_state building and task_state spawning.
Jul 31 14:45:57 user nova-compute[72239]: INFO nova.compute.manager [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Rescuing
Jul 31 14:45:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "refresh_cache-079a5ed7-ee25-495b-a2a4-924d830a670a" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:45:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquired lock "refresh_cache-079a5ed7-ee25-495b-a2a4-924d830a670a" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:45:57 user nova-compute[72239]: DEBUG nova.network.neutron [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:45:57 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814757.4066186, 9203aeaf-2ae9-4e28-9741-05d33df6c915 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:45:57 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] VM Resumed (Lifecycle Event)
Jul 31 14:45:57 user nova-compute[72239]: DEBUG nova.compute.manager [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:45:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 14:45:57 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Instance spawned successfully.
Jul 31 14:45:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 14:45:57 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:45:57 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:45:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:45:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:45:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:45:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:45:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:45:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:45:57 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:45:57 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814757.4085612, 9203aeaf-2ae9-4e28-9741-05d33df6c915 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:45:57 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] VM Started (Lifecycle Event)
Jul 31 14:45:57 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:45:57 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:45:57 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:45:57 user nova-compute[72239]: INFO nova.compute.manager [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Took 11.25 seconds to spawn the instance on the hypervisor.
Jul 31 14:45:57 user nova-compute[72239]: DEBUG nova.compute.manager [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:45:57 user nova-compute[72239]: INFO nova.compute.manager [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Took 37.56 seconds to build instance.
Jul 31 14:45:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4c817e27-718d-437b-b17b-119a02706dcb tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 37.664s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:45:57 user nova-compute[72239]: DEBUG nova.network.neutron [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Updating instance_info_cache with network_info: [{"id": "e22b0941-5069-46e7-9722-621a758253f1", "address": "fa:16:3e:5e:88:13", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape22b0941-50", "ovs_interfaceid": "e22b0941-5069-46e7-9722-621a758253f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:45:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Releasing lock "refresh_cache-079a5ed7-ee25-495b-a2a4-924d830a670a" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:45:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:58 user nova-compute[72239]: DEBUG nova.compute.manager [req-0de6d28e-5c91-4961-a1d6-fd62be4e1940 req-d359cfd7-3e26-4cae-950d-ff5b6df024f0 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-vif-plugged-da58ae48-fdc4-4816-a641-525030c3beb2 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:45:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0de6d28e-5c91-4961-a1d6-fd62be4e1940 req-d359cfd7-3e26-4cae-950d-ff5b6df024f0 service nova] Acquiring lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:45:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0de6d28e-5c91-4961-a1d6-fd62be4e1940 req-d359cfd7-3e26-4cae-950d-ff5b6df024f0 service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:45:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0de6d28e-5c91-4961-a1d6-fd62be4e1940 req-d359cfd7-3e26-4cae-950d-ff5b6df024f0 service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:45:58 user nova-compute[72239]: DEBUG nova.compute.manager [req-0de6d28e-5c91-4961-a1d6-fd62be4e1940 req-d359cfd7-3e26-4cae-950d-ff5b6df024f0 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] No waiting events found dispatching network-vif-plugged-da58ae48-fdc4-4816-a641-525030c3beb2 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:45:58 user nova-compute[72239]: WARNING nova.compute.manager [req-0de6d28e-5c91-4961-a1d6-fd62be4e1940 req-d359cfd7-3e26-4cae-950d-ff5b6df024f0 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received unexpected event network-vif-plugged-da58ae48-fdc4-4816-a641-525030c3beb2 for instance with vm_state building and task_state spawning.
Jul 31 14:45:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 14:45:59 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Instance destroyed successfully.
Jul 31 14:45:59 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Attempting rescue
Jul 31 14:45:59 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72239) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG nova.compute.manager [req-a6ed9fb0-00f4-4ae6-bbd1-4dd16340b2e1 req-5689ee81-b34b-4ab9-9f0d-8c2ff93a42b9 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-vif-plugged-57f80e07-cfe0-47a5-9b99-10166cdcf351 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a6ed9fb0-00f4-4ae6-bbd1-4dd16340b2e1 req-5689ee81-b34b-4ab9-9f0d-8c2ff93a42b9 service nova] Acquiring lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a6ed9fb0-00f4-4ae6-bbd1-4dd16340b2e1 req-5689ee81-b34b-4ab9-9f0d-8c2ff93a42b9 service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a6ed9fb0-00f4-4ae6-bbd1-4dd16340b2e1 req-5689ee81-b34b-4ab9-9f0d-8c2ff93a42b9 service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG nova.compute.manager [req-a6ed9fb0-00f4-4ae6-bbd1-4dd16340b2e1 req-5689ee81-b34b-4ab9-9f0d-8c2ff93a42b9 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] No waiting events found dispatching network-vif-plugged-57f80e07-cfe0-47a5-9b99-10166cdcf351 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:45:59 user nova-compute[72239]: WARNING nova.compute.manager [req-a6ed9fb0-00f4-4ae6-bbd1-4dd16340b2e1 req-5689ee81-b34b-4ab9-9f0d-8c2ff93a42b9 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received unexpected event network-vif-plugged-57f80e07-cfe0-47a5-9b99-10166cdcf351 for instance with vm_state building and task_state spawning.
Jul 31 14:45:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Instance directory exists: not creating {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 31 14:45:59 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Creating image(s)
Jul 31 14:45:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "/opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "/opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "/opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG nova.objects.instance [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lazy-loading 'trusted_certs' on Instance uuid 079a5ed7-ee25-495b-a2a4-924d830a670a {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "ca449065000c92aac3b7b9fa685f9a7710929444" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-6716534f-ae47-4b7d-bfd8-10f94ea8a182" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-6716534f-ae47-4b7d-bfd8-10f94ea8a182" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.218s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue" returned: 0 in 0.190s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.413s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG nova.objects.instance [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lazy-loading 'migration_context' on Instance uuid 079a5ed7-ee25-495b-a2a4-924d830a670a {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Start _get_guest_xml network_info=[{"id": "e22b0941-5069-46e7-9722-621a758253f1", "address": "fa:16:3e:5e:88:13", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "vif_mac": "fa:16:3e:5e:88:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape22b0941-50", "ovs_interfaceid": "e22b0941-5069-46e7-9722-621a758253f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG nova.objects.instance [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lazy-loading 'resources' on Instance uuid 079a5ed7-ee25-495b-a2a4-924d830a670a {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG nova.objects.instance [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lazy-loading 'numa_topology' on Instance uuid 079a5ed7-ee25-495b-a2a4-924d830a670a {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:59 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:45:59 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:45:59 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG nova.objects.instance [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lazy-loading 'vcpu_model' on Instance uuid 079a5ed7-ee25-495b-a2a4-924d830a670a {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:44:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1703908301',display_name='tempest-ServerRescueNegativeTestJSON-server-1703908301',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1703908301',id=4,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:44:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='959107d575f04ba2b0ac800ed2ef61fa',ramdisk_id='',reservation_id='r-ay6781r8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1296361049',owner_user_name='tempest-ServerRescueNegativeTestJSON-1296361049-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:44:19Z,user_data=None,user_id='f10fd7b9c1d34ca5b37150f34ea09ffa',uuid=079a5ed7-ee25-495b-a2a4-924d830a670a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e22b0941-5069-46e7-9722-621a758253f1", "address": "fa:16:3e:5e:88:13", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "vif_mac": "fa:16:3e:5e:88:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape22b0941-50", "ovs_interfaceid": "e22b0941-5069-46e7-9722-621a758253f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Converting VIF {"id": "e22b0941-5069-46e7-9722-621a758253f1", "address": "fa:16:3e:5e:88:13", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "vif_mac": "fa:16:3e:5e:88:13"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape22b0941-50", "ovs_interfaceid": "e22b0941-5069-46e7-9722-621a758253f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:88:13,bridge_name='br-int',has_traffic_filtering=True,id=e22b0941-5069-46e7-9722-621a758253f1,network=Network(02dfd673-dd23-4768-9c30-291cdbecbb64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape22b0941-50') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG nova.objects.instance [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lazy-loading 'pci_devices' on Instance uuid 079a5ed7-ee25-495b-a2a4-924d830a670a {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:45:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:46:00 user nova-compute[72239]:   <uuid>079a5ed7-ee25-495b-a2a4-924d830a670a</uuid>
Jul 31 14:46:00 user nova-compute[72239]:   <name>instance-00000004</name>
Jul 31 14:46:00 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:46:00 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:46:00 user nova-compute[72239]:   <metadata>
Jul 31 14:46:00 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:46:00 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:46:00 user nova-compute[72239]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1703908301</nova:name>
Jul 31 14:46:00 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:45:59</nova:creationTime>
Jul 31 14:46:00 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:46:00 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:46:00 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:46:00 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:46:00 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:46:00 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:46:00 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:46:00 user nova-compute[72239]:       <nova:owner>
Jul 31 14:46:00 user nova-compute[72239]:         <nova:user uuid="f10fd7b9c1d34ca5b37150f34ea09ffa">tempest-ServerRescueNegativeTestJSON-1296361049-project-member</nova:user>
Jul 31 14:46:00 user nova-compute[72239]:         <nova:project uuid="959107d575f04ba2b0ac800ed2ef61fa">tempest-ServerRescueNegativeTestJSON-1296361049</nova:project>
Jul 31 14:46:00 user nova-compute[72239]:       </nova:owner>
Jul 31 14:46:00 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:46:00 user nova-compute[72239]:       <nova:ports>
Jul 31 14:46:00 user nova-compute[72239]:         <nova:port uuid="e22b0941-5069-46e7-9722-621a758253f1">
Jul 31 14:46:00 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 31 14:46:00 user nova-compute[72239]:         </nova:port>
Jul 31 14:46:00 user nova-compute[72239]:       </nova:ports>
Jul 31 14:46:00 user nova-compute[72239]:     </nova:instance>
Jul 31 14:46:00 user nova-compute[72239]:   </metadata>
Jul 31 14:46:00 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:46:00 user nova-compute[72239]:     <system>
Jul 31 14:46:00 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:46:00 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:46:00 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:46:00 user nova-compute[72239]:       <entry name="serial">079a5ed7-ee25-495b-a2a4-924d830a670a</entry>
Jul 31 14:46:00 user nova-compute[72239]:       <entry name="uuid">079a5ed7-ee25-495b-a2a4-924d830a670a</entry>
Jul 31 14:46:00 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:46:00 user nova-compute[72239]:     </system>
Jul 31 14:46:00 user nova-compute[72239]:   </sysinfo>
Jul 31 14:46:00 user nova-compute[72239]:   <os>
Jul 31 14:46:00 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:46:00 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:46:00 user nova-compute[72239]:   </os>
Jul 31 14:46:00 user nova-compute[72239]:   <features>
Jul 31 14:46:00 user nova-compute[72239]:     <acpi/>
Jul 31 14:46:00 user nova-compute[72239]:     <apic/>
Jul 31 14:46:00 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:46:00 user nova-compute[72239]:   </features>
Jul 31 14:46:00 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:46:00 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:46:00 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:46:00 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:46:00 user nova-compute[72239]:   </clock>
Jul 31 14:46:00 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:46:00 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:46:00 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:46:00 user nova-compute[72239]:   </cpu>
Jul 31 14:46:00 user nova-compute[72239]:   <devices>
Jul 31 14:46:00 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:46:00 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:46:00 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue"/>
Jul 31 14:46:00 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:46:00 user nova-compute[72239]:     </disk>
Jul 31 14:46:00 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:46:00 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:46:00 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk"/>
Jul 31 14:46:00 user nova-compute[72239]:       <target dev="vdb" bus="virtio"/>
Jul 31 14:46:00 user nova-compute[72239]:     </disk>
Jul 31 14:46:00 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:46:00 user nova-compute[72239]:       <mac address="fa:16:3e:5e:88:13"/>
Jul 31 14:46:00 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:46:00 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:46:00 user nova-compute[72239]:       <target dev="tape22b0941-50"/>
Jul 31 14:46:00 user nova-compute[72239]:     </interface>
Jul 31 14:46:00 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:46:00 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/console.log" append="off"/>
Jul 31 14:46:00 user nova-compute[72239]:     </serial>
Jul 31 14:46:00 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:46:00 user nova-compute[72239]:     <video>
Jul 31 14:46:00 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:46:00 user nova-compute[72239]:     </video>
Jul 31 14:46:00 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:46:00 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:46:00 user nova-compute[72239]:     </rng>
Jul 31 14:46:00 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:46:00 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:46:00 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:46:00 user nova-compute[72239]:     </memballoon>
Jul 31 14:46:00 user nova-compute[72239]:   </devices>
Jul 31 14:46:00 user nova-compute[72239]: </domain>
Jul 31 14:46:00 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG nova.compute.manager [req-be16bce4-a78c-4fe5-bc4f-2ef47cc13e33 req-2258d907-3484-4151-a9bb-e38110b13a90 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-vif-plugged-01e36afb-4b92-42af-a2da-900e447e474e {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-be16bce4-a78c-4fe5-bc4f-2ef47cc13e33 req-2258d907-3484-4151-a9bb-e38110b13a90 service nova] Acquiring lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-be16bce4-a78c-4fe5-bc4f-2ef47cc13e33 req-2258d907-3484-4151-a9bb-e38110b13a90 service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-be16bce4-a78c-4fe5-bc4f-2ef47cc13e33 req-2258d907-3484-4151-a9bb-e38110b13a90 service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG nova.compute.manager [req-be16bce4-a78c-4fe5-bc4f-2ef47cc13e33 req-2258d907-3484-4151-a9bb-e38110b13a90 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] No waiting events found dispatching network-vif-plugged-01e36afb-4b92-42af-a2da-900e447e474e {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:46:00 user nova-compute[72239]: WARNING nova.compute.manager [req-be16bce4-a78c-4fe5-bc4f-2ef47cc13e33 req-2258d907-3484-4151-a9bb-e38110b13a90 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received unexpected event network-vif-plugged-01e36afb-4b92-42af-a2da-900e447e474e for instance with vm_state building and task_state spawning.
Jul 31 14:46:00 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:00 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Instance destroyed successfully.
Jul 31 14:46:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] No VIF found with MAC fa:16:3e:5e:88:13, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG nova.compute.manager [req-72ccfb8f-bb12-4603-b2c7-510434515f25 req-ff1148a2-bfc3-42a6-bc24-e3cdfa44c510 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-vif-plugged-da58ae48-fdc4-4816-a641-525030c3beb2 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-72ccfb8f-bb12-4603-b2c7-510434515f25 req-ff1148a2-bfc3-42a6-bc24-e3cdfa44c510 service nova] Acquiring lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-72ccfb8f-bb12-4603-b2c7-510434515f25 req-ff1148a2-bfc3-42a6-bc24-e3cdfa44c510 service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-72ccfb8f-bb12-4603-b2c7-510434515f25 req-ff1148a2-bfc3-42a6-bc24-e3cdfa44c510 service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG nova.compute.manager [req-72ccfb8f-bb12-4603-b2c7-510434515f25 req-ff1148a2-bfc3-42a6-bc24-e3cdfa44c510 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] No waiting events found dispatching network-vif-plugged-da58ae48-fdc4-4816-a641-525030c3beb2 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:46:00 user nova-compute[72239]: WARNING nova.compute.manager [req-72ccfb8f-bb12-4603-b2c7-510434515f25 req-ff1148a2-bfc3-42a6-bc24-e3cdfa44c510 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received unexpected event network-vif-plugged-da58ae48-fdc4-4816-a641-525030c3beb2 for instance with vm_state building and task_state spawning.
Jul 31 14:46:00 user nova-compute[72239]: DEBUG nova.compute.manager [req-72ccfb8f-bb12-4603-b2c7-510434515f25 req-ff1148a2-bfc3-42a6-bc24-e3cdfa44c510 service nova] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Received event network-vif-unplugged-e22b0941-5069-46e7-9722-621a758253f1 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-72ccfb8f-bb12-4603-b2c7-510434515f25 req-ff1148a2-bfc3-42a6-bc24-e3cdfa44c510 service nova] Acquiring lock "079a5ed7-ee25-495b-a2a4-924d830a670a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-72ccfb8f-bb12-4603-b2c7-510434515f25 req-ff1148a2-bfc3-42a6-bc24-e3cdfa44c510 service nova] Lock "079a5ed7-ee25-495b-a2a4-924d830a670a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-72ccfb8f-bb12-4603-b2c7-510434515f25 req-ff1148a2-bfc3-42a6-bc24-e3cdfa44c510 service nova] Lock "079a5ed7-ee25-495b-a2a4-924d830a670a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG nova.compute.manager [req-72ccfb8f-bb12-4603-b2c7-510434515f25 req-ff1148a2-bfc3-42a6-bc24-e3cdfa44c510 service nova] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] No waiting events found dispatching network-vif-unplugged-e22b0941-5069-46e7-9722-621a758253f1 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:46:00 user nova-compute[72239]: WARNING nova.compute.manager [req-72ccfb8f-bb12-4603-b2c7-510434515f25 req-ff1148a2-bfc3-42a6-bc24-e3cdfa44c510 service nova] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Received unexpected event network-vif-unplugged-e22b0941-5069-46e7-9722-621a758253f1 for instance with vm_state active and task_state rescuing.
Jul 31 14:46:00 user nova-compute[72239]: DEBUG nova.compute.manager [req-72ccfb8f-bb12-4603-b2c7-510434515f25 req-ff1148a2-bfc3-42a6-bc24-e3cdfa44c510 service nova] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Received event network-vif-plugged-e22b0941-5069-46e7-9722-621a758253f1 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-72ccfb8f-bb12-4603-b2c7-510434515f25 req-ff1148a2-bfc3-42a6-bc24-e3cdfa44c510 service nova] Acquiring lock "079a5ed7-ee25-495b-a2a4-924d830a670a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-72ccfb8f-bb12-4603-b2c7-510434515f25 req-ff1148a2-bfc3-42a6-bc24-e3cdfa44c510 service nova] Lock "079a5ed7-ee25-495b-a2a4-924d830a670a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-72ccfb8f-bb12-4603-b2c7-510434515f25 req-ff1148a2-bfc3-42a6-bc24-e3cdfa44c510 service nova] Lock "079a5ed7-ee25-495b-a2a4-924d830a670a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG nova.compute.manager [req-72ccfb8f-bb12-4603-b2c7-510434515f25 req-ff1148a2-bfc3-42a6-bc24-e3cdfa44c510 service nova] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] No waiting events found dispatching network-vif-plugged-e22b0941-5069-46e7-9722-621a758253f1 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:46:00 user nova-compute[72239]: WARNING nova.compute.manager [req-72ccfb8f-bb12-4603-b2c7-510434515f25 req-ff1148a2-bfc3-42a6-bc24-e3cdfa44c510 service nova] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Received unexpected event network-vif-plugged-e22b0941-5069-46e7-9722-621a758253f1 for instance with vm_state active and task_state rescuing.
Jul 31 14:46:00 user nova-compute[72239]: DEBUG nova.compute.manager [req-72ccfb8f-bb12-4603-b2c7-510434515f25 req-ff1148a2-bfc3-42a6-bc24-e3cdfa44c510 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-vif-plugged-403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-72ccfb8f-bb12-4603-b2c7-510434515f25 req-ff1148a2-bfc3-42a6-bc24-e3cdfa44c510 service nova] Acquiring lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-72ccfb8f-bb12-4603-b2c7-510434515f25 req-ff1148a2-bfc3-42a6-bc24-e3cdfa44c510 service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-72ccfb8f-bb12-4603-b2c7-510434515f25 req-ff1148a2-bfc3-42a6-bc24-e3cdfa44c510 service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG nova.compute.manager [req-72ccfb8f-bb12-4603-b2c7-510434515f25 req-ff1148a2-bfc3-42a6-bc24-e3cdfa44c510 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] No waiting events found dispatching network-vif-plugged-403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:46:00 user nova-compute[72239]: WARNING nova.compute.manager [req-72ccfb8f-bb12-4603-b2c7-510434515f25 req-ff1148a2-bfc3-42a6-bc24-e3cdfa44c510 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received unexpected event network-vif-plugged-403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd for instance with vm_state building and task_state spawning.
Jul 31 14:46:00 user nova-compute[72239]: DEBUG nova.compute.manager [req-72ccfb8f-bb12-4603-b2c7-510434515f25 req-ff1148a2-bfc3-42a6-bc24-e3cdfa44c510 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-vif-plugged-403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-72ccfb8f-bb12-4603-b2c7-510434515f25 req-ff1148a2-bfc3-42a6-bc24-e3cdfa44c510 service nova] Acquiring lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-72ccfb8f-bb12-4603-b2c7-510434515f25 req-ff1148a2-bfc3-42a6-bc24-e3cdfa44c510 service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-72ccfb8f-bb12-4603-b2c7-510434515f25 req-ff1148a2-bfc3-42a6-bc24-e3cdfa44c510 service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG nova.compute.manager [req-72ccfb8f-bb12-4603-b2c7-510434515f25 req-ff1148a2-bfc3-42a6-bc24-e3cdfa44c510 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] No waiting events found dispatching network-vif-plugged-403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:46:00 user nova-compute[72239]: WARNING nova.compute.manager [req-72ccfb8f-bb12-4603-b2c7-510434515f25 req-ff1148a2-bfc3-42a6-bc24-e3cdfa44c510 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received unexpected event network-vif-plugged-403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd for instance with vm_state building and task_state spawning.
Jul 31 14:46:00 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Updating instance_info_cache with network_info: [{"id": "5606e369-50ff-4ebd-a3a4-7da83520dd63", "address": "fa:16:3e:7d:f8:d4", "network": {"id": "4b1e409d-af08-43b1-a228-04a24d8352f5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-720428295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ffc3a1968554e5fa9550a9f4c37735d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5606e369-50", "ovs_interfaceid": "5606e369-50ff-4ebd-a3a4-7da83520dd63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-6716534f-ae47-4b7d-bfd8-10f94ea8a182" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 14:46:00 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:01 user nova-compute[72239]: DEBUG nova.compute.manager [req-91fd94ab-7b01-44cb-9a0a-a2c0d7b399b6 req-2f4c9eab-9930-44e5-a069-10621a564180 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-vif-plugged-57f80e07-cfe0-47a5-9b99-10166cdcf351 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:46:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-91fd94ab-7b01-44cb-9a0a-a2c0d7b399b6 req-2f4c9eab-9930-44e5-a069-10621a564180 service nova] Acquiring lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-91fd94ab-7b01-44cb-9a0a-a2c0d7b399b6 req-2f4c9eab-9930-44e5-a069-10621a564180 service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-91fd94ab-7b01-44cb-9a0a-a2c0d7b399b6 req-2f4c9eab-9930-44e5-a069-10621a564180 service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:01 user nova-compute[72239]: DEBUG nova.compute.manager [req-91fd94ab-7b01-44cb-9a0a-a2c0d7b399b6 req-2f4c9eab-9930-44e5-a069-10621a564180 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] No waiting events found dispatching network-vif-plugged-57f80e07-cfe0-47a5-9b99-10166cdcf351 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:46:01 user nova-compute[72239]: WARNING nova.compute.manager [req-91fd94ab-7b01-44cb-9a0a-a2c0d7b399b6 req-2f4c9eab-9930-44e5-a069-10621a564180 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received unexpected event network-vif-plugged-57f80e07-cfe0-47a5-9b99-10166cdcf351 for instance with vm_state building and task_state spawning.
Jul 31 14:46:01 user nova-compute[72239]: DEBUG nova.compute.manager [req-91fd94ab-7b01-44cb-9a0a-a2c0d7b399b6 req-2f4c9eab-9930-44e5-a069-10621a564180 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-vif-plugged-c330e2c1-2507-406a-b255-6e72d82c689e {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:46:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-91fd94ab-7b01-44cb-9a0a-a2c0d7b399b6 req-2f4c9eab-9930-44e5-a069-10621a564180 service nova] Acquiring lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-91fd94ab-7b01-44cb-9a0a-a2c0d7b399b6 req-2f4c9eab-9930-44e5-a069-10621a564180 service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-91fd94ab-7b01-44cb-9a0a-a2c0d7b399b6 req-2f4c9eab-9930-44e5-a069-10621a564180 service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:01 user nova-compute[72239]: DEBUG nova.compute.manager [req-91fd94ab-7b01-44cb-9a0a-a2c0d7b399b6 req-2f4c9eab-9930-44e5-a069-10621a564180 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] No waiting events found dispatching network-vif-plugged-c330e2c1-2507-406a-b255-6e72d82c689e {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:46:01 user nova-compute[72239]: WARNING nova.compute.manager [req-91fd94ab-7b01-44cb-9a0a-a2c0d7b399b6 req-2f4c9eab-9930-44e5-a069-10621a564180 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received unexpected event network-vif-plugged-c330e2c1-2507-406a-b255-6e72d82c689e for instance with vm_state building and task_state spawning.
Jul 31 14:46:01 user nova-compute[72239]: DEBUG nova.compute.manager [req-91fd94ab-7b01-44cb-9a0a-a2c0d7b399b6 req-2f4c9eab-9930-44e5-a069-10621a564180 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-vif-plugged-c330e2c1-2507-406a-b255-6e72d82c689e {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:46:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-91fd94ab-7b01-44cb-9a0a-a2c0d7b399b6 req-2f4c9eab-9930-44e5-a069-10621a564180 service nova] Acquiring lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-91fd94ab-7b01-44cb-9a0a-a2c0d7b399b6 req-2f4c9eab-9930-44e5-a069-10621a564180 service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-91fd94ab-7b01-44cb-9a0a-a2c0d7b399b6 req-2f4c9eab-9930-44e5-a069-10621a564180 service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:01 user nova-compute[72239]: DEBUG nova.compute.manager [req-91fd94ab-7b01-44cb-9a0a-a2c0d7b399b6 req-2f4c9eab-9930-44e5-a069-10621a564180 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] No waiting events found dispatching network-vif-plugged-c330e2c1-2507-406a-b255-6e72d82c689e {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:46:01 user nova-compute[72239]: WARNING nova.compute.manager [req-91fd94ab-7b01-44cb-9a0a-a2c0d7b399b6 req-2f4c9eab-9930-44e5-a069-10621a564180 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received unexpected event network-vif-plugged-c330e2c1-2507-406a-b255-6e72d82c689e for instance with vm_state building and task_state spawning.
Jul 31 14:46:01 user nova-compute[72239]: DEBUG nova.compute.manager [req-91fd94ab-7b01-44cb-9a0a-a2c0d7b399b6 req-2f4c9eab-9930-44e5-a069-10621a564180 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-vif-plugged-6fba6d4e-0137-4514-9525-29e86356c1eb {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:46:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-91fd94ab-7b01-44cb-9a0a-a2c0d7b399b6 req-2f4c9eab-9930-44e5-a069-10621a564180 service nova] Acquiring lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-91fd94ab-7b01-44cb-9a0a-a2c0d7b399b6 req-2f4c9eab-9930-44e5-a069-10621a564180 service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-91fd94ab-7b01-44cb-9a0a-a2c0d7b399b6 req-2f4c9eab-9930-44e5-a069-10621a564180 service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:01 user nova-compute[72239]: DEBUG nova.compute.manager [req-91fd94ab-7b01-44cb-9a0a-a2c0d7b399b6 req-2f4c9eab-9930-44e5-a069-10621a564180 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] No waiting events found dispatching network-vif-plugged-6fba6d4e-0137-4514-9525-29e86356c1eb {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:46:01 user nova-compute[72239]: WARNING nova.compute.manager [req-91fd94ab-7b01-44cb-9a0a-a2c0d7b399b6 req-2f4c9eab-9930-44e5-a069-10621a564180 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received unexpected event network-vif-plugged-6fba6d4e-0137-4514-9525-29e86356c1eb for instance with vm_state building and task_state spawning.
Jul 31 14:46:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:02 user nova-compute[72239]: DEBUG nova.compute.manager [req-08309c35-46ac-4b46-a998-b62d02e79cef req-1cc8949b-5e22-4efd-95b6-68d0fcd8b06e service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-vif-plugged-01e36afb-4b92-42af-a2da-900e447e474e {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:46:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-08309c35-46ac-4b46-a998-b62d02e79cef req-1cc8949b-5e22-4efd-95b6-68d0fcd8b06e service nova] Acquiring lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-08309c35-46ac-4b46-a998-b62d02e79cef req-1cc8949b-5e22-4efd-95b6-68d0fcd8b06e service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-08309c35-46ac-4b46-a998-b62d02e79cef req-1cc8949b-5e22-4efd-95b6-68d0fcd8b06e service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:02 user nova-compute[72239]: DEBUG nova.compute.manager [req-08309c35-46ac-4b46-a998-b62d02e79cef req-1cc8949b-5e22-4efd-95b6-68d0fcd8b06e service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] No waiting events found dispatching network-vif-plugged-01e36afb-4b92-42af-a2da-900e447e474e {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:46:02 user nova-compute[72239]: WARNING nova.compute.manager [req-08309c35-46ac-4b46-a998-b62d02e79cef req-1cc8949b-5e22-4efd-95b6-68d0fcd8b06e service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received unexpected event network-vif-plugged-01e36afb-4b92-42af-a2da-900e447e474e for instance with vm_state building and task_state spawning.
Jul 31 14:46:02 user nova-compute[72239]: DEBUG nova.compute.manager [req-08309c35-46ac-4b46-a998-b62d02e79cef req-1cc8949b-5e22-4efd-95b6-68d0fcd8b06e service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-vif-plugged-87d5bb80-ad2c-4137-89f2-03bc494de37d {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:46:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-08309c35-46ac-4b46-a998-b62d02e79cef req-1cc8949b-5e22-4efd-95b6-68d0fcd8b06e service nova] Acquiring lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-08309c35-46ac-4b46-a998-b62d02e79cef req-1cc8949b-5e22-4efd-95b6-68d0fcd8b06e service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-08309c35-46ac-4b46-a998-b62d02e79cef req-1cc8949b-5e22-4efd-95b6-68d0fcd8b06e service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:02 user nova-compute[72239]: DEBUG nova.compute.manager [req-08309c35-46ac-4b46-a998-b62d02e79cef req-1cc8949b-5e22-4efd-95b6-68d0fcd8b06e service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] No waiting events found dispatching network-vif-plugged-87d5bb80-ad2c-4137-89f2-03bc494de37d {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:46:02 user nova-compute[72239]: WARNING nova.compute.manager [req-08309c35-46ac-4b46-a998-b62d02e79cef req-1cc8949b-5e22-4efd-95b6-68d0fcd8b06e service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received unexpected event network-vif-plugged-87d5bb80-ad2c-4137-89f2-03bc494de37d for instance with vm_state building and task_state spawning.
Jul 31 14:46:02 user nova-compute[72239]: DEBUG nova.compute.manager [req-08309c35-46ac-4b46-a998-b62d02e79cef req-1cc8949b-5e22-4efd-95b6-68d0fcd8b06e service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-vif-plugged-87d5bb80-ad2c-4137-89f2-03bc494de37d {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:46:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-08309c35-46ac-4b46-a998-b62d02e79cef req-1cc8949b-5e22-4efd-95b6-68d0fcd8b06e service nova] Acquiring lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-08309c35-46ac-4b46-a998-b62d02e79cef req-1cc8949b-5e22-4efd-95b6-68d0fcd8b06e service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-08309c35-46ac-4b46-a998-b62d02e79cef req-1cc8949b-5e22-4efd-95b6-68d0fcd8b06e service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:02 user nova-compute[72239]: DEBUG nova.compute.manager [req-08309c35-46ac-4b46-a998-b62d02e79cef req-1cc8949b-5e22-4efd-95b6-68d0fcd8b06e service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] No waiting events found dispatching network-vif-plugged-87d5bb80-ad2c-4137-89f2-03bc494de37d {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:46:02 user nova-compute[72239]: WARNING nova.compute.manager [req-08309c35-46ac-4b46-a998-b62d02e79cef req-1cc8949b-5e22-4efd-95b6-68d0fcd8b06e service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received unexpected event network-vif-plugged-87d5bb80-ad2c-4137-89f2-03bc494de37d for instance with vm_state building and task_state spawning.
Jul 31 14:46:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:02 user nova-compute[72239]: DEBUG nova.compute.manager [req-ce5783e2-04d3-420b-92d4-bb993c0001a4 req-c270bb05-0d6b-43f4-bc7a-94767681c025 service nova] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Received event network-vif-plugged-e22b0941-5069-46e7-9722-621a758253f1 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:46:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ce5783e2-04d3-420b-92d4-bb993c0001a4 req-c270bb05-0d6b-43f4-bc7a-94767681c025 service nova] Acquiring lock "079a5ed7-ee25-495b-a2a4-924d830a670a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ce5783e2-04d3-420b-92d4-bb993c0001a4 req-c270bb05-0d6b-43f4-bc7a-94767681c025 service nova] Lock "079a5ed7-ee25-495b-a2a4-924d830a670a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ce5783e2-04d3-420b-92d4-bb993c0001a4 req-c270bb05-0d6b-43f4-bc7a-94767681c025 service nova] Lock "079a5ed7-ee25-495b-a2a4-924d830a670a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:02 user nova-compute[72239]: DEBUG nova.compute.manager [req-ce5783e2-04d3-420b-92d4-bb993c0001a4 req-c270bb05-0d6b-43f4-bc7a-94767681c025 service nova] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] No waiting events found dispatching network-vif-plugged-e22b0941-5069-46e7-9722-621a758253f1 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:46:02 user nova-compute[72239]: WARNING nova.compute.manager [req-ce5783e2-04d3-420b-92d4-bb993c0001a4 req-c270bb05-0d6b-43f4-bc7a-94767681c025 service nova] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Received unexpected event network-vif-plugged-e22b0941-5069-46e7-9722-621a758253f1 for instance with vm_state active and task_state rescuing.
Jul 31 14:46:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f011c736-1a43-4b0e-ac7c-d512bcaa9bdc/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f011c736-1a43-4b0e-ac7c-d512bcaa9bdc/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f011c736-1a43-4b0e-ac7c-d512bcaa9bdc/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKXUYkRl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:46:03 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:46:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:46:03 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:46:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:46:03 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700 -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[899cab06-2644-4c2c-ab53-8d6f3ab78d5d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 14:46:03 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700 -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdc0a98-eaad-4fee-bd09-14f05d6fdcaa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700] added
Jul 31 14:46:03 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f011c736-1a43-4b0e-ac7c-d512bcaa9bdc/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b4c956-db2b-4603-b191-30597c53f9e6]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG nova.compute.manager [req-aa74bd76-dc75-43de-8c77-f695be96ed29 req-1213db35-2d51-4be1-9962-6222c18b00eb service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-vif-plugged-6fba6d4e-0137-4514-9525-29e86356c1eb {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-aa74bd76-dc75-43de-8c77-f695be96ed29 req-1213db35-2d51-4be1-9962-6222c18b00eb service nova] Acquiring lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-aa74bd76-dc75-43de-8c77-f695be96ed29 req-1213db35-2d51-4be1-9962-6222c18b00eb service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-aa74bd76-dc75-43de-8c77-f695be96ed29 req-1213db35-2d51-4be1-9962-6222c18b00eb service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG nova.compute.manager [req-aa74bd76-dc75-43de-8c77-f695be96ed29 req-1213db35-2d51-4be1-9962-6222c18b00eb service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] No waiting events found dispatching network-vif-plugged-6fba6d4e-0137-4514-9525-29e86356c1eb {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:46:03 user nova-compute[72239]: WARNING nova.compute.manager [req-aa74bd76-dc75-43de-8c77-f695be96ed29 req-1213db35-2d51-4be1-9962-6222c18b00eb service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received unexpected event network-vif-plugged-6fba6d4e-0137-4514-9525-29e86356c1eb for instance with vm_state building and task_state spawning.
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d91609-7443-440b-a4cc-0dc234ccaa14]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jKXUYkRl {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jKXUYkRl" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ed9028-5e46-406f-9ee3-ad8f3e9df1ac]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jKXUYkRl'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f1e037-a5c4-407f-ba5c-c562c2bb7714]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8889c01b-59e2-479b-9e19-ff7a2fcf6d57]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:46:03 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:46:03 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:46:03 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:46:03 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:46:03 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:46:03 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:46:03 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:46:03 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:46:03 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:46:03 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:46:03 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:46:03 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700 -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6892ae8-c407-40b3-bb17-da591e1140a1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700, portal: 172.16.0.220,3260]
Jul 31 14:46:03 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700, portal: 172.16.0.220,3260] successful.
Jul 31 14:46:03 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[561a3114-8e0c-474c-a73a-59c66cd9b5e8]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c8d04a-1369-4960-8df9-68899f91f5bd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:46:03 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:46:03 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:46:03 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:46:03 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:46:03 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:46:03 user nova-compute[72239]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700 (non-flash)
Jul 31 14:46:03 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:46:03 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:46:03 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:46:03 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:46:03 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:46:03 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:46:03 user nova-compute[72239]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700 (non-flash)
Jul 31 14:46:03 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.365s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] HCTL ('39', '-', '-', 0) found on session 8 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf589a19-1499-4e89-a7ee-ac06a523a2fb]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Searching for a device in session 8 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKXUYkRl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814764.0894287, 6258dba2-2e73-45d7-99f0-9a4af065ffcc => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:46:04 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] VM Resumed (Lifecycle Event)
Jul 31 14:46:04 user nova-compute[72239]: DEBUG nova.compute.manager [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:46:04 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Instance spawned successfully.
Jul 31 14:46:04 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:46:04 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:46:04 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814764.102702, 6258dba2-2e73-45d7-99f0-9a4af065ffcc => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:46:04 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] VM Started (Lifecycle Event)
Jul 31 14:46:04 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:04 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:46:04 user nova-compute[72239]: INFO nova.compute.manager [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Took 14.09 seconds to spawn the instance on the hypervisor.
Jul 31 14:46:04 user nova-compute[72239]: DEBUG nova.compute.manager [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:04 user nova-compute[72239]: INFO nova.compute.manager [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Took 38.38 seconds to build instance.
Jul 31 14:46:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a1256a7c-70fc-49e2-b949-839ee3627b73 tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 38.495s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG nova.compute.manager [req-f6bb77ac-c0b8-476b-bd5b-79358a2ab8de req-a125d732-45a7-4d1d-b51f-1d05107be422 service nova] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Received event network-vif-plugged-e22b0941-5069-46e7-9722-621a758253f1 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-f6bb77ac-c0b8-476b-bd5b-79358a2ab8de req-a125d732-45a7-4d1d-b51f-1d05107be422 service nova] Acquiring lock "079a5ed7-ee25-495b-a2a4-924d830a670a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-f6bb77ac-c0b8-476b-bd5b-79358a2ab8de req-a125d732-45a7-4d1d-b51f-1d05107be422 service nova] Lock "079a5ed7-ee25-495b-a2a4-924d830a670a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-f6bb77ac-c0b8-476b-bd5b-79358a2ab8de req-a125d732-45a7-4d1d-b51f-1d05107be422 service nova] Lock "079a5ed7-ee25-495b-a2a4-924d830a670a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG nova.compute.manager [req-f6bb77ac-c0b8-476b-bd5b-79358a2ab8de req-a125d732-45a7-4d1d-b51f-1d05107be422 service nova] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] No waiting events found dispatching network-vif-plugged-e22b0941-5069-46e7-9722-621a758253f1 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:46:04 user nova-compute[72239]: WARNING nova.compute.manager [req-f6bb77ac-c0b8-476b-bd5b-79358a2ab8de req-a125d732-45a7-4d1d-b51f-1d05107be422 service nova] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Received unexpected event network-vif-plugged-e22b0941-5069-46e7-9722-621a758253f1 for instance with vm_state active and task_state rescuing.
Jul 31 14:46:04 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Removed pending event for 079a5ed7-ee25-495b-a2a4-924d830a670a due to event {{(pid=72239) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814764.5182197, 079a5ed7-ee25-495b-a2a4-924d830a670a => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:46:04 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] VM Resumed (Lifecycle Event)
Jul 31 14:46:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG nova.compute.manager [None req-ffca5c84-987d-4024-a239-35747779c625 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:46:04 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 31 14:46:04 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814764.520451, 079a5ed7-ee25-495b-a2a4-924d830a670a => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:46:04 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] VM Started (Lifecycle Event)
Jul 31 14:46:04 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6716534f-ae47-4b7d-bfd8-10f94ea8a182/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.448s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] <== connect_volume: return (1452ms) {'type': 'block', 'scsi_wwn': '23334356536353732', 'path': '/dev/sdh'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334356536353732', 'path': '/dev/sdh'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG nova.objects.instance [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Lazy-loading 'flavor' on Instance uuid 6716534f-ae47-4b7d-bfd8-10f94ea8a182 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6716534f-ae47-4b7d-bfd8-10f94ea8a182/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6716534f-ae47-4b7d-bfd8-10f94ea8a182/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:04 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 14:46:04 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:46:04 user nova-compute[72239]:   <source dev="/dev/sdh"/>
Jul 31 14:46:04 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:46:04 user nova-compute[72239]:   <serial>216c5321-d877-48e1-9b2d-bfe47ab51700</serial>
Jul 31 14:46:04 user nova-compute[72239]: </disk>
Jul 31 14:46:04 user nova-compute[72239]:  {{(pid=72239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 14:46:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6716534f-ae47-4b7d-bfd8-10f94ea8a182/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62122879-2a72-4ddf-a028-317eda0da465/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:46:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:46:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] No VIF found with MAC fa:16:3e:7d:f8:d4, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:46:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62122879-2a72-4ddf-a028-317eda0da465/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62122879-2a72-4ddf-a028-317eda0da465/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5114bc4c-5920-4197-b63e-92fae40a116f tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Lock "6716534f-ae47-4b7d-bfd8-10f94ea8a182" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.278s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62122879-2a72-4ddf-a028-317eda0da465/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c244056f-d17d-4d92-98bb-7c0de6a4d261/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Acquiring lock "6716534f-ae47-4b7d-bfd8-10f94ea8a182" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Lock "6716534f-ae47-4b7d-bfd8-10f94ea8a182" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Acquiring lock "6716534f-ae47-4b7d-bfd8-10f94ea8a182-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Lock "6716534f-ae47-4b7d-bfd8-10f94ea8a182-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Lock "6716534f-ae47-4b7d-bfd8-10f94ea8a182-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:06 user nova-compute[72239]: INFO nova.compute.manager [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Terminating instance
Jul 31 14:46:06 user nova-compute[72239]: DEBUG nova.compute.manager [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 14:46:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c244056f-d17d-4d92-98bb-7c0de6a4d261/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c244056f-d17d-4d92-98bb-7c0de6a4d261/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:06 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:06 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:06 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c244056f-d17d-4d92-98bb-7c0de6a4d261/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:06 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG nova.compute.manager [req-6fa57801-6439-43e2-962b-35f1f9f54421 req-a7b993c2-8c8b-4944-bb31-58a81ecf8aa8 service nova] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Received event network-vif-unplugged-5606e369-50ff-4ebd-a3a4-7da83520dd63 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-6fa57801-6439-43e2-962b-35f1f9f54421 req-a7b993c2-8c8b-4944-bb31-58a81ecf8aa8 service nova] Acquiring lock "6716534f-ae47-4b7d-bfd8-10f94ea8a182-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-6fa57801-6439-43e2-962b-35f1f9f54421 req-a7b993c2-8c8b-4944-bb31-58a81ecf8aa8 service nova] Lock "6716534f-ae47-4b7d-bfd8-10f94ea8a182-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-6fa57801-6439-43e2-962b-35f1f9f54421 req-a7b993c2-8c8b-4944-bb31-58a81ecf8aa8 service nova] Lock "6716534f-ae47-4b7d-bfd8-10f94ea8a182-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG nova.compute.manager [req-6fa57801-6439-43e2-962b-35f1f9f54421 req-a7b993c2-8c8b-4944-bb31-58a81ecf8aa8 service nova] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] No waiting events found dispatching network-vif-unplugged-5606e369-50ff-4ebd-a3a4-7da83520dd63 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG nova.compute.manager [req-6fa57801-6439-43e2-962b-35f1f9f54421 req-a7b993c2-8c8b-4944-bb31-58a81ecf8aa8 service nova] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Received event network-vif-unplugged-5606e369-50ff-4ebd-a3a4-7da83520dd63 for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG nova.compute.manager [req-e09f62b7-0746-4343-be10-14e361800461 req-04f6a9e3-ae40-4be4-a66a-ae98244b6bf0 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Received event network-changed-d6ef6541-6b7e-4dc5-8149-a10940dfe87b {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG nova.compute.manager [req-e09f62b7-0746-4343-be10-14e361800461 req-04f6a9e3-ae40-4be4-a66a-ae98244b6bf0 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Refreshing instance network info cache due to event network-changed-d6ef6541-6b7e-4dc5-8149-a10940dfe87b. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e09f62b7-0746-4343-be10-14e361800461 req-04f6a9e3-ae40-4be4-a66a-ae98244b6bf0 service nova] Acquiring lock "refresh_cache-d3e3612b-c6b9-4308-a45a-1ff3805e18bb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e09f62b7-0746-4343-be10-14e361800461 req-04f6a9e3-ae40-4be4-a66a-ae98244b6bf0 service nova] Acquired lock "refresh_cache-d3e3612b-c6b9-4308-a45a-1ff3805e18bb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG nova.network.neutron [req-e09f62b7-0746-4343-be10-14e361800461 req-04f6a9e3-ae40-4be4-a66a-ae98244b6bf0 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Refreshing network info cache for port d6ef6541-6b7e-4dc5-8149-a10940dfe87b {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:46:08 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Instance destroyed successfully.
Jul 31 14:46:08 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:46:08 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:46:08 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=6708MB free_disk=25.490116119384766GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG nova.objects.instance [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Lazy-loading 'resources' on Instance uuid 6716534f-ae47-4b7d-bfd8-10f94ea8a182 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:43:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-212184800',display_name='tempest-DeleteServersTestJSON-server-212184800',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-212184800',id=2,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:44:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5ffc3a1968554e5fa9550a9f4c37735d',ramdisk_id='',reservation_id='r-dvkl0t6j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1110151379',owner_user_name='tempest-DeleteServersTestJSON-1110151379-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:44:19Z,user_data=None,user_id='91360d7bd8654fe0ac076a96300cdd42',uuid=6716534f-ae47-4b7d-bfd8-10f94ea8a182,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5606e369-50ff-4ebd-a3a4-7da83520dd63", "address": "fa:16:3e:7d:f8:d4", "network": {"id": "4b1e409d-af08-43b1-a228-04a24d8352f5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-720428295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ffc3a1968554e5fa9550a9f4c37735d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5606e369-50", "ovs_interfaceid": "5606e369-50ff-4ebd-a3a4-7da83520dd63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Converting VIF {"id": "5606e369-50ff-4ebd-a3a4-7da83520dd63", "address": "fa:16:3e:7d:f8:d4", "network": {"id": "4b1e409d-af08-43b1-a228-04a24d8352f5", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-720428295-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5ffc3a1968554e5fa9550a9f4c37735d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5606e369-50", "ovs_interfaceid": "5606e369-50ff-4ebd-a3a4-7da83520dd63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:f8:d4,bridge_name='br-int',has_traffic_filtering=True,id=5606e369-50ff-4ebd-a3a4-7da83520dd63,network=Network(4b1e409d-af08-43b1-a228-04a24d8352f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5606e369-50') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG os_vif [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:f8:d4,bridge_name='br-int',has_traffic_filtering=True,id=5606e369-50ff-4ebd-a3a4-7da83520dd63,network=Network(4b1e409d-af08-43b1-a228-04a24d8352f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5606e369-50') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5606e369-50, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:46:08 user nova-compute[72239]: INFO os_vif [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:f8:d4,bridge_name='br-int',has_traffic_filtering=True,id=5606e369-50ff-4ebd-a3a4-7da83520dd63,network=Network(4b1e409d-af08-43b1-a228-04a24d8352f5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5606e369-50')
Jul 31 14:46:08 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKXUYkRl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:46:08 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:46:08 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6127fe-1245-4de6-bd22-26e96a284eee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac93c81-d48e-4aca-8b3f-da84fe376aa6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:46:08 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:46:08 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:46:08 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:46:08 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:46:08 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:46:08 user nova-compute[72239]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700 (non-flash)
Jul 31 14:46:08 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:46:08 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:46:08 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:46:08 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:46:08 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:46:08 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:46:08 user nova-compute[72239]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700 (non-flash)
Jul 31 14:46:08 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f412044bc70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700'): ({'sdh'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Removing single pathed devices sdh {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b3b4af-ba3d-416a-a246-1d4458ad8917]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea34114e-79f8-4fdf-bcfb-7b4dba273b34]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Flushing IO for device /dev/sdh {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0de03d7-5b36-49c1-ad07-d8271cc11ba5]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 20abf743-de5b-4122-aad0-e2124c7804b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 6716534f-ae47-4b7d-bfd8-10f94ea8a182 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 7d81b881-b44e-4fb3-8245-9dea634bdec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 079a5ed7-ee25-495b-a2a4-924d830a670a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance d3e3612b-c6b9-4308-a45a-1ff3805e18bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 97917500-bc78-433b-8d3d-181ed13667dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance c244056f-d17d-4d92-98bb-7c0de6a4d261 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 62122879-2a72-4ddf-a028-317eda0da465 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 9bd6169a-9a44-4d9c-a406-c10a2542a7b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance f011c736-1a43-4b0e-ac7c-d512bcaa9bdc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 82116af8-3702-401b-8d00-9291d4caeb03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 9203aeaf-2ae9-4e28-9741-05d33df6c915 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 6258dba2-2e73-45d7-99f0-9a4af065ffcc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.061s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6dcc68a-a229-4d7e-9843-f57661b9dc0b]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] SCSI volumes sdh have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e6d8ca-e4a6-49e0-8249-dae29bd8dbc2]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700 -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9764714f-8cdb-4682-9a3a-01c286938068]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700, portal: 172.16.0.220,3260]
Jul 31 14:46:08 user nova-compute[72239]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700, portal: 172.16.0.220,3260] successful.
Jul 31 14:46:08 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700 -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:216c5321-d877-48e1-9b2d-bfe47ab51700 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[34f2cea3-1aa6-4e05-a057-7d040f3ca7e1]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.414s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] <== disconnect_volume: return (415ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 14:46:08 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Deleting instance files /opt/stack/data/nova/instances/6716534f-ae47-4b7d-bfd8-10f94ea8a182_del
Jul 31 14:46:08 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Deletion of /opt/stack/data/nova/instances/6716534f-ae47-4b7d-bfd8-10f94ea8a182_del complete
Jul 31 14:46:08 user nova-compute[72239]: INFO nova.compute.manager [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Took 2.02 seconds to destroy the instance on the hypervisor.
Jul 31 14:46:08 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG nova.network.neutron [req-e09f62b7-0746-4343-be10-14e361800461 req-04f6a9e3-ae40-4be4-a66a-ae98244b6bf0 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Updated VIF entry in instance network info cache for port d6ef6541-6b7e-4dc5-8149-a10940dfe87b. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG nova.network.neutron [req-e09f62b7-0746-4343-be10-14e361800461 req-04f6a9e3-ae40-4be4-a66a-ae98244b6bf0 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Updating instance_info_cache with network_info: [{"id": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "address": "fa:16:3e:f4:8d:da", "network": {"id": "ad1d78ca-d597-4586-8b1b-4dc00fac3c3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-398965992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "506aad3c95a94800a4cc333a3478da17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ef6541-6b", "ovs_interfaceid": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e09f62b7-0746-4343-be10-14e361800461 req-04f6a9e3-ae40-4be4-a66a-ae98244b6bf0 service nova] Releasing lock "refresh_cache-d3e3612b-c6b9-4308-a45a-1ff3805e18bb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 14:46:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.809s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:09 user nova-compute[72239]: DEBUG nova.compute.manager [req-085b96c6-827e-409e-b9ea-0a8857f108ea req-5b7c36f7-2370-4e36-bab8-975d04db9fe1 service nova] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Received event network-vif-plugged-5606e369-50ff-4ebd-a3a4-7da83520dd63 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:46:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-085b96c6-827e-409e-b9ea-0a8857f108ea req-5b7c36f7-2370-4e36-bab8-975d04db9fe1 service nova] Acquiring lock "6716534f-ae47-4b7d-bfd8-10f94ea8a182-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-085b96c6-827e-409e-b9ea-0a8857f108ea req-5b7c36f7-2370-4e36-bab8-975d04db9fe1 service nova] Lock "6716534f-ae47-4b7d-bfd8-10f94ea8a182-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-085b96c6-827e-409e-b9ea-0a8857f108ea req-5b7c36f7-2370-4e36-bab8-975d04db9fe1 service nova] Lock "6716534f-ae47-4b7d-bfd8-10f94ea8a182-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:09 user nova-compute[72239]: DEBUG nova.compute.manager [req-085b96c6-827e-409e-b9ea-0a8857f108ea req-5b7c36f7-2370-4e36-bab8-975d04db9fe1 service nova] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] No waiting events found dispatching network-vif-plugged-5606e369-50ff-4ebd-a3a4-7da83520dd63 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:46:09 user nova-compute[72239]: WARNING nova.compute.manager [req-085b96c6-827e-409e-b9ea-0a8857f108ea req-5b7c36f7-2370-4e36-bab8-975d04db9fe1 service nova] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Received unexpected event network-vif-plugged-5606e369-50ff-4ebd-a3a4-7da83520dd63 for instance with vm_state active and task_state deleting.
Jul 31 14:46:09 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:46:09 user nova-compute[72239]: DEBUG nova.compute.manager [None req-e4fdaf47-8c07-4b35-832d-d4b47b1eff93 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:46:09 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Took 0.76 seconds to deallocate network for instance.
Jul 31 14:46:09 user nova-compute[72239]: INFO nova.compute.manager [None req-e4fdaf47-8c07-4b35-832d-d4b47b1eff93 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] instance snapshotting
Jul 31 14:46:09 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-e4fdaf47-8c07-4b35-832d-d4b47b1eff93 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Beginning live snapshot process
Jul 31 14:46:09 user nova-compute[72239]: DEBUG nova.compute.manager [req-c042e497-f4a0-447b-a791-231e97b3bb01 req-7a7acf7e-7c5c-4b8d-83ec-f5c1d3308174 service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Received event network-changed-60c1bdaa-524e-41da-96d7-56c77f959c71 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:46:09 user nova-compute[72239]: DEBUG nova.compute.manager [req-c042e497-f4a0-447b-a791-231e97b3bb01 req-7a7acf7e-7c5c-4b8d-83ec-f5c1d3308174 service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Refreshing instance network info cache due to event network-changed-60c1bdaa-524e-41da-96d7-56c77f959c71. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:46:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-c042e497-f4a0-447b-a791-231e97b3bb01 req-7a7acf7e-7c5c-4b8d-83ec-f5c1d3308174 service nova] Acquiring lock "refresh_cache-97917500-bc78-433b-8d3d-181ed13667dc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:46:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-c042e497-f4a0-447b-a791-231e97b3bb01 req-7a7acf7e-7c5c-4b8d-83ec-f5c1d3308174 service nova] Acquired lock "refresh_cache-97917500-bc78-433b-8d3d-181ed13667dc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:46:09 user nova-compute[72239]: DEBUG nova.network.neutron [req-c042e497-f4a0-447b-a791-231e97b3bb01 req-7a7acf7e-7c5c-4b8d-83ec-f5c1d3308174 service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Refreshing network info cache for port 60c1bdaa-524e-41da-96d7-56c77f959c71 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:46:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-e4fdaf47-8c07-4b35-832d-d4b47b1eff93 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk --force-share --output=json -f qcow2 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-e4fdaf47-8c07-4b35-832d-d4b47b1eff93 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk --force-share --output=json -f qcow2" returned: 0 in 0.146s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-e4fdaf47-8c07-4b35-832d-d4b47b1eff93 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk --force-share --output=json -f qcow2 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-e4fdaf47-8c07-4b35-832d-d4b47b1eff93 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk --force-share --output=json -f qcow2" returned: 0 in 0.141s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-e4fdaf47-8c07-4b35-832d-d4b47b1eff93 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-e4fdaf47-8c07-4b35-832d-d4b47b1eff93 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.148s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-e4fdaf47-8c07-4b35-832d-d4b47b1eff93 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdl8ubkk1/85d88f25f8d746e3863b6372af044535.delta 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-e4fdaf47-8c07-4b35-832d-d4b47b1eff93 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpdl8ubkk1/85d88f25f8d746e3863b6372af044535.delta 1073741824" returned: 0 in 0.052s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:10 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-e4fdaf47-8c07-4b35-832d-d4b47b1eff93 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 31 14:46:10 user nova-compute[72239]: INFO nova.compute.manager [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Took 1.01 seconds to detach 1 volumes for instance.
Jul 31 14:46:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:10 user nova-compute[72239]: DEBUG nova.network.neutron [req-c042e497-f4a0-447b-a791-231e97b3bb01 req-7a7acf7e-7c5c-4b8d-83ec-f5c1d3308174 service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Updated VIF entry in instance network info cache for port 60c1bdaa-524e-41da-96d7-56c77f959c71. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:46:10 user nova-compute[72239]: DEBUG nova.network.neutron [req-c042e497-f4a0-447b-a791-231e97b3bb01 req-7a7acf7e-7c5c-4b8d-83ec-f5c1d3308174 service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Updating instance_info_cache with network_info: [{"id": "60c1bdaa-524e-41da-96d7-56c77f959c71", "address": "fa:16:3e:a4:5f:0e", "network": {"id": "edecce7c-9fe9-4028-997d-b1ceef4e22bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1931054498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e59830ca9e40718341c3f2b0375af0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c1bdaa-52", "ovs_interfaceid": "60c1bdaa-524e-41da-96d7-56c77f959c71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:46:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-c042e497-f4a0-447b-a791-231e97b3bb01 req-7a7acf7e-7c5c-4b8d-83ec-f5c1d3308174 service nova] Releasing lock "refresh_cache-97917500-bc78-433b-8d3d-181ed13667dc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:46:10 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:46:11 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:46:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.487s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:11 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Deleted allocations for instance 6716534f-ae47-4b7d-bfd8-10f94ea8a182
Jul 31 14:46:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-e4fdaf47-8c07-4b35-832d-d4b47b1eff93 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 14:46:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e4e71c0e-be7b-405b-892c-851782e39585 tempest-DeleteServersTestJSON-1110151379 tempest-DeleteServersTestJSON-1110151379-project-member] Lock "6716534f-ae47-4b7d-bfd8-10f94ea8a182" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.630s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-e4fdaf47-8c07-4b35-832d-d4b47b1eff93 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 14:46:11 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-e4fdaf47-8c07-4b35-832d-d4b47b1eff93 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 31 14:46:11 user nova-compute[72239]: DEBUG nova.privsep.utils [None req-e4fdaf47-8c07-4b35-832d-d4b47b1eff93 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72239) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 14:46:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-e4fdaf47-8c07-4b35-832d-d4b47b1eff93 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdl8ubkk1/85d88f25f8d746e3863b6372af044535.delta /opt/stack/data/nova/instances/snapshots/tmpdl8ubkk1/85d88f25f8d746e3863b6372af044535 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:11 user nova-compute[72239]: DEBUG nova.compute.manager [req-0f9f4424-c8dc-4595-a78c-44294a8e2922 req-926fcf3c-8c62-40ee-a3ba-0711f3915e20 service nova] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Received event network-vif-deleted-5606e369-50ff-4ebd-a3a4-7da83520dd63 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:46:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-e4fdaf47-8c07-4b35-832d-d4b47b1eff93 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpdl8ubkk1/85d88f25f8d746e3863b6372af044535.delta /opt/stack/data/nova/instances/snapshots/tmpdl8ubkk1/85d88f25f8d746e3863b6372af044535" returned: 0 in 0.469s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:12 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-e4fdaf47-8c07-4b35-832d-d4b47b1eff93 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Snapshot extracted, beginning image upload
Jul 31 14:46:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:14 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-e4fdaf47-8c07-4b35-832d-d4b47b1eff93 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Snapshot image upload complete
Jul 31 14:46:14 user nova-compute[72239]: INFO nova.compute.manager [None req-e4fdaf47-8c07-4b35-832d-d4b47b1eff93 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Took 5.21 seconds to snapshot the instance on the hypervisor.
Jul 31 14:46:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:23 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690814767.5202188, 6716534f-ae47-4b7d-bfd8-10f94ea8a182 => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:46:23 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] VM Stopped (Lifecycle Event)
Jul 31 14:46:23 user nova-compute[72239]: DEBUG nova.compute.manager [None req-945d8be4-14bd-4303-9fae-7cee3bc26006 None None] [instance: 6716534f-ae47-4b7d-bfd8-10f94ea8a182] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:46:23 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:23 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:28 user nova-compute[72239]: DEBUG nova.compute.manager [req-f5d9d774-12e8-4d9e-865e-f43eba33c9d2 req-ea44e00f-d6c0-41e0-9475-3769a2290e3b service nova] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Received event network-changed-84eefab5-3319-4e79-9153-628396e013c6 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:46:28 user nova-compute[72239]: DEBUG nova.compute.manager [req-f5d9d774-12e8-4d9e-865e-f43eba33c9d2 req-ea44e00f-d6c0-41e0-9475-3769a2290e3b service nova] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Refreshing instance network info cache due to event network-changed-84eefab5-3319-4e79-9153-628396e013c6. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:46:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-f5d9d774-12e8-4d9e-865e-f43eba33c9d2 req-ea44e00f-d6c0-41e0-9475-3769a2290e3b service nova] Acquiring lock "refresh_cache-c244056f-d17d-4d92-98bb-7c0de6a4d261" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:46:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-f5d9d774-12e8-4d9e-865e-f43eba33c9d2 req-ea44e00f-d6c0-41e0-9475-3769a2290e3b service nova] Acquired lock "refresh_cache-c244056f-d17d-4d92-98bb-7c0de6a4d261" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:46:28 user nova-compute[72239]: DEBUG nova.network.neutron [req-f5d9d774-12e8-4d9e-865e-f43eba33c9d2 req-ea44e00f-d6c0-41e0-9475-3769a2290e3b service nova] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Refreshing network info cache for port 84eefab5-3319-4e79-9153-628396e013c6 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:46:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:29 user nova-compute[72239]: DEBUG nova.network.neutron [req-f5d9d774-12e8-4d9e-865e-f43eba33c9d2 req-ea44e00f-d6c0-41e0-9475-3769a2290e3b service nova] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Updated VIF entry in instance network info cache for port 84eefab5-3319-4e79-9153-628396e013c6. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:46:29 user nova-compute[72239]: DEBUG nova.network.neutron [req-f5d9d774-12e8-4d9e-865e-f43eba33c9d2 req-ea44e00f-d6c0-41e0-9475-3769a2290e3b service nova] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Updating instance_info_cache with network_info: [{"id": "84eefab5-3319-4e79-9153-628396e013c6", "address": "fa:16:3e:3f:0e:9a", "network": {"id": "ec35da67-9eac-4670-8019-ca1eff993e4c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2131299185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9bac52049b64df48709cc39d0eb0d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84eefab5-33", "ovs_interfaceid": "84eefab5-3319-4e79-9153-628396e013c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:46:29 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-f5d9d774-12e8-4d9e-865e-f43eba33c9d2 req-ea44e00f-d6c0-41e0-9475-3769a2290e3b service nova] Releasing lock "refresh_cache-c244056f-d17d-4d92-98bb-7c0de6a4d261" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:46:29 user nova-compute[72239]: DEBUG nova.compute.manager [req-93b5f473-ac59-4182-8b34-4425d5cbda06 req-56d482df-fbd8-44f0-9530-616b0494d290 service nova] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Received event network-changed-7bc07641-e336-4044-9615-fea49f5b056c {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:46:29 user nova-compute[72239]: DEBUG nova.compute.manager [req-93b5f473-ac59-4182-8b34-4425d5cbda06 req-56d482df-fbd8-44f0-9530-616b0494d290 service nova] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Refreshing instance network info cache due to event network-changed-7bc07641-e336-4044-9615-fea49f5b056c. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:46:29 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-93b5f473-ac59-4182-8b34-4425d5cbda06 req-56d482df-fbd8-44f0-9530-616b0494d290 service nova] Acquiring lock "refresh_cache-62122879-2a72-4ddf-a028-317eda0da465" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:46:29 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-93b5f473-ac59-4182-8b34-4425d5cbda06 req-56d482df-fbd8-44f0-9530-616b0494d290 service nova] Acquired lock "refresh_cache-62122879-2a72-4ddf-a028-317eda0da465" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:46:29 user nova-compute[72239]: DEBUG nova.network.neutron [req-93b5f473-ac59-4182-8b34-4425d5cbda06 req-56d482df-fbd8-44f0-9530-616b0494d290 service nova] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Refreshing network info cache for port 7bc07641-e336-4044-9615-fea49f5b056c {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:46:29 user nova-compute[72239]: DEBUG nova.network.neutron [req-93b5f473-ac59-4182-8b34-4425d5cbda06 req-56d482df-fbd8-44f0-9530-616b0494d290 service nova] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Updated VIF entry in instance network info cache for port 7bc07641-e336-4044-9615-fea49f5b056c. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:46:29 user nova-compute[72239]: DEBUG nova.network.neutron [req-93b5f473-ac59-4182-8b34-4425d5cbda06 req-56d482df-fbd8-44f0-9530-616b0494d290 service nova] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Updating instance_info_cache with network_info: [{"id": "7bc07641-e336-4044-9615-fea49f5b056c", "address": "fa:16:3e:f6:05:0e", "network": {"id": "f05d7a54-33c7-463e-a73e-8d726fe2a9b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-181910970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aad7d4ecc24425a8571cc2ac8041628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc07641-e3", "ovs_interfaceid": "7bc07641-e336-4044-9615-fea49f5b056c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:46:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-93b5f473-ac59-4182-8b34-4425d5cbda06 req-56d482df-fbd8-44f0-9530-616b0494d290 service nova] Releasing lock "refresh_cache-62122879-2a72-4ddf-a028-317eda0da465" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:46:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Acquiring lock "c244056f-d17d-4d92-98bb-7c0de6a4d261" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Lock "c244056f-d17d-4d92-98bb-7c0de6a4d261" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:31 user nova-compute[72239]: DEBUG nova.objects.instance [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Lazy-loading 'flavor' on Instance uuid c244056f-d17d-4d92-98bb-7c0de6a4d261 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:46:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Lock "c244056f-d17d-4d92-98bb-7c0de6a4d261" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.081s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:32 user nova-compute[72239]: DEBUG nova.compute.manager [req-22b97a16-7d03-412a-b9f8-0d3fb140d9db req-39267c39-1bde-4780-bbc1-38f73837624e service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Received event network-changed-bc41ac8f-b231-4381-9278-64ce17f8833d {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:46:32 user nova-compute[72239]: DEBUG nova.compute.manager [req-22b97a16-7d03-412a-b9f8-0d3fb140d9db req-39267c39-1bde-4780-bbc1-38f73837624e service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Refreshing instance network info cache due to event network-changed-bc41ac8f-b231-4381-9278-64ce17f8833d. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:46:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-22b97a16-7d03-412a-b9f8-0d3fb140d9db req-39267c39-1bde-4780-bbc1-38f73837624e service nova] Acquiring lock "refresh_cache-9bd6169a-9a44-4d9c-a406-c10a2542a7b4" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:46:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-22b97a16-7d03-412a-b9f8-0d3fb140d9db req-39267c39-1bde-4780-bbc1-38f73837624e service nova] Acquired lock "refresh_cache-9bd6169a-9a44-4d9c-a406-c10a2542a7b4" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:46:32 user nova-compute[72239]: DEBUG nova.network.neutron [req-22b97a16-7d03-412a-b9f8-0d3fb140d9db req-39267c39-1bde-4780-bbc1-38f73837624e service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Refreshing network info cache for port bc41ac8f-b231-4381-9278-64ce17f8833d {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:46:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Acquiring lock "c244056f-d17d-4d92-98bb-7c0de6a4d261" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Lock "c244056f-d17d-4d92-98bb-7c0de6a4d261" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:32 user nova-compute[72239]: INFO nova.compute.manager [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Attaching volume 9782fe97-b7f9-4ca4-b75b-23c3ed01656a to /dev/sdc
Jul 31 14:46:32 user nova-compute[72239]: DEBUG os_brick.utils [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:46:32 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:32 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:32 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b17264-4f16-4dd4-8653-6ff525ef08da]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:32 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:32 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:32 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e3372e-2301-46aa-b841-4b98cbeb45c7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:32 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:32 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:32 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d87bcbf-6762-487b-a53c-870e888f26df]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:32 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1e1478-b396-4bcd-a929-89b8343d2f57]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:32 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:32 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:46:32 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 14:46:32 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:32 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:46:32 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 14:46:32 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b3a783-29a3-48b9-991f-b67bbb61fbda]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:32 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 14:46:32 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 14:46:32 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 14:46:32 user nova-compute[72239]: DEBUG os_brick.utils [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:46:32 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Updating existing volume attachment record: d1881ef2-31cb-48ed-a14a-8e94619d2b44 {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 14:46:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-53c7b199-dbe6-48ea-afb9-85153905e521 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Acquiring lock "interface-9bd6169a-9a44-4d9c-a406-c10a2542a7b4-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-53c7b199-dbe6-48ea-afb9-85153905e521 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lock "interface-9bd6169a-9a44-4d9c-a406-c10a2542a7b4-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:32 user nova-compute[72239]: DEBUG nova.objects.instance [None req-53c7b199-dbe6-48ea-afb9-85153905e521 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lazy-loading 'flavor' on Instance uuid 9bd6169a-9a44-4d9c-a406-c10a2542a7b4 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:46:32 user nova-compute[72239]: DEBUG nova.network.neutron [req-22b97a16-7d03-412a-b9f8-0d3fb140d9db req-39267c39-1bde-4780-bbc1-38f73837624e service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Updated VIF entry in instance network info cache for port bc41ac8f-b231-4381-9278-64ce17f8833d. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:46:32 user nova-compute[72239]: DEBUG nova.network.neutron [req-22b97a16-7d03-412a-b9f8-0d3fb140d9db req-39267c39-1bde-4780-bbc1-38f73837624e service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Updating instance_info_cache with network_info: [{"id": "bc41ac8f-b231-4381-9278-64ce17f8833d", "address": "fa:16:3e:25:8c:a7", "network": {"id": "c36e8dbf-183c-4511-bb8d-12d2f61ff51c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1591719384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0e60cdf6a46cfb149c45d8f5443c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc41ac8f-b2", "ovs_interfaceid": "bc41ac8f-b231-4381-9278-64ce17f8833d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:46:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-22b97a16-7d03-412a-b9f8-0d3fb140d9db req-39267c39-1bde-4780-bbc1-38f73837624e service nova] Releasing lock "refresh_cache-9bd6169a-9a44-4d9c-a406-c10a2542a7b4" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:46:32 user nova-compute[72239]: DEBUG nova.objects.instance [None req-53c7b199-dbe6-48ea-afb9-85153905e521 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lazy-loading 'pci_requests' on Instance uuid 9bd6169a-9a44-4d9c-a406-c10a2542a7b4 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:46:32 user nova-compute[72239]: DEBUG nova.network.neutron [None req-53c7b199-dbe6-48ea-afb9-85153905e521 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 14:46:32 user nova-compute[72239]: DEBUG nova.policy [None req-53c7b199-dbe6-48ea-afb9-85153905e521 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ffb1bd7bcf554374b9b3c5bb1fc2b00a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ef0e60cdf6a46cfb149c45d8f5443c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 14:46:33 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Acquiring lock "62122879-2a72-4ddf-a028-317eda0da465" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "62122879-2a72-4ddf-a028-317eda0da465" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:33 user nova-compute[72239]: DEBUG nova.objects.instance [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lazy-loading 'flavor' on Instance uuid 62122879-2a72-4ddf-a028-317eda0da465 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:46:33 user nova-compute[72239]: DEBUG nova.network.neutron [None req-53c7b199-dbe6-48ea-afb9-85153905e521 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Successfully created port: 377c42af-1122-41e2-9dba-9986e495c09a {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:46:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "62122879-2a72-4ddf-a028-317eda0da465" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Acquiring lock "62122879-2a72-4ddf-a028-317eda0da465" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "62122879-2a72-4ddf-a028-317eda0da465" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:33 user nova-compute[72239]: INFO nova.compute.manager [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Attaching volume 21fe9e13-7d8c-42ad-9778-45b6e1709dd3 to /dev/vdb
Jul 31 14:46:33 user nova-compute[72239]: DEBUG os_brick.utils [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:46:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:33 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf1da50-4cf7-45f6-81de-a2e288bdb6c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:33 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[42018d78-52e8-4c90-b430-6940fbda2d48]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:33 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7b7fee-71d2-4a82-867f-806fb273618b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:33 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bff8f4-5e3f-4159-a9cf-7580eb77046d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:46:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 14:46:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:46:33 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 14:46:33 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d6bf98-11e2-4898-ac7b-3d602dbd155f]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 14:46:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 14:46:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 14:46:33 user nova-compute[72239]: DEBUG os_brick.utils [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] <== get_connector_properties: return (111ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:46:33 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Updating existing volume attachment record: 104f3867-2463-4792-a706-68fedb1202b2 {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 14:46:33 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:34 user nova-compute[72239]: DEBUG nova.network.neutron [None req-53c7b199-dbe6-48ea-afb9-85153905e521 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Successfully updated port: 377c42af-1122-41e2-9dba-9986e495c09a {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:46:34 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-53c7b199-dbe6-48ea-afb9-85153905e521 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Acquiring lock "refresh_cache-9bd6169a-9a44-4d9c-a406-c10a2542a7b4" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:46:34 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-53c7b199-dbe6-48ea-afb9-85153905e521 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Acquired lock "refresh_cache-9bd6169a-9a44-4d9c-a406-c10a2542a7b4" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:46:34 user nova-compute[72239]: DEBUG nova.network.neutron [None req-53c7b199-dbe6-48ea-afb9-85153905e521 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:46:34 user nova-compute[72239]: DEBUG nova.compute.manager [req-89d425b4-665f-44dd-a7d4-59ea76c3db54 req-dcaee780-cab2-485d-90c5-50797809684c service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Received event network-changed-377c42af-1122-41e2-9dba-9986e495c09a {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:46:34 user nova-compute[72239]: DEBUG nova.compute.manager [req-89d425b4-665f-44dd-a7d4-59ea76c3db54 req-dcaee780-cab2-485d-90c5-50797809684c service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Refreshing instance network info cache due to event network-changed-377c42af-1122-41e2-9dba-9986e495c09a. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:46:34 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-89d425b4-665f-44dd-a7d4-59ea76c3db54 req-dcaee780-cab2-485d-90c5-50797809684c service nova] Acquiring lock "refresh_cache-9bd6169a-9a44-4d9c-a406-c10a2542a7b4" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:46:35 user nova-compute[72239]: DEBUG nova.network.neutron [None req-53c7b199-dbe6-48ea-afb9-85153905e521 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Updating instance_info_cache with network_info: [{"id": "bc41ac8f-b231-4381-9278-64ce17f8833d", "address": "fa:16:3e:25:8c:a7", "network": {"id": "c36e8dbf-183c-4511-bb8d-12d2f61ff51c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1591719384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0e60cdf6a46cfb149c45d8f5443c6", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc41ac8f-b2", "ovs_interfaceid": "bc41ac8f-b231-4381-9278-64ce17f8833d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "377c42af-1122-41e2-9dba-9986e495c09a", "address": "fa:16:3e:11:fc:32", "network": {"id": "b396cce0-2406-4897-966e-5fa419b42fee", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1921449827", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ef0e60cdf6a46cfb149c45d8f5443c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377c42af-11", "ovs_interfaceid": "377c42af-1122-41e2-9dba-9986e495c09a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:46:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-53c7b199-dbe6-48ea-afb9-85153905e521 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Releasing lock "refresh_cache-9bd6169a-9a44-4d9c-a406-c10a2542a7b4" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:46:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-89d425b4-665f-44dd-a7d4-59ea76c3db54 req-dcaee780-cab2-485d-90c5-50797809684c service nova] Acquired lock "refresh_cache-9bd6169a-9a44-4d9c-a406-c10a2542a7b4" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:46:35 user nova-compute[72239]: DEBUG nova.network.neutron [req-89d425b4-665f-44dd-a7d4-59ea76c3db54 req-dcaee780-cab2-485d-90c5-50797809684c service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Refreshing network info cache for port 377c42af-1122-41e2-9dba-9986e495c09a {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:46:35 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-53c7b199-dbe6-48ea-afb9-85153905e521 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1518629609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1518629609',id=9,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkO64Mxo9V45ZvyZddW60Bj3R/wxTnuP74Wl0QbQrxRPpHV5wIIOFOuVL0TXCzmSq9fH99PAiORRcNxyzp52Ts3i5cecEtzUOk3DHNvVsfSIw0FbT8y4KNU2UgxwmOgpg==',key_name='tempest-keypair-1851777278',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:44:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0ef0e60cdf6a46cfb149c45d8f5443c6',ramdisk_id='',reservation_id='r-uyqcqdz1',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-99713276',owner_user_name='tempest-TaggedAttachmentsTest-99713276-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:44:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffb1bd7bcf554374b9b3c5bb1fc2b00a',uuid=9bd6169a-9a44-4d9c-a406-c10a2542a7b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "377c42af-1122-41e2-9dba-9986e495c09a", "address": "fa:16:3e:11:fc:32", "network": {"id": "b396cce0-2406-4897-966e-5fa419b42fee", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1921449827", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ef0e60cdf6a46cfb149c45d8f5443c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377c42af-11", "ovs_interfaceid": "377c42af-1122-41e2-9dba-9986e495c09a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:46:35 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-53c7b199-dbe6-48ea-afb9-85153905e521 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Converting VIF {"id": "377c42af-1122-41e2-9dba-9986e495c09a", "address": "fa:16:3e:11:fc:32", "network": {"id": "b396cce0-2406-4897-966e-5fa419b42fee", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1921449827", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ef0e60cdf6a46cfb149c45d8f5443c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377c42af-11", "ovs_interfaceid": "377c42af-1122-41e2-9dba-9986e495c09a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:46:35 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-53c7b199-dbe6-48ea-afb9-85153905e521 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:fc:32,bridge_name='br-int',has_traffic_filtering=True,id=377c42af-1122-41e2-9dba-9986e495c09a,network=Network(b396cce0-2406-4897-966e-5fa419b42fee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap377c42af-11') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:46:35 user nova-compute[72239]: DEBUG os_vif [None req-53c7b199-dbe6-48ea-afb9-85153905e521 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:fc:32,bridge_name='br-int',has_traffic_filtering=True,id=377c42af-1122-41e2-9dba-9986e495c09a,network=Network(b396cce0-2406-4897-966e-5fa419b42fee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap377c42af-11') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:46:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:46:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:46:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap377c42af-11, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:46:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap377c42af-11, col_values=(('external_ids', {'iface-id': '377c42af-1122-41e2-9dba-9986e495c09a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:fc:32', 'vm-uuid': '9bd6169a-9a44-4d9c-a406-c10a2542a7b4'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:46:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:46:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:35 user nova-compute[72239]: INFO os_vif [None req-53c7b199-dbe6-48ea-afb9-85153905e521 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:fc:32,bridge_name='br-int',has_traffic_filtering=True,id=377c42af-1122-41e2-9dba-9986e495c09a,network=Network(b396cce0-2406-4897-966e-5fa419b42fee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap377c42af-11')
Jul 31 14:46:35 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-53c7b199-dbe6-48ea-afb9-85153905e521 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1518629609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1518629609',id=9,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkO64Mxo9V45ZvyZddW60Bj3R/wxTnuP74Wl0QbQrxRPpHV5wIIOFOuVL0TXCzmSq9fH99PAiORRcNxyzp52Ts3i5cecEtzUOk3DHNvVsfSIw0FbT8y4KNU2UgxwmOgpg==',key_name='tempest-keypair-1851777278',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:44:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='0ef0e60cdf6a46cfb149c45d8f5443c6',ramdisk_id='',reservation_id='r-uyqcqdz1',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-99713276',owner_user_name='tempest-TaggedAttachmentsTest-99713276-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:44:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffb1bd7bcf554374b9b3c5bb1fc2b00a',uuid=9bd6169a-9a44-4d9c-a406-c10a2542a7b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "377c42af-1122-41e2-9dba-9986e495c09a", "address": "fa:16:3e:11:fc:32", "network": {"id": "b396cce0-2406-4897-966e-5fa419b42fee", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1921449827", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ef0e60cdf6a46cfb149c45d8f5443c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377c42af-11", "ovs_interfaceid": "377c42af-1122-41e2-9dba-9986e495c09a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:46:35 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-53c7b199-dbe6-48ea-afb9-85153905e521 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Converting VIF {"id": "377c42af-1122-41e2-9dba-9986e495c09a", "address": "fa:16:3e:11:fc:32", "network": {"id": "b396cce0-2406-4897-966e-5fa419b42fee", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1921449827", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ef0e60cdf6a46cfb149c45d8f5443c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377c42af-11", "ovs_interfaceid": "377c42af-1122-41e2-9dba-9986e495c09a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:46:35 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-53c7b199-dbe6-48ea-afb9-85153905e521 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:fc:32,bridge_name='br-int',has_traffic_filtering=True,id=377c42af-1122-41e2-9dba-9986e495c09a,network=Network(b396cce0-2406-4897-966e-5fa419b42fee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap377c42af-11') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:46:35 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-53c7b199-dbe6-48ea-afb9-85153905e521 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] attach device xml: <interface type="ethernet">
Jul 31 14:46:35 user nova-compute[72239]:   <mac address="fa:16:3e:11:fc:32"/>
Jul 31 14:46:35 user nova-compute[72239]:   <model type="virtio"/>
Jul 31 14:46:35 user nova-compute[72239]:   <mtu size="1442"/>
Jul 31 14:46:35 user nova-compute[72239]:   <target dev="tap377c42af-11"/>
Jul 31 14:46:35 user nova-compute[72239]: </interface>
Jul 31 14:46:35 user nova-compute[72239]:  {{(pid=72239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 14:46:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:35 user nova-compute[72239]: DEBUG nova.compute.manager [req-8e998a99-0451-4136-b16c-046bba14c23d req-8dc75c55-b778-4d00-b269-c5d67d479c01 service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Received event network-vif-plugged-377c42af-1122-41e2-9dba-9986e495c09a {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:46:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-8e998a99-0451-4136-b16c-046bba14c23d req-8dc75c55-b778-4d00-b269-c5d67d479c01 service nova] Acquiring lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-8e998a99-0451-4136-b16c-046bba14c23d req-8dc75c55-b778-4d00-b269-c5d67d479c01 service nova] Lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-8e998a99-0451-4136-b16c-046bba14c23d req-8dc75c55-b778-4d00-b269-c5d67d479c01 service nova] Lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:35 user nova-compute[72239]: DEBUG nova.compute.manager [req-8e998a99-0451-4136-b16c-046bba14c23d req-8dc75c55-b778-4d00-b269-c5d67d479c01 service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] No waiting events found dispatching network-vif-plugged-377c42af-1122-41e2-9dba-9986e495c09a {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:46:35 user nova-compute[72239]: WARNING nova.compute.manager [req-8e998a99-0451-4136-b16c-046bba14c23d req-8dc75c55-b778-4d00-b269-c5d67d479c01 service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Received unexpected event network-vif-plugged-377c42af-1122-41e2-9dba-9986e495c09a for instance with vm_state active and task_state None.
Jul 31 14:46:35 user nova-compute[72239]: DEBUG nova.network.neutron [req-89d425b4-665f-44dd-a7d4-59ea76c3db54 req-dcaee780-cab2-485d-90c5-50797809684c service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Updated VIF entry in instance network info cache for port 377c42af-1122-41e2-9dba-9986e495c09a. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:46:35 user nova-compute[72239]: DEBUG nova.network.neutron [req-89d425b4-665f-44dd-a7d4-59ea76c3db54 req-dcaee780-cab2-485d-90c5-50797809684c service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Updating instance_info_cache with network_info: [{"id": "bc41ac8f-b231-4381-9278-64ce17f8833d", "address": "fa:16:3e:25:8c:a7", "network": {"id": "c36e8dbf-183c-4511-bb8d-12d2f61ff51c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1591719384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0e60cdf6a46cfb149c45d8f5443c6", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc41ac8f-b2", "ovs_interfaceid": "bc41ac8f-b231-4381-9278-64ce17f8833d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "377c42af-1122-41e2-9dba-9986e495c09a", "address": "fa:16:3e:11:fc:32", "network": {"id": "b396cce0-2406-4897-966e-5fa419b42fee", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1921449827", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ef0e60cdf6a46cfb149c45d8f5443c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377c42af-11", "ovs_interfaceid": "377c42af-1122-41e2-9dba-9986e495c09a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:46:35 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-53c7b199-dbe6-48ea-afb9-85153905e521 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:46:35 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-53c7b199-dbe6-48ea-afb9-85153905e521 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] No BDM found with device name hda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:46:35 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-53c7b199-dbe6-48ea-afb9-85153905e521 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] No VIF found with MAC fa:16:3e:25:8c:a7, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:46:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-89d425b4-665f-44dd-a7d4-59ea76c3db54 req-dcaee780-cab2-485d-90c5-50797809684c service nova] Releasing lock "refresh_cache-9bd6169a-9a44-4d9c-a406-c10a2542a7b4" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:46:35 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-53c7b199-dbe6-48ea-afb9-85153905e521 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:46:35 user nova-compute[72239]:   <nova:package version="0.0.0"/>
Jul 31 14:46:35 user nova-compute[72239]:   <nova:name>tempest-device-tagging-server-1518629609</nova:name>
Jul 31 14:46:35 user nova-compute[72239]:   <nova:creationTime>2023-07-31 14:46:35</nova:creationTime>
Jul 31 14:46:35 user nova-compute[72239]:   <nova:flavor name="m1.tiny">
Jul 31 14:46:35 user nova-compute[72239]:     <nova:memory>512</nova:memory>
Jul 31 14:46:35 user nova-compute[72239]:     <nova:disk>1</nova:disk>
Jul 31 14:46:35 user nova-compute[72239]:     <nova:swap>0</nova:swap>
Jul 31 14:46:35 user nova-compute[72239]:     <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:46:35 user nova-compute[72239]:     <nova:vcpus>1</nova:vcpus>
Jul 31 14:46:35 user nova-compute[72239]:   </nova:flavor>
Jul 31 14:46:35 user nova-compute[72239]:   <nova:owner>
Jul 31 14:46:35 user nova-compute[72239]:     <nova:user uuid="ffb1bd7bcf554374b9b3c5bb1fc2b00a">tempest-TaggedAttachmentsTest-99713276-project-member</nova:user>
Jul 31 14:46:35 user nova-compute[72239]:     <nova:project uuid="0ef0e60cdf6a46cfb149c45d8f5443c6">tempest-TaggedAttachmentsTest-99713276</nova:project>
Jul 31 14:46:35 user nova-compute[72239]:   </nova:owner>
Jul 31 14:46:35 user nova-compute[72239]:   <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:46:35 user nova-compute[72239]:   <nova:ports>
Jul 31 14:46:35 user nova-compute[72239]:     <nova:port uuid="bc41ac8f-b231-4381-9278-64ce17f8833d">
Jul 31 14:46:35 user nova-compute[72239]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 31 14:46:35 user nova-compute[72239]:     </nova:port>
Jul 31 14:46:35 user nova-compute[72239]:     <nova:port uuid="377c42af-1122-41e2-9dba-9986e495c09a">
Jul 31 14:46:35 user nova-compute[72239]:       <nova:ip type="fixed" address="10.10.10.107" ipVersion="4"/>
Jul 31 14:46:35 user nova-compute[72239]:     </nova:port>
Jul 31 14:46:35 user nova-compute[72239]:   </nova:ports>
Jul 31 14:46:35 user nova-compute[72239]: </nova:instance>
Jul 31 14:46:35 user nova-compute[72239]:  {{(pid=72239) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 31 14:46:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-53c7b199-dbe6-48ea-afb9-85153905e521 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lock "interface-9bd6169a-9a44-4d9c-a406-c10a2542a7b4-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.427s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:36 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:36 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:36 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:36 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Acquiring lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:36 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:36 user nova-compute[72239]: DEBUG nova.objects.instance [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lazy-loading 'flavor' on Instance uuid 9bd6169a-9a44-4d9c-a406-c10a2542a7b4 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:46:36 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:36 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Acquiring lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:36 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:36 user nova-compute[72239]: INFO nova.compute.manager [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Attaching volume d7c86d6a-e784-4d16-9a14-26d4730da84c to /dev/vdb
Jul 31 14:46:36 user nova-compute[72239]: DEBUG os_brick.utils [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:46:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:36 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[955e334e-e6a3-414f-8314-23758011dfc4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:36 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a03d8f-8e06-49c3-abbc-7cd4065386cc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:36 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a165244-d8fa-44fa-a414-9922050ca3e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:36 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[631f4d80-67a5-498a-b2ff-75da450f71d6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:46:36 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 14:46:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:46:36 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 14:46:36 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc733c86-46c0-46db-b508-2d5d0bb73e2d]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:36 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 14:46:36 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 14:46:36 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 14:46:36 user nova-compute[72239]: DEBUG os_brick.utils [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:46:36 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Updating existing volume attachment record: 91c89432-fc07-4645-b7b8-7ce5567af690 {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 14:46:37 user nova-compute[72239]: DEBUG nova.compute.manager [req-ccad3cae-3c1c-4ec9-9444-a8c9a6cecef9 req-3e7cb5e6-be36-4acf-b134-f7c69c922ba7 service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Received event network-vif-plugged-377c42af-1122-41e2-9dba-9986e495c09a {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:46:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ccad3cae-3c1c-4ec9-9444-a8c9a6cecef9 req-3e7cb5e6-be36-4acf-b134-f7c69c922ba7 service nova] Acquiring lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ccad3cae-3c1c-4ec9-9444-a8c9a6cecef9 req-3e7cb5e6-be36-4acf-b134-f7c69c922ba7 service nova] Lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ccad3cae-3c1c-4ec9-9444-a8c9a6cecef9 req-3e7cb5e6-be36-4acf-b134-f7c69c922ba7 service nova] Lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:37 user nova-compute[72239]: DEBUG nova.compute.manager [req-ccad3cae-3c1c-4ec9-9444-a8c9a6cecef9 req-3e7cb5e6-be36-4acf-b134-f7c69c922ba7 service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] No waiting events found dispatching network-vif-plugged-377c42af-1122-41e2-9dba-9986e495c09a {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:46:37 user nova-compute[72239]: WARNING nova.compute.manager [req-ccad3cae-3c1c-4ec9-9444-a8c9a6cecef9 req-3e7cb5e6-be36-4acf-b134-f7c69c922ba7 service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Received unexpected event network-vif-plugged-377c42af-1122-41e2-9dba-9986e495c09a for instance with vm_state active and task_state None.
Jul 31 14:46:38 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IfnpqXLc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:46:40 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:46:40 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:46:40 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:46:40 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:46:40 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 14:46:40 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e28dcb2-c5f6-4264-b3ad-36a8d7c2b265]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 14:46:40 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a4b568-3420-4bde-8a0e-f8bb044d70b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a] added
Jul 31 14:46:40 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[166663b5-2e55-4ed6-916f-9ca769f3758d]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b4eca2-2230-49a2-ab87-cee77f5b052d]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IfnpqXLc {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IfnpqXLc" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8159e7-4588-486c-b2de-ba7ba10401dc]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IfnpqXLc'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1e1b6a-e951-4bdc-bde7-deb2287e518f]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b512d3e-9bb3-4154-985e-fabf277b9f84]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:46:40 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:46:40 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:46:40 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:46:40 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:46:40 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:46:40 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:46:40 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:46:40 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:46:40 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:46:40 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:46:40 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:46:40 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ef76ce-a1a6-4e24-9574-8031936e5bd8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a, portal: 172.16.0.220,3260]
Jul 31 14:46:40 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a, portal: 172.16.0.220,3260] successful.
Jul 31 14:46:40 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[da501df1-5226-47ad-b1d2-3e7c817664a4]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6df37bc-3f5e-452f-bd4b-8b0d5e2b6d74]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:46:40 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:46:40 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:46:40 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:46:40 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:46:40 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:46:40 user nova-compute[72239]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a (non-flash)
Jul 31 14:46:40 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:46:40 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:46:40 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:46:40 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:46:40 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:46:40 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:46:40 user nova-compute[72239]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a (non-flash)
Jul 31 14:46:40 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c37677-ce77-4d84-a446-80eda390f8fb]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:40 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: None {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:46:41 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:46:41 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IfnpqXLc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 14:46:41 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:46:41 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] <== connect_volume: return (1361ms) {'type': 'block', 'scsi_wwn': '23234386339613730', 'path': '/dev/sdh'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:46:41 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234386339613730', 'path': '/dev/sdh'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 14:46:41 user nova-compute[72239]: DEBUG nova.objects.instance [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Lazy-loading 'flavor' on Instance uuid c244056f-d17d-4d92-98bb-7c0de6a4d261 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:46:41 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 14:46:41 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:46:41 user nova-compute[72239]:   <source dev="/dev/sdh"/>
Jul 31 14:46:41 user nova-compute[72239]:   <target dev="sdc" bus="scsi"/>
Jul 31 14:46:41 user nova-compute[72239]:   <serial>9782fe97-b7f9-4ca4-b75b-23c3ed01656a</serial>
Jul 31 14:46:41 user nova-compute[72239]:   <address type="drive" controller="0" unit="2"/>
Jul 31 14:46:41 user nova-compute[72239]: </disk>
Jul 31 14:46:41 user nova-compute[72239]:  {{(pid=72239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SXfgRtWB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:46:42 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:46:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:46:42 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:46:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:46:42 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 14:46:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3 -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abdd317-b109-478d-acd4-067a6a70e929]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 14:46:42 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3 -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff74b9f8-90bf-47bc-8e58-1414003d17fc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3] added
Jul 31 14:46:42 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfea4b96-0906-4f54-b631-3e22a3246471]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] No BDM found with device name sda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] No BDM found with device name sdb, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] No BDM found with device name sdc, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] No VIF found with MAC fa:16:3e:3f:0e:9a, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f293055b-2e1a-4e30-a606-078724d4dc06]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SXfgRtWB {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SXfgRtWB" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69b43a6-a5b1-4d2a-8e1c-fd3ff695ff94]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SXfgRtWB'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[33457d5b-340e-429d-970c-b6cd6af1a6c8]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[543a536e-8767-46b0-90a5-8826fa7132ad]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:46:42 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:46:42 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:46:42 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:46:42 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:46:42 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:46:42 user nova-compute[72239]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a (non-flash)
Jul 31 14:46:42 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:46:42 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:46:42 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:46:42 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:46:42 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:46:42 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:46:42 user nova-compute[72239]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a (non-flash)
Jul 31 14:46:42 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3 -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-8c075c5d-b0a9-4fd0-8be4-fcd377aa9965 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Lock "c244056f-d17d-4d92-98bb-7c0de6a4d261" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.344s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c88813-3907-4ed3-8b6a-d0f601e7ea11]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3, portal: 172.16.0.220,3260]
Jul 31 14:46:42 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3, portal: 172.16.0.220,3260] successful.
Jul 31 14:46:42 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee192da2-2f6f-4646-8ec7-900a37b1549c]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86ef4f0-4014-4951-913f-6cc9aed39982]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3 (non-flash)
Jul 31 14:46:42 user nova-compute[72239]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:46:42 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:46:42 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:46:42 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:46:42 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:46:42 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:46:42 user nova-compute[72239]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a (non-flash)
Jul 31 14:46:42 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3 (non-flash)
Jul 31 14:46:42 user nova-compute[72239]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:46:42 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:46:42 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:46:42 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:46:42 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:46:42 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:46:42 user nova-compute[72239]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a (non-flash)
Jul 31 14:46:42 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[411b5f3f-e410-4d2f-b944-03e6ae1d6f72]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SXfgRtWB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG nova.compute.manager [req-00f02d88-e58c-43c2-bb24-1febeb03f68b req-5644326b-89e2-441b-9b72-602e136dffa6 service nova] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Received event network-changed-8953e4f0-db77-497e-884b-2521c5b7d385 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG nova.compute.manager [req-00f02d88-e58c-43c2-bb24-1febeb03f68b req-5644326b-89e2-441b-9b72-602e136dffa6 service nova] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Refreshing instance network info cache due to event network-changed-8953e4f0-db77-497e-884b-2521c5b7d385. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-00f02d88-e58c-43c2-bb24-1febeb03f68b req-5644326b-89e2-441b-9b72-602e136dffa6 service nova] Acquiring lock "refresh_cache-f011c736-1a43-4b0e-ac7c-d512bcaa9bdc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-00f02d88-e58c-43c2-bb24-1febeb03f68b req-5644326b-89e2-441b-9b72-602e136dffa6 service nova] Acquired lock "refresh_cache-f011c736-1a43-4b0e-ac7c-d512bcaa9bdc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG nova.network.neutron [req-00f02d88-e58c-43c2-bb24-1febeb03f68b req-5644326b-89e2-441b-9b72-602e136dffa6 service nova] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Refreshing network info cache for port 8953e4f0-db77-497e-884b-2521c5b7d385 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Acquiring lock "f011c736-1a43-4b0e-ac7c-d512bcaa9bdc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Lock "f011c736-1a43-4b0e-ac7c-d512bcaa9bdc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG nova.objects.instance [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Lazy-loading 'flavor' on Instance uuid f011c736-1a43-4b0e-ac7c-d512bcaa9bdc {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Lock "f011c736-1a43-4b0e-ac7c-d512bcaa9bdc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7af188e6-102a-4b0d-9e48-646a128649e3 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Acquiring lock "c244056f-d17d-4d92-98bb-7c0de6a4d261" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7af188e6-102a-4b0d-9e48-646a128649e3 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Lock "c244056f-d17d-4d92-98bb-7c0de6a4d261" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:43 user nova-compute[72239]: INFO nova.compute.manager [None req-7af188e6-102a-4b0d-9e48-646a128649e3 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Detaching volume 9782fe97-b7f9-4ca4-b75b-23c3ed01656a
Jul 31 14:46:43 user nova-compute[72239]: DEBUG nova.network.neutron [req-00f02d88-e58c-43c2-bb24-1febeb03f68b req-5644326b-89e2-441b-9b72-602e136dffa6 service nova] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Updated VIF entry in instance network info cache for port 8953e4f0-db77-497e-884b-2521c5b7d385. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG nova.network.neutron [req-00f02d88-e58c-43c2-bb24-1febeb03f68b req-5644326b-89e2-441b-9b72-602e136dffa6 service nova] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Updating instance_info_cache with network_info: [{"id": "8953e4f0-db77-497e-884b-2521c5b7d385", "address": "fa:16:3e:57:47:b5", "network": {"id": "3adf6b2e-86b8-4345-af2a-0d45f9d2c77b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-869289263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec2ff6a04934b24973a97b4cde3af01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8953e4f0-db", "ovs_interfaceid": "8953e4f0-db77-497e-884b-2521c5b7d385", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:46:43 user nova-compute[72239]: INFO nova.virt.block_device [None req-7af188e6-102a-4b0d-9e48-646a128649e3 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Attempting to driver detach volume 9782fe97-b7f9-4ca4-b75b-23c3ed01656a from mountpoint /dev/sdc
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Acquiring lock "f011c736-1a43-4b0e-ac7c-d512bcaa9bdc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Lock "f011c736-1a43-4b0e-ac7c-d512bcaa9bdc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:43 user nova-compute[72239]: INFO nova.compute.manager [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Attaching volume ab681c1d-23c4-4717-80b9-c98d504cca89 to /dev/vdb
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-00f02d88-e58c-43c2-bb24-1febeb03f68b req-5644326b-89e2-441b-9b72-602e136dffa6 service nova] Releasing lock "refresh_cache-f011c736-1a43-4b0e-ac7c-d512bcaa9bdc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7af188e6-102a-4b0d-9e48-646a128649e3 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Attempting to detach device sdc from instance c244056f-d17d-4d92-98bb-7c0de6a4d261 from the persistent domain config. {{(pid=72239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-7af188e6-102a-4b0d-9e48-646a128649e3 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 14:46:43 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:46:43 user nova-compute[72239]:   <source dev="/dev/sdh"/>
Jul 31 14:46:43 user nova-compute[72239]:   <target dev="sdc" bus="scsi"/>
Jul 31 14:46:43 user nova-compute[72239]:   <serial>9782fe97-b7f9-4ca4-b75b-23c3ed01656a</serial>
Jul 31 14:46:43 user nova-compute[72239]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jul 31 14:46:43 user nova-compute[72239]: </disk>
Jul 31 14:46:43 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 14:46:43 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-7af188e6-102a-4b0d-9e48-646a128649e3 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Successfully detached device sdc from instance c244056f-d17d-4d92-98bb-7c0de6a4d261 from the persistent domain config.
Jul 31 14:46:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7af188e6-102a-4b0d-9e48-646a128649e3 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance c244056f-d17d-4d92-98bb-7c0de6a4d261 from the live domain config. {{(pid=72239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-7af188e6-102a-4b0d-9e48-646a128649e3 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 14:46:43 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:46:43 user nova-compute[72239]:   <source dev="/dev/sdh"/>
Jul 31 14:46:43 user nova-compute[72239]:   <target dev="sdc" bus="scsi"/>
Jul 31 14:46:43 user nova-compute[72239]:   <serial>9782fe97-b7f9-4ca4-b75b-23c3ed01656a</serial>
Jul 31 14:46:43 user nova-compute[72239]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jul 31 14:46:43 user nova-compute[72239]: </disk>
Jul 31 14:46:43 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG os_brick.utils [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[27971cbb-a48e-4467-a259-bd2e75071477]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c27ad53-5669-4fa1-8278-724df26673a0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c299f2-b55d-4e3e-a032-e66da2819768]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc559ab-ce65-493f-a878-8cb54b1fe6a6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:46:43 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2107f42b-4bdd-4e49-a75b-1b2ae6e8b630]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG os_brick.utils [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] <== get_connector_properties: return (109ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Updating existing volume attachment record: a28bbf0e-1c77-43dd-b95f-46688e1bbef5 {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] <== connect_volume: return (1390ms) {'type': 'block', 'scsi_wwn': '26435363838623162', 'path': '/dev/sdi'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435363838623162', 'path': '/dev/sdi'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG nova.objects.instance [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lazy-loading 'flavor' on Instance uuid 62122879-2a72-4ddf-a028-317eda0da465 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 14:46:43 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:46:43 user nova-compute[72239]:   <source dev="/dev/sdi"/>
Jul 31 14:46:43 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:46:43 user nova-compute[72239]:   <serial>21fe9e13-7d8c-42ad-9778-45b6e1709dd3</serial>
Jul 31 14:46:43 user nova-compute[72239]: </disk>
Jul 31 14:46:43 user nova-compute[72239]:  {{(pid=72239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Received event <DeviceRemovedEvent: 1690814803.6286914, c244056f-d17d-4d92-98bb-7c0de6a4d261 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72239) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7af188e6-102a-4b0d-9e48-646a128649e3 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance c244056f-d17d-4d92-98bb-7c0de6a4d261 {{(pid=72239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 14:46:43 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-7af188e6-102a-4b0d-9e48-646a128649e3 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Successfully detached device sdc from instance c244056f-d17d-4d92-98bb-7c0de6a4d261 from the live domain config.
Jul 31 14:46:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7af188e6-102a-4b0d-9e48-646a128649e3 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af188e6-102a-4b0d-9e48-646a128649e3 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IfnpqXLc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:46:43 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-7af188e6-102a-4b0d-9e48-646a128649e3 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:46:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-7af188e6-102a-4b0d-9e48-646a128649e3 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-7af188e6-102a-4b0d-9e48-646a128649e3 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af188e6-102a-4b0d-9e48-646a128649e3 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e84a831-bc30-45d9-a481-b4ca099a31d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3726b9a7-99fe-474d-9b6f-655fd3485423]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af188e6-102a-4b0d-9e48-646a128649e3 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3 (non-flash)
Jul 31 14:46:43 user nova-compute[72239]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:46:43 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:46:43 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:46:43 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:46:43 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:46:43 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:46:43 user nova-compute[72239]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a (non-flash)
Jul 31 14:46:43 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af188e6-102a-4b0d-9e48-646a128649e3 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3 (non-flash)
Jul 31 14:46:43 user nova-compute[72239]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:46:43 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:46:43 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:46:43 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:46:43 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:46:43 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:46:43 user nova-compute[72239]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a (non-flash)
Jul 31 14:46:43 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af188e6-102a-4b0d-9e48-646a128649e3 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41214b1f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a'): ({'sdh'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-7af188e6-102a-4b0d-9e48-646a128649e3 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Removing single pathed devices sdh {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6fbdd5-d6d5-4692-8185-6d06abd73e4f]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[12742e08-e04a-45fe-b9da-4cead39585a9]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-7af188e6-102a-4b0d-9e48-646a128649e3 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Flushing IO for device /dev/sdh {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a58b651-262d-49c8-9bc0-a686db08ad0d]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-7af188e6-102a-4b0d-9e48-646a128649e3 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.042s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc56109d-9ac0-40d3-89dc-d27eff8cb18a]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-7af188e6-102a-4b0d-9e48-646a128649e3 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-7af188e6-102a-4b0d-9e48-646a128649e3 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] SCSI volumes sdh have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af188e6-102a-4b0d-9e48-646a128649e3 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c18de6-e5d2-4d1d-a243-f99df5650eee]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af188e6-102a-4b0d-9e48-646a128649e3 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce3073d-dd56-4f5b-b309-ecb7af335b2e]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af188e6-102a-4b0d-9e48-646a128649e3 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a, portal: 172.16.0.220,3260]
Jul 31 14:46:43 user nova-compute[72239]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a, portal: 172.16.0.220,3260] successful.
Jul 31 14:46:43 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9782fe97-b7f9-4ca4-b75b-23c3ed01656a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d271e1-460a-4c26-a5cb-da86e757eac4]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af188e6-102a-4b0d-9e48-646a128649e3 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-7af188e6-102a-4b0d-9e48-646a128649e3 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7af188e6-102a-4b0d-9e48-646a128649e3 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] <== disconnect_volume: return (310ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:46:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7af188e6-102a-4b0d-9e48-646a128649e3 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 14:46:44 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:46:44 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:46:44 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] No VIF found with MAC fa:16:3e:f6:05:0e, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:46:44 user nova-compute[72239]: DEBUG nova.objects.instance [None req-7af188e6-102a-4b0d-9e48-646a128649e3 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Lazy-loading 'flavor' on Instance uuid c244056f-d17d-4d92-98bb-7c0de6a4d261 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:46:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7af188e6-102a-4b0d-9e48-646a128649e3 tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Lock "c244056f-d17d-4d92-98bb-7c0de6a4d261" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.733s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7b29635f-5611-4568-b8ab-fa2e94dca9e0 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "62122879-2a72-4ddf-a028-317eda0da465" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.360s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xVXlqfQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:46:45 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:46:45 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:46:45 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:46:45 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:46:45 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[583ba659-86be-4e23-9028-70240c108ac4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 14:46:45 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[060b06c4-8977-4a73-9c54-159f3b3f447e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c] added
Jul 31 14:46:45 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4997d128-c015-4012-9529-b4af333f4f17]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da38877-89a4-4998-b262-dfd3e62d38b6]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xVXlqfQP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xVXlqfQP" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[affd197b-b988-465d-be7e-e30afa5f41c5]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xVXlqfQP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc79ec3c-5183-4aa6-a758-27a492df1622]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0014b296-3a62-40c8-8c96-56dba0a57b8b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3 (non-flash)
Jul 31 14:46:45 user nova-compute[72239]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:46:45 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:46:45 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:46:45 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:46:45 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:46:45 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:46:45 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3 (non-flash)
Jul 31 14:46:45 user nova-compute[72239]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:46:45 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:46:45 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:46:45 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:46:45 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:46:45 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:46:45 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c -p 172.16.0.220:3260 --login" returned: 0 in 0.095s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8974df00-f60b-4a36-bae1-e89eda083de2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c, portal: 172.16.0.220,3260]
Jul 31 14:46:45 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c, portal: 172.16.0.220,3260] successful.
Jul 31 14:46:45 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[439a2f75-eab2-48e4-8b1c-687677fbb663]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[88388f8c-0490-49ff-8e21-cf30750ec861]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3 (non-flash)
Jul 31 14:46:45 user nova-compute[72239]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c (non-flash)
Jul 31 14:46:45 user nova-compute[72239]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:46:45 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:46:45 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:46:45 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:46:45 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:46:45 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:46:45 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3 (non-flash)
Jul 31 14:46:45 user nova-compute[72239]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c (non-flash)
Jul 31 14:46:45 user nova-compute[72239]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:46:45 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:46:45 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:46:45 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:46:45 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:46:45 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:46:45 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.357s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] HCTL ('39', '-', '-', 0) found on session 11 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-23796290-2018-4a80-b9c6-84fba0cccb7c tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Acquiring lock "c244056f-d17d-4d92-98bb-7c0de6a4d261" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-23796290-2018-4a80-b9c6-84fba0cccb7c tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Lock "c244056f-d17d-4d92-98bb-7c0de6a4d261" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-23796290-2018-4a80-b9c6-84fba0cccb7c tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Acquiring lock "c244056f-d17d-4d92-98bb-7c0de6a4d261-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-23796290-2018-4a80-b9c6-84fba0cccb7c tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Lock "c244056f-d17d-4d92-98bb-7c0de6a4d261-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-23796290-2018-4a80-b9c6-84fba0cccb7c tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Lock "c244056f-d17d-4d92-98bb-7c0de6a4d261-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:45 user nova-compute[72239]: INFO nova.compute.manager [None req-23796290-2018-4a80-b9c6-84fba0cccb7c tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Terminating instance
Jul 31 14:46:45 user nova-compute[72239]: DEBUG nova.compute.manager [None req-23796290-2018-4a80-b9c6-84fba0cccb7c tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.051s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3646616b-b3f6-4f3e-acab-157bccabc110]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Searching for a device in session 11 and hctl ['39', '*', '*', 0] yield: None {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG nova.compute.manager [req-af484cb6-5d45-48cc-bb26-67ed00422586 req-506d98e4-aa6d-4062-832c-4cf272d494ab service nova] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Received event network-vif-unplugged-84eefab5-3319-4e79-9153-628396e013c6 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-af484cb6-5d45-48cc-bb26-67ed00422586 req-506d98e4-aa6d-4062-832c-4cf272d494ab service nova] Acquiring lock "c244056f-d17d-4d92-98bb-7c0de6a4d261-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-af484cb6-5d45-48cc-bb26-67ed00422586 req-506d98e4-aa6d-4062-832c-4cf272d494ab service nova] Lock "c244056f-d17d-4d92-98bb-7c0de6a4d261-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-af484cb6-5d45-48cc-bb26-67ed00422586 req-506d98e4-aa6d-4062-832c-4cf272d494ab service nova] Lock "c244056f-d17d-4d92-98bb-7c0de6a4d261-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG nova.compute.manager [req-af484cb6-5d45-48cc-bb26-67ed00422586 req-506d98e4-aa6d-4062-832c-4cf272d494ab service nova] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] No waiting events found dispatching network-vif-unplugged-84eefab5-3319-4e79-9153-628396e013c6 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG nova.compute.manager [req-af484cb6-5d45-48cc-bb26-67ed00422586 req-506d98e4-aa6d-4062-832c-4cf272d494ab service nova] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Received event network-vif-unplugged-84eefab5-3319-4e79-9153-628396e013c6 for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b54ecdaf-319f-440e-8c7a-6635153e83d6 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Acquiring lock "62122879-2a72-4ddf-a028-317eda0da465" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b54ecdaf-319f-440e-8c7a-6635153e83d6 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "62122879-2a72-4ddf-a028-317eda0da465" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:45 user nova-compute[72239]: INFO nova.compute.manager [None req-b54ecdaf-319f-440e-8c7a-6635153e83d6 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Detaching volume 21fe9e13-7d8c-42ad-9778-45b6e1709dd3
Jul 31 14:46:46 user nova-compute[72239]: INFO nova.virt.block_device [None req-b54ecdaf-319f-440e-8c7a-6635153e83d6 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Attempting to driver detach volume 21fe9e13-7d8c-42ad-9778-45b6e1709dd3 from mountpoint /dev/vdb
Jul 31 14:46:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b54ecdaf-319f-440e-8c7a-6635153e83d6 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Attempting to detach device vdb from instance 62122879-2a72-4ddf-a028-317eda0da465 from the persistent domain config. {{(pid=72239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-b54ecdaf-319f-440e-8c7a-6635153e83d6 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 14:46:46 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:46:46 user nova-compute[72239]:   <source dev="/dev/sdi"/>
Jul 31 14:46:46 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:46:46 user nova-compute[72239]:   <serial>21fe9e13-7d8c-42ad-9778-45b6e1709dd3</serial>
Jul 31 14:46:46 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 14:46:46 user nova-compute[72239]: </disk>
Jul 31 14:46:46 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 14:46:46 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-b54ecdaf-319f-440e-8c7a-6635153e83d6 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Successfully detached device vdb from instance 62122879-2a72-4ddf-a028-317eda0da465 from the persistent domain config.
Jul 31 14:46:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b54ecdaf-319f-440e-8c7a-6635153e83d6 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 62122879-2a72-4ddf-a028-317eda0da465 from the live domain config. {{(pid=72239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-b54ecdaf-319f-440e-8c7a-6635153e83d6 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 14:46:46 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:46:46 user nova-compute[72239]:   <source dev="/dev/sdi"/>
Jul 31 14:46:46 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:46:46 user nova-compute[72239]:   <serial>21fe9e13-7d8c-42ad-9778-45b6e1709dd3</serial>
Jul 31 14:46:46 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 14:46:46 user nova-compute[72239]: </disk>
Jul 31 14:46:46 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Searching for a device in session 11 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xVXlqfQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.424s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] <== connect_volume: return (1426ms) {'type': 'block', 'scsi_wwn': '26636353338306334', 'path': '/dev/sdh'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636353338306334', 'path': '/dev/sdh'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG nova.objects.instance [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lazy-loading 'flavor' on Instance uuid 9bd6169a-9a44-4d9c-a406-c10a2542a7b4 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 14:46:46 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:46:46 user nova-compute[72239]:   <source dev="/dev/sdh"/>
Jul 31 14:46:46 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:46:46 user nova-compute[72239]:   <serial>d7c86d6a-e784-4d16-9a14-26d4730da84c</serial>
Jul 31 14:46:46 user nova-compute[72239]: </disk>
Jul 31 14:46:46 user nova-compute[72239]:  {{(pid=72239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Received event <DeviceRemovedEvent: 1690814806.4790778, 62122879-2a72-4ddf-a028-317eda0da465 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72239) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b54ecdaf-319f-440e-8c7a-6635153e83d6 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 62122879-2a72-4ddf-a028-317eda0da465 {{(pid=72239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 14:46:46 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-b54ecdaf-319f-440e-8c7a-6635153e83d6 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Successfully detached device vdb from instance 62122879-2a72-4ddf-a028-317eda0da465 from the live domain config.
Jul 31 14:46:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b54ecdaf-319f-440e-8c7a-6635153e83d6 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54ecdaf-319f-440e-8c7a-6635153e83d6 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SXfgRtWB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:46:46 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-b54ecdaf-319f-440e-8c7a-6635153e83d6 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:46:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-b54ecdaf-319f-440e-8c7a-6635153e83d6 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-b54ecdaf-319f-440e-8c7a-6635153e83d6 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54ecdaf-319f-440e-8c7a-6635153e83d6 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:46 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Instance destroyed successfully.
Jul 31 14:46:46 user nova-compute[72239]: DEBUG nova.objects.instance [None req-23796290-2018-4a80-b9c6-84fba0cccb7c tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Lazy-loading 'resources' on Instance uuid c244056f-d17d-4d92-98bb-7c0de6a4d261 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2aeeb34-c469-4b07-b9fe-47afa37c08de]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-23796290-2018-4a80-b9c6-84fba0cccb7c tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:44:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-211925374',display_name='tempest-AttachSCSIVolumeTestJSON-server-211925374',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-211925374',id=7,image_ref='2b11b3a6-ec7a-4750-b89d-6b64a407ebcc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCsSz4wNbhGDLqBJd2RtQebiILhRgGDv3TUEzbCLPcKfJ94p3ZUPY0fqLGq7EeflZq3emYRXydauMSQx6uTNFnjFDrbJOqQgtohj/FIei2RyRfwzjE/gdGfQBPfxD9HDwA==',key_name='tempest-keypair-243965215',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:44:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f9bac52049b64df48709cc39d0eb0d8b',ramdisk_id='',reservation_id='r-50xmmsuc',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='2b11b3a6-ec7a-4750-b89d-6b64a407ebcc',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-410481285',owner_user_name='tempest-AttachSCSIVolumeTestJSON-410481285-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='26efb4513a03454182cf241961521114',uuid=c244056f-d17d-4d92-98bb-7c0de6a4d261,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84eefab5-3319-4e79-9153-628396e013c6", "address": "fa:16:3e:3f:0e:9a", "network": {"id": "ec35da67-9eac-4670-8019-ca1eff993e4c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2131299185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9bac52049b64df48709cc39d0eb0d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84eefab5-33", "ovs_interfaceid": "84eefab5-3319-4e79-9153-628396e013c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-23796290-2018-4a80-b9c6-84fba0cccb7c tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Converting VIF {"id": "84eefab5-3319-4e79-9153-628396e013c6", "address": "fa:16:3e:3f:0e:9a", "network": {"id": "ec35da67-9eac-4670-8019-ca1eff993e4c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2131299185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.3", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f9bac52049b64df48709cc39d0eb0d8b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84eefab5-33", "ovs_interfaceid": "84eefab5-3319-4e79-9153-628396e013c6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-23796290-2018-4a80-b9c6-84fba0cccb7c tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3f:0e:9a,bridge_name='br-int',has_traffic_filtering=True,id=84eefab5-3319-4e79-9153-628396e013c6,network=Network(ec35da67-9eac-4670-8019-ca1eff993e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84eefab5-33') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG os_vif [None req-23796290-2018-4a80-b9c6-84fba0cccb7c tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:0e:9a,bridge_name='br-int',has_traffic_filtering=True,id=84eefab5-3319-4e79-9153-628396e013c6,network=Network(ec35da67-9eac-4670-8019-ca1eff993e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84eefab5-33') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84eefab5-33, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:46 user nova-compute[72239]: INFO os_vif [None req-23796290-2018-4a80-b9c6-84fba0cccb7c tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3f:0e:9a,bridge_name='br-int',has_traffic_filtering=True,id=84eefab5-3319-4e79-9153-628396e013c6,network=Network(ec35da67-9eac-4670-8019-ca1eff993e4c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84eefab5-33')
Jul 31 14:46:46 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-23796290-2018-4a80-b9c6-84fba0cccb7c tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Deleting instance files /opt/stack/data/nova/instances/c244056f-d17d-4d92-98bb-7c0de6a4d261_del
Jul 31 14:46:46 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-23796290-2018-4a80-b9c6-84fba0cccb7c tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Deletion of /opt/stack/data/nova/instances/c244056f-d17d-4d92-98bb-7c0de6a4d261_del complete
Jul 31 14:46:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23ba4de-f976-4e25-b444-57e2ff8d5a48]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54ecdaf-319f-440e-8c7a-6635153e83d6 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3 (non-flash)
Jul 31 14:46:46 user nova-compute[72239]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c (non-flash)
Jul 31 14:46:46 user nova-compute[72239]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:46:46 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:46:46 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:46:46 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:46:46 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:46:46 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:46:46 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54ecdaf-319f-440e-8c7a-6635153e83d6 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3 (non-flash)
Jul 31 14:46:46 user nova-compute[72239]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c (non-flash)
Jul 31 14:46:46 user nova-compute[72239]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:46:46 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:46:46 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:46:46 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:46:46 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:46:46 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:46:46 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54ecdaf-319f-440e-8c7a-6635153e83d6 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4126c4e3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3'): ({'sdi'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-b54ecdaf-319f-440e-8c7a-6635153e83d6 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Removing single pathed devices sdi {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[68caff66-0b32-4d3d-8f0d-a3e858f17a58]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d20d6d-91c3-4a49-b04f-75b5232b9fa8]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-b54ecdaf-319f-440e-8c7a-6635153e83d6 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Flushing IO for device /dev/sdi {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:46 user nova-compute[72239]: INFO nova.compute.manager [None req-23796290-2018-4a80-b9c6-84fba0cccb7c tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Took 1.23 seconds to destroy the instance on the hypervisor.
Jul 31 14:46:46 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-23796290-2018-4a80-b9c6-84fba0cccb7c tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.013s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a7cfa9-2d8a-4536-b6aa-8cf2775142c8]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-b54ecdaf-319f-440e-8c7a-6635153e83d6 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.042s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[57917625-f032-4ef9-baf2-1639111f6420]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-b54ecdaf-319f-440e-8c7a-6635153e83d6 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-b54ecdaf-319f-440e-8c7a-6635153e83d6 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] SCSI volumes sdi have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54ecdaf-319f-440e-8c7a-6635153e83d6 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ad1f86-b69e-4751-9d9c-41e30a470194]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54ecdaf-319f-440e-8c7a-6635153e83d6 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3 -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3f04cc-46d6-4b83-ac25-baf242ead9d8]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54ecdaf-319f-440e-8c7a-6635153e83d6 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3, portal: 172.16.0.220,3260]
Jul 31 14:46:46 user nova-compute[72239]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3, portal: 172.16.0.220,3260] successful.
Jul 31 14:46:46 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3 -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:21fe9e13-7d8c-42ad-9778-45b6e1709dd3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad391b1-8370-4749-ae17-0561e0428683]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54ecdaf-319f-440e-8c7a-6635153e83d6 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-b54ecdaf-319f-440e-8c7a-6635153e83d6 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b54ecdaf-319f-440e-8c7a-6635153e83d6 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] <== disconnect_volume: return (332ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b54ecdaf-319f-440e-8c7a-6635153e83d6 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] No BDM found with device name hda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:46:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] No VIF found with MAC fa:16:3e:25:8c:a7, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:46:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b6fe2c1a-d36d-48d6-9f0b-9a46c35c4c7c tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.658s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:47 user nova-compute[72239]: DEBUG nova.objects.instance [None req-b54ecdaf-319f-440e-8c7a-6635153e83d6 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lazy-loading 'flavor' on Instance uuid 62122879-2a72-4ddf-a028-317eda0da465 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:46:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b54ecdaf-319f-440e-8c7a-6635153e83d6 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "62122879-2a72-4ddf-a028-317eda0da465" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.733s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:47 user nova-compute[72239]: DEBUG nova.compute.manager [req-8be791ac-7531-426a-ad00-b47769ef3449 req-14d3fdb5-002f-4876-805d-581b06664b57 service nova] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Received event network-vif-plugged-84eefab5-3319-4e79-9153-628396e013c6 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:46:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-8be791ac-7531-426a-ad00-b47769ef3449 req-14d3fdb5-002f-4876-805d-581b06664b57 service nova] Acquiring lock "c244056f-d17d-4d92-98bb-7c0de6a4d261-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-8be791ac-7531-426a-ad00-b47769ef3449 req-14d3fdb5-002f-4876-805d-581b06664b57 service nova] Lock "c244056f-d17d-4d92-98bb-7c0de6a4d261-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-8be791ac-7531-426a-ad00-b47769ef3449 req-14d3fdb5-002f-4876-805d-581b06664b57 service nova] Lock "c244056f-d17d-4d92-98bb-7c0de6a4d261-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:47 user nova-compute[72239]: DEBUG nova.compute.manager [req-8be791ac-7531-426a-ad00-b47769ef3449 req-14d3fdb5-002f-4876-805d-581b06664b57 service nova] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] No waiting events found dispatching network-vif-plugged-84eefab5-3319-4e79-9153-628396e013c6 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:46:47 user nova-compute[72239]: WARNING nova.compute.manager [req-8be791ac-7531-426a-ad00-b47769ef3449 req-14d3fdb5-002f-4876-805d-581b06664b57 service nova] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Received unexpected event network-vif-plugged-84eefab5-3319-4e79-9153-628396e013c6 for instance with vm_state active and task_state deleting.
Jul 31 14:46:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ce859df0-3578-4e5f-9e09-5d8d75f847e5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Acquiring lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ce859df0-3578-4e5f-9e09-5d8d75f847e5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:48 user nova-compute[72239]: INFO nova.compute.manager [None req-ce859df0-3578-4e5f-9e09-5d8d75f847e5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Detaching volume d7c86d6a-e784-4d16-9a14-26d4730da84c
Jul 31 14:46:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:46:48 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Took 1.51 seconds to deallocate network for instance.
Jul 31 14:46:48 user nova-compute[72239]: DEBUG nova.compute.manager [req-1a820cd1-b4e1-4af2-903c-9a0124b655c2 req-37751966-3659-4be0-9029-0b31892e94b5 service nova] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Received event network-vif-deleted-84eefab5-3319-4e79-9153-628396e013c6 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-23796290-2018-4a80-b9c6-84fba0cccb7c tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-23796290-2018-4a80-b9c6-84fba0cccb7c tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:48 user nova-compute[72239]: INFO nova.virt.block_device [None req-ce859df0-3578-4e5f-9e09-5d8d75f847e5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Attempting to driver detach volume d7c86d6a-e784-4d16-9a14-26d4730da84c from mountpoint /dev/vdb
Jul 31 14:46:48 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-ce859df0-3578-4e5f-9e09-5d8d75f847e5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Attempting to detach device vdb from instance 9bd6169a-9a44-4d9c-a406-c10a2542a7b4 from the persistent domain config. {{(pid=72239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-ce859df0-3578-4e5f-9e09-5d8d75f847e5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 14:46:48 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:46:48 user nova-compute[72239]:   <source dev="/dev/sdh"/>
Jul 31 14:46:48 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:46:48 user nova-compute[72239]:   <serial>d7c86d6a-e784-4d16-9a14-26d4730da84c</serial>
Jul 31 14:46:48 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 31 14:46:48 user nova-compute[72239]: </disk>
Jul 31 14:46:48 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 14:46:48 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-ce859df0-3578-4e5f-9e09-5d8d75f847e5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Successfully detached device vdb from instance 9bd6169a-9a44-4d9c-a406-c10a2542a7b4 from the persistent domain config.
Jul 31 14:46:48 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-ce859df0-3578-4e5f-9e09-5d8d75f847e5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9bd6169a-9a44-4d9c-a406-c10a2542a7b4 from the live domain config. {{(pid=72239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-ce859df0-3578-4e5f-9e09-5d8d75f847e5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 14:46:48 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:46:48 user nova-compute[72239]:   <source dev="/dev/sdh"/>
Jul 31 14:46:48 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:46:48 user nova-compute[72239]:   <serial>d7c86d6a-e784-4d16-9a14-26d4730da84c</serial>
Jul 31 14:46:48 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 31 14:46:48 user nova-compute[72239]: </disk>
Jul 31 14:46:48 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-23796290-2018-4a80-b9c6-84fba0cccb7c tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-23796290-2018-4a80-b9c6-84fba0cccb7c tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-23796290-2018-4a80-b9c6-84fba0cccb7c tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:48 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-23796290-2018-4a80-b9c6-84fba0cccb7c tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Deleted allocations for instance c244056f-d17d-4d92-98bb-7c0de6a4d261
Jul 31 14:46:48 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Received event <DeviceRemovedEvent: 1690814808.6554937, 9bd6169a-9a44-4d9c-a406-c10a2542a7b4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72239) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-ce859df0-3578-4e5f-9e09-5d8d75f847e5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9bd6169a-9a44-4d9c-a406-c10a2542a7b4 {{(pid=72239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 14:46:48 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-ce859df0-3578-4e5f-9e09-5d8d75f847e5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Successfully detached device vdb from instance 9bd6169a-9a44-4d9c-a406-c10a2542a7b4 from the live domain config.
Jul 31 14:46:48 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce859df0-3578-4e5f-9e09-5d8d75f847e5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce859df0-3578-4e5f-9e09-5d8d75f847e5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xVXlqfQP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:46:48 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-ce859df0-3578-4e5f-9e09-5d8d75f847e5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:46:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-ce859df0-3578-4e5f-9e09-5d8d75f847e5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-ce859df0-3578-4e5f-9e09-5d8d75f847e5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce859df0-3578-4e5f-9e09-5d8d75f847e5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-23796290-2018-4a80-b9c6-84fba0cccb7c tempest-AttachSCSIVolumeTestJSON-410481285 tempest-AttachSCSIVolumeTestJSON-410481285-project-member] Lock "c244056f-d17d-4d92-98bb-7c0de6a4d261" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.309s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f41f96c-6c9f-4948-af92-819559d5552b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5359519c-3b99-4380-91f3-95f222643813]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce859df0-3578-4e5f-9e09-5d8d75f847e5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c (non-flash)
Jul 31 14:46:48 user nova-compute[72239]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:46:48 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:46:48 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:46:48 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:46:48 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:46:48 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:46:48 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce859df0-3578-4e5f-9e09-5d8d75f847e5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c (non-flash)
Jul 31 14:46:48 user nova-compute[72239]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:46:48 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:46:48 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:46:48 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:46:48 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:46:48 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:46:48 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce859df0-3578-4e5f-9e09-5d8d75f847e5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41214b39a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c'): ({'sdh'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-ce859df0-3578-4e5f-9e09-5d8d75f847e5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Removing single pathed devices sdh {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[05663349-0b6b-4069-8350-0affb3512d1e]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb90c887-ffce-4433-80a0-f4f0ecdc8da1]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-ce859df0-3578-4e5f-9e09-5d8d75f847e5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Flushing IO for device /dev/sdh {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff4802c-52e5-4841-9c94-068f11839c64]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-ce859df0-3578-4e5f-9e09-5d8d75f847e5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.047s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3579f81f-90c6-46b5-96c7-198dd7a96a63]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-ce859df0-3578-4e5f-9e09-5d8d75f847e5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-ce859df0-3578-4e5f-9e09-5d8d75f847e5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] SCSI volumes sdh have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce859df0-3578-4e5f-9e09-5d8d75f847e5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ba9200-efd8-44c6-a5ff-788c2829294c]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce859df0-3578-4e5f-9e09-5d8d75f847e5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[117b401a-f74a-460d-8cbe-148aafe752d5]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce859df0-3578-4e5f-9e09-5d8d75f847e5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c, portal: 172.16.0.220,3260]
Jul 31 14:46:48 user nova-compute[72239]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c, portal: 172.16.0.220,3260] successful.
Jul 31 14:46:48 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7c86d6a-e784-4d16-9a14-26d4730da84c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[146ce941-6916-4400-86e4-ac417012744f]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce859df0-3578-4e5f-9e09-5d8d75f847e5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-ce859df0-3578-4e5f-9e09-5d8d75f847e5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce859df0-3578-4e5f-9e09-5d8d75f847e5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] <== disconnect_volume: return (325ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:46:48 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce859df0-3578-4e5f-9e09-5d8d75f847e5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 14:46:49 user nova-compute[72239]: DEBUG nova.objects.instance [None req-ce859df0-3578-4e5f-9e09-5d8d75f847e5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lazy-loading 'flavor' on Instance uuid 9bd6169a-9a44-4d9c-a406-c10a2542a7b4 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:46:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ce859df0-3578-4e5f-9e09-5d8d75f847e5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.784s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4627c361-9a65-4b07-8d62-3922200dd4c4 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Acquiring lock "interface-9bd6169a-9a44-4d9c-a406-c10a2542a7b4-377c42af-1122-41e2-9dba-9986e495c09a" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4627c361-9a65-4b07-8d62-3922200dd4c4 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lock "interface-9bd6169a-9a44-4d9c-a406-c10a2542a7b4-377c42af-1122-41e2-9dba-9986e495c09a" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:50 user nova-compute[72239]: DEBUG nova.objects.instance [None req-4627c361-9a65-4b07-8d62-3922200dd4c4 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lazy-loading 'flavor' on Instance uuid 9bd6169a-9a44-4d9c-a406-c10a2542a7b4 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:46:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-4627c361-9a65-4b07-8d62-3922200dd4c4 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1518629609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1518629609',id=9,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkO64Mxo9V45ZvyZddW60Bj3R/wxTnuP74Wl0QbQrxRPpHV5wIIOFOuVL0TXCzmSq9fH99PAiORRcNxyzp52Ts3i5cecEtzUOk3DHNvVsfSIw0FbT8y4KNU2UgxwmOgpg==',key_name='tempest-keypair-1851777278',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:44:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ef0e60cdf6a46cfb149c45d8f5443c6',ramdisk_id='',reservation_id='r-uyqcqdz1',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-99713276',owner_user_name='tempest-TaggedAttachmentsTest-99713276-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:44:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffb1bd7bcf554374b9b3c5bb1fc2b00a',uuid=9bd6169a-9a44-4d9c-a406-c10a2542a7b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "377c42af-1122-41e2-9dba-9986e495c09a", "address": "fa:16:3e:11:fc:32", "network": {"id": "b396cce0-2406-4897-966e-5fa419b42fee", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1921449827", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ef0e60cdf6a46cfb149c45d8f5443c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377c42af-11", "ovs_interfaceid": "377c42af-1122-41e2-9dba-9986e495c09a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:46:50 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-4627c361-9a65-4b07-8d62-3922200dd4c4 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Converting VIF {"id": "377c42af-1122-41e2-9dba-9986e495c09a", "address": "fa:16:3e:11:fc:32", "network": {"id": "b396cce0-2406-4897-966e-5fa419b42fee", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1921449827", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ef0e60cdf6a46cfb149c45d8f5443c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377c42af-11", "ovs_interfaceid": "377c42af-1122-41e2-9dba-9986e495c09a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:46:50 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-4627c361-9a65-4b07-8d62-3922200dd4c4 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:fc:32,bridge_name='br-int',has_traffic_filtering=True,id=377c42af-1122-41e2-9dba-9986e495c09a,network=Network(b396cce0-2406-4897-966e-5fa419b42fee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap377c42af-11') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:46:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-4627c361-9a65-4b07-8d62-3922200dd4c4 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:11:fc:32"/><model type="virtio"/><mtu size="1442"/><target dev="tap377c42af-11"/></interface> {{(pid=72239) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 31 14:46:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-4627c361-9a65-4b07-8d62-3922200dd4c4 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:11:fc:32"/><model type="virtio"/><mtu size="1442"/><target dev="tap377c42af-11"/></interface> {{(pid=72239) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 31 14:46:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4627c361-9a65-4b07-8d62-3922200dd4c4 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Attempting to detach device tap377c42af-11 from instance 9bd6169a-9a44-4d9c-a406-c10a2542a7b4 from the persistent domain config. {{(pid=72239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 14:46:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-4627c361-9a65-4b07-8d62-3922200dd4c4 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] detach device xml: <interface type="ethernet">
Jul 31 14:46:50 user nova-compute[72239]:   <mac address="fa:16:3e:11:fc:32"/>
Jul 31 14:46:50 user nova-compute[72239]:   <model type="virtio"/>
Jul 31 14:46:50 user nova-compute[72239]:   <mtu size="1442"/>
Jul 31 14:46:50 user nova-compute[72239]:   <target dev="tap377c42af-11"/>
Jul 31 14:46:50 user nova-compute[72239]: </interface>
Jul 31 14:46:50 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 14:46:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-4627c361-9a65-4b07-8d62-3922200dd4c4 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:11:fc:32"/><model type="virtio"/><mtu size="1442"/><target dev="tap377c42af-11"/></interface> {{(pid=72239) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 31 14:46:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-4627c361-9a65-4b07-8d62-3922200dd4c4 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:11:fc:32"/><model type="virtio"/><mtu size="1442"/><target dev="tap377c42af-11"/></interface>not found in domain: <domain type='kvm' id='9'>
Jul 31 14:46:50 user nova-compute[72239]:   <name>instance-00000009</name>
Jul 31 14:46:50 user nova-compute[72239]:   <uuid>9bd6169a-9a44-4d9c-a406-c10a2542a7b4</uuid>
Jul 31 14:46:50 user nova-compute[72239]:   <metadata>
Jul 31 14:46:50 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:46:50 user nova-compute[72239]:   <nova:package version="0.0.0"/>
Jul 31 14:46:50 user nova-compute[72239]:   <nova:name>tempest-device-tagging-server-1518629609</nova:name>
Jul 31 14:46:50 user nova-compute[72239]:   <nova:creationTime>2023-07-31 14:46:35</nova:creationTime>
Jul 31 14:46:50 user nova-compute[72239]:   <nova:flavor name="m1.tiny">
Jul 31 14:46:50 user nova-compute[72239]:     <nova:memory>512</nova:memory>
Jul 31 14:46:50 user nova-compute[72239]:     <nova:disk>1</nova:disk>
Jul 31 14:46:50 user nova-compute[72239]:     <nova:swap>0</nova:swap>
Jul 31 14:46:50 user nova-compute[72239]:     <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:46:50 user nova-compute[72239]:     <nova:vcpus>1</nova:vcpus>
Jul 31 14:46:50 user nova-compute[72239]:   </nova:flavor>
Jul 31 14:46:50 user nova-compute[72239]:   <nova:owner>
Jul 31 14:46:50 user nova-compute[72239]:     <nova:user uuid="ffb1bd7bcf554374b9b3c5bb1fc2b00a">tempest-TaggedAttachmentsTest-99713276-project-member</nova:user>
Jul 31 14:46:50 user nova-compute[72239]:     <nova:project uuid="0ef0e60cdf6a46cfb149c45d8f5443c6">tempest-TaggedAttachmentsTest-99713276</nova:project>
Jul 31 14:46:50 user nova-compute[72239]:   </nova:owner>
Jul 31 14:46:50 user nova-compute[72239]:   <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:46:50 user nova-compute[72239]:   <nova:ports>
Jul 31 14:46:50 user nova-compute[72239]:     <nova:port uuid="bc41ac8f-b231-4381-9278-64ce17f8833d">
Jul 31 14:46:50 user nova-compute[72239]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 31 14:46:50 user nova-compute[72239]:     </nova:port>
Jul 31 14:46:50 user nova-compute[72239]:     <nova:port uuid="377c42af-1122-41e2-9dba-9986e495c09a">
Jul 31 14:46:50 user nova-compute[72239]:       <nova:ip type="fixed" address="10.10.10.107" ipVersion="4"/>
Jul 31 14:46:50 user nova-compute[72239]:     </nova:port>
Jul 31 14:46:50 user nova-compute[72239]:   </nova:ports>
Jul 31 14:46:50 user nova-compute[72239]: </nova:instance>
Jul 31 14:46:50 user nova-compute[72239]:   </metadata>
Jul 31 14:46:50 user nova-compute[72239]:   <memory unit='KiB'>524288</memory>
Jul 31 14:46:50 user nova-compute[72239]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 31 14:46:50 user nova-compute[72239]:   <vcpu placement='static'>1</vcpu>
Jul 31 14:46:50 user nova-compute[72239]:   <resource>
Jul 31 14:46:50 user nova-compute[72239]:     <partition>/machine</partition>
Jul 31 14:46:50 user nova-compute[72239]:   </resource>
Jul 31 14:46:50 user nova-compute[72239]:   <sysinfo type='smbios'>
Jul 31 14:46:50 user nova-compute[72239]:     <system>
Jul 31 14:46:50 user nova-compute[72239]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 31 14:46:50 user nova-compute[72239]:       <entry name='product'>OpenStack Nova</entry>
Jul 31 14:46:50 user nova-compute[72239]:       <entry name='version'>0.0.0</entry>
Jul 31 14:46:50 user nova-compute[72239]:       <entry name='serial'>9bd6169a-9a44-4d9c-a406-c10a2542a7b4</entry>
Jul 31 14:46:50 user nova-compute[72239]:       <entry name='uuid'>9bd6169a-9a44-4d9c-a406-c10a2542a7b4</entry>
Jul 31 14:46:50 user nova-compute[72239]:       <entry name='family'>Virtual Machine</entry>
Jul 31 14:46:50 user nova-compute[72239]:     </system>
Jul 31 14:46:50 user nova-compute[72239]:   </sysinfo>
Jul 31 14:46:50 user nova-compute[72239]:   <os>
Jul 31 14:46:50 user nova-compute[72239]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 31 14:46:50 user nova-compute[72239]:     <boot dev='hd'/>
Jul 31 14:46:50 user nova-compute[72239]:     <smbios mode='sysinfo'/>
Jul 31 14:46:50 user nova-compute[72239]:   </os>
Jul 31 14:46:50 user nova-compute[72239]:   <features>
Jul 31 14:46:50 user nova-compute[72239]:     <acpi/>
Jul 31 14:46:50 user nova-compute[72239]:     <apic/>
Jul 31 14:46:50 user nova-compute[72239]:     <vmcoreinfo state='on'/>
Jul 31 14:46:50 user nova-compute[72239]:   </features>
Jul 31 14:46:50 user nova-compute[72239]:   <cpu mode='custom' match='exact' check='full'>
Jul 31 14:46:50 user nova-compute[72239]:     <model fallback='forbid'>Nehalem</model>
Jul 31 14:46:50 user nova-compute[72239]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 31 14:46:50 user nova-compute[72239]:     <feature policy='require' name='vme'/>
Jul 31 14:46:50 user nova-compute[72239]:     <feature policy='require' name='x2apic'/>
Jul 31 14:46:50 user nova-compute[72239]:     <feature policy='require' name='hypervisor'/>
Jul 31 14:46:50 user nova-compute[72239]:   </cpu>
Jul 31 14:46:50 user nova-compute[72239]:   <clock offset='utc'>
Jul 31 14:46:50 user nova-compute[72239]:     <timer name='pit' tickpolicy='delay'/>
Jul 31 14:46:50 user nova-compute[72239]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 31 14:46:50 user nova-compute[72239]:     <timer name='hpet' present='no'/>
Jul 31 14:46:50 user nova-compute[72239]:   </clock>
Jul 31 14:46:50 user nova-compute[72239]:   <on_poweroff>destroy</on_poweroff>
Jul 31 14:46:50 user nova-compute[72239]:   <on_reboot>restart</on_reboot>
Jul 31 14:46:50 user nova-compute[72239]:   <on_crash>destroy</on_crash>
Jul 31 14:46:50 user nova-compute[72239]:   <devices>
Jul 31 14:46:50 user nova-compute[72239]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 31 14:46:50 user nova-compute[72239]:     <disk type='file' device='disk'>
Jul 31 14:46:50 user nova-compute[72239]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 31 14:46:50 user nova-compute[72239]:       <source file='/opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/disk' index='2'/>
Jul 31 14:46:50 user nova-compute[72239]:       <backingStore type='file' index='3'>
Jul 31 14:46:50 user nova-compute[72239]:         <format type='raw'/>
Jul 31 14:46:50 user nova-compute[72239]:         <source file='/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444'/>
Jul 31 14:46:50 user nova-compute[72239]:         <backingStore/>
Jul 31 14:46:50 user nova-compute[72239]:       </backingStore>
Jul 31 14:46:50 user nova-compute[72239]:       <target dev='vda' bus='virtio'/>
Jul 31 14:46:50 user nova-compute[72239]:       <alias name='virtio-disk0'/>
Jul 31 14:46:50 user nova-compute[72239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 31 14:46:50 user nova-compute[72239]:     </disk>
Jul 31 14:46:50 user nova-compute[72239]:     <disk type='file' device='cdrom'>
Jul 31 14:46:50 user nova-compute[72239]:       <driver name='qemu' type='raw' cache='none'/>
Jul 31 14:46:50 user nova-compute[72239]:       <source file='/opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/disk.config' index='1'/>
Jul 31 14:46:50 user nova-compute[72239]:       <backingStore/>
Jul 31 14:46:50 user nova-compute[72239]:       <target dev='hda' bus='ide'/>
Jul 31 14:46:50 user nova-compute[72239]:       <readonly/>
Jul 31 14:46:50 user nova-compute[72239]:       <alias name='ide0-0-0'/>
Jul 31 14:46:50 user nova-compute[72239]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 31 14:46:50 user nova-compute[72239]:     </disk>
Jul 31 14:46:50 user nova-compute[72239]:     <controller type='usb' index='0' model='none'>
Jul 31 14:46:50 user nova-compute[72239]:       <alias name='usb'/>
Jul 31 14:46:50 user nova-compute[72239]:     </controller>
Jul 31 14:46:50 user nova-compute[72239]:     <controller type='pci' index='0' model='pci-root'>
Jul 31 14:46:50 user nova-compute[72239]:       <alias name='pci.0'/>
Jul 31 14:46:50 user nova-compute[72239]:     </controller>
Jul 31 14:46:50 user nova-compute[72239]:     <controller type='ide' index='0'>
Jul 31 14:46:50 user nova-compute[72239]:       <alias name='ide'/>
Jul 31 14:46:50 user nova-compute[72239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 31 14:46:50 user nova-compute[72239]:     </controller>
Jul 31 14:46:50 user nova-compute[72239]:     <interface type='ethernet'>
Jul 31 14:46:50 user nova-compute[72239]:       <mac address='fa:16:3e:25:8c:a7'/>
Jul 31 14:46:50 user nova-compute[72239]:       <target dev='tapbc41ac8f-b2'/>
Jul 31 14:46:50 user nova-compute[72239]:       <model type='virtio'/>
Jul 31 14:46:50 user nova-compute[72239]:       <mtu size='1442'/>
Jul 31 14:46:50 user nova-compute[72239]:       <alias name='net0'/>
Jul 31 14:46:50 user nova-compute[72239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 31 14:46:50 user nova-compute[72239]:     </interface>
Jul 31 14:46:50 user nova-compute[72239]:     <interface type='ethernet'>
Jul 31 14:46:50 user nova-compute[72239]:       <mac address='fa:16:3e:11:fc:32'/>
Jul 31 14:46:50 user nova-compute[72239]:       <target dev='tap377c42af-11'/>
Jul 31 14:46:50 user nova-compute[72239]:       <model type='virtio'/>
Jul 31 14:46:50 user nova-compute[72239]:       <mtu size='1442'/>
Jul 31 14:46:50 user nova-compute[72239]:       <alias name='net1'/>
Jul 31 14:46:50 user nova-compute[72239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Jul 31 14:46:50 user nova-compute[72239]:     </interface>
Jul 31 14:46:50 user nova-compute[72239]:     <serial type='pty'>
Jul 31 14:46:50 user nova-compute[72239]:       <source path='/dev/pts/8'/>
Jul 31 14:46:50 user nova-compute[72239]:       <log file='/opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/console.log' append='off'/>
Jul 31 14:46:50 user nova-compute[72239]:       <target type='isa-serial' port='0'>
Jul 31 14:46:50 user nova-compute[72239]:         <model name='isa-serial'/>
Jul 31 14:46:50 user nova-compute[72239]:       </target>
Jul 31 14:46:50 user nova-compute[72239]:       <alias name='serial0'/>
Jul 31 14:46:50 user nova-compute[72239]:     </serial>
Jul 31 14:46:50 user nova-compute[72239]:     <console type='pty' tty='/dev/pts/8'>
Jul 31 14:46:50 user nova-compute[72239]:       <source path='/dev/pts/8'/>
Jul 31 14:46:50 user nova-compute[72239]:       <log file='/opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/console.log' append='off'/>
Jul 31 14:46:50 user nova-compute[72239]:       <target type='serial' port='0'/>
Jul 31 14:46:50 user nova-compute[72239]:       <alias name='serial0'/>
Jul 31 14:46:50 user nova-compute[72239]:     </console>
Jul 31 14:46:50 user nova-compute[72239]:     <input type='mouse' bus='ps2'>
Jul 31 14:46:50 user nova-compute[72239]:       <alias name='input0'/>
Jul 31 14:46:50 user nova-compute[72239]:     </input>
Jul 31 14:46:50 user nova-compute[72239]:     <input type='keyboard' bus='ps2'>
Jul 31 14:46:50 user nova-compute[72239]:       <alias name='input1'/>
Jul 31 14:46:50 user nova-compute[72239]:     </input>
Jul 31 14:46:50 user nova-compute[72239]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Jul 31 14:46:50 user nova-compute[72239]:       <listen type='address' address='0.0.0.0'/>
Jul 31 14:46:50 user nova-compute[72239]:     </graphics>
Jul 31 14:46:50 user nova-compute[72239]:     <audio id='1' type='none'/>
Jul 31 14:46:50 user nova-compute[72239]:     <video>
Jul 31 14:46:50 user nova-compute[72239]:       <model type='virtio' heads='1' primary='yes'/>
Jul 31 14:46:50 user nova-compute[72239]:       <alias name='video0'/>
Jul 31 14:46:50 user nova-compute[72239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 31 14:46:50 user nova-compute[72239]:     </video>
Jul 31 14:46:50 user nova-compute[72239]:     <memballoon model='virtio'>
Jul 31 14:46:50 user nova-compute[72239]:       <stats period='10'/>
Jul 31 14:46:50 user nova-compute[72239]:       <alias name='balloon0'/>
Jul 31 14:46:50 user nova-compute[72239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 31 14:46:50 user nova-compute[72239]:     </memballoon>
Jul 31 14:46:50 user nova-compute[72239]:     <rng model='virtio'>
Jul 31 14:46:50 user nova-compute[72239]:       <backend model='random'>/dev/urandom</backend>
Jul 31 14:46:50 user nova-compute[72239]:       <alias name='rng0'/>
Jul 31 14:46:50 user nova-compute[72239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 31 14:46:50 user nova-compute[72239]:     </rng>
Jul 31 14:46:50 user nova-compute[72239]:   </devices>
Jul 31 14:46:50 user nova-compute[72239]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 31 14:46:50 user nova-compute[72239]:     <label>libvirt-9bd6169a-9a44-4d9c-a406-c10a2542a7b4</label>
Jul 31 14:46:50 user nova-compute[72239]:     <imagelabel>libvirt-9bd6169a-9a44-4d9c-a406-c10a2542a7b4</imagelabel>
Jul 31 14:46:50 user nova-compute[72239]:   </seclabel>
Jul 31 14:46:50 user nova-compute[72239]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 31 14:46:50 user nova-compute[72239]:     <label>+64055:+108</label>
Jul 31 14:46:50 user nova-compute[72239]:     <imagelabel>+64055:+108</imagelabel>
Jul 31 14:46:50 user nova-compute[72239]:   </seclabel>
Jul 31 14:46:50 user nova-compute[72239]: </domain>
Jul 31 14:46:50 user nova-compute[72239]:  {{(pid=72239) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 31 14:46:50 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-4627c361-9a65-4b07-8d62-3922200dd4c4 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Successfully detached device tap377c42af-11 from instance 9bd6169a-9a44-4d9c-a406-c10a2542a7b4 from the persistent domain config.
Jul 31 14:46:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4627c361-9a65-4b07-8d62-3922200dd4c4 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] (1/8): Attempting to detach device tap377c42af-11 with device alias net1 from instance 9bd6169a-9a44-4d9c-a406-c10a2542a7b4 from the live domain config. {{(pid=72239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 14:46:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-4627c361-9a65-4b07-8d62-3922200dd4c4 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] detach device xml: <interface type="ethernet">
Jul 31 14:46:50 user nova-compute[72239]:   <mac address="fa:16:3e:11:fc:32"/>
Jul 31 14:46:50 user nova-compute[72239]:   <model type="virtio"/>
Jul 31 14:46:50 user nova-compute[72239]:   <mtu size="1442"/>
Jul 31 14:46:50 user nova-compute[72239]:   <target dev="tap377c42af-11"/>
Jul 31 14:46:50 user nova-compute[72239]: </interface>
Jul 31 14:46:50 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 14:46:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Received event <DeviceRemovedEvent: 1690814810.688425, 9bd6169a-9a44-4d9c-a406-c10a2542a7b4 => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72239) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 14:46:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4627c361-9a65-4b07-8d62-3922200dd4c4 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Start waiting for the detach event from libvirt for device tap377c42af-11 with device alias net1 for instance 9bd6169a-9a44-4d9c-a406-c10a2542a7b4 {{(pid=72239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 14:46:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-4627c361-9a65-4b07-8d62-3922200dd4c4 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:11:fc:32"/><model type="virtio"/><mtu size="1442"/><target dev="tap377c42af-11"/></interface> {{(pid=72239) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 31 14:46:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-4627c361-9a65-4b07-8d62-3922200dd4c4 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:11:fc:32"/><model type="virtio"/><mtu size="1442"/><target dev="tap377c42af-11"/></interface>not found in domain: <domain type='kvm' id='9'>
Jul 31 14:46:50 user nova-compute[72239]:   <name>instance-00000009</name>
Jul 31 14:46:50 user nova-compute[72239]:   <uuid>9bd6169a-9a44-4d9c-a406-c10a2542a7b4</uuid>
Jul 31 14:46:50 user nova-compute[72239]:   <metadata>
Jul 31 14:46:50 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:46:50 user nova-compute[72239]:   <nova:package version="0.0.0"/>
Jul 31 14:46:50 user nova-compute[72239]:   <nova:name>tempest-device-tagging-server-1518629609</nova:name>
Jul 31 14:46:50 user nova-compute[72239]:   <nova:creationTime>2023-07-31 14:46:35</nova:creationTime>
Jul 31 14:46:50 user nova-compute[72239]:   <nova:flavor name="m1.tiny">
Jul 31 14:46:50 user nova-compute[72239]:     <nova:memory>512</nova:memory>
Jul 31 14:46:50 user nova-compute[72239]:     <nova:disk>1</nova:disk>
Jul 31 14:46:50 user nova-compute[72239]:     <nova:swap>0</nova:swap>
Jul 31 14:46:50 user nova-compute[72239]:     <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:46:50 user nova-compute[72239]:     <nova:vcpus>1</nova:vcpus>
Jul 31 14:46:50 user nova-compute[72239]:   </nova:flavor>
Jul 31 14:46:50 user nova-compute[72239]:   <nova:owner>
Jul 31 14:46:50 user nova-compute[72239]:     <nova:user uuid="ffb1bd7bcf554374b9b3c5bb1fc2b00a">tempest-TaggedAttachmentsTest-99713276-project-member</nova:user>
Jul 31 14:46:50 user nova-compute[72239]:     <nova:project uuid="0ef0e60cdf6a46cfb149c45d8f5443c6">tempest-TaggedAttachmentsTest-99713276</nova:project>
Jul 31 14:46:50 user nova-compute[72239]:   </nova:owner>
Jul 31 14:46:50 user nova-compute[72239]:   <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:46:50 user nova-compute[72239]:   <nova:ports>
Jul 31 14:46:50 user nova-compute[72239]:     <nova:port uuid="bc41ac8f-b231-4381-9278-64ce17f8833d">
Jul 31 14:46:50 user nova-compute[72239]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 31 14:46:50 user nova-compute[72239]:     </nova:port>
Jul 31 14:46:50 user nova-compute[72239]:     <nova:port uuid="377c42af-1122-41e2-9dba-9986e495c09a">
Jul 31 14:46:50 user nova-compute[72239]:       <nova:ip type="fixed" address="10.10.10.107" ipVersion="4"/>
Jul 31 14:46:50 user nova-compute[72239]:     </nova:port>
Jul 31 14:46:50 user nova-compute[72239]:   </nova:ports>
Jul 31 14:46:50 user nova-compute[72239]: </nova:instance>
Jul 31 14:46:50 user nova-compute[72239]:   </metadata>
Jul 31 14:46:50 user nova-compute[72239]:   <memory unit='KiB'>524288</memory>
Jul 31 14:46:50 user nova-compute[72239]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 31 14:46:50 user nova-compute[72239]:   <vcpu placement='static'>1</vcpu>
Jul 31 14:46:50 user nova-compute[72239]:   <resource>
Jul 31 14:46:50 user nova-compute[72239]:     <partition>/machine</partition>
Jul 31 14:46:50 user nova-compute[72239]:   </resource>
Jul 31 14:46:50 user nova-compute[72239]:   <sysinfo type='smbios'>
Jul 31 14:46:50 user nova-compute[72239]:     <system>
Jul 31 14:46:50 user nova-compute[72239]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 31 14:46:50 user nova-compute[72239]:       <entry name='product'>OpenStack Nova</entry>
Jul 31 14:46:50 user nova-compute[72239]:       <entry name='version'>0.0.0</entry>
Jul 31 14:46:50 user nova-compute[72239]:       <entry name='serial'>9bd6169a-9a44-4d9c-a406-c10a2542a7b4</entry>
Jul 31 14:46:50 user nova-compute[72239]:       <entry name='uuid'>9bd6169a-9a44-4d9c-a406-c10a2542a7b4</entry>
Jul 31 14:46:50 user nova-compute[72239]:       <entry name='family'>Virtual Machine</entry>
Jul 31 14:46:50 user nova-compute[72239]:     </system>
Jul 31 14:46:50 user nova-compute[72239]:   </sysinfo>
Jul 31 14:46:50 user nova-compute[72239]:   <os>
Jul 31 14:46:50 user nova-compute[72239]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 31 14:46:50 user nova-compute[72239]:     <boot dev='hd'/>
Jul 31 14:46:50 user nova-compute[72239]:     <smbios mode='sysinfo'/>
Jul 31 14:46:50 user nova-compute[72239]:   </os>
Jul 31 14:46:50 user nova-compute[72239]:   <features>
Jul 31 14:46:50 user nova-compute[72239]:     <acpi/>
Jul 31 14:46:50 user nova-compute[72239]:     <apic/>
Jul 31 14:46:50 user nova-compute[72239]:     <vmcoreinfo state='on'/>
Jul 31 14:46:50 user nova-compute[72239]:   </features>
Jul 31 14:46:50 user nova-compute[72239]:   <cpu mode='custom' match='exact' check='full'>
Jul 31 14:46:50 user nova-compute[72239]:     <model fallback='forbid'>Nehalem</model>
Jul 31 14:46:50 user nova-compute[72239]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 31 14:46:50 user nova-compute[72239]:     <feature policy='require' name='vme'/>
Jul 31 14:46:50 user nova-compute[72239]:     <feature policy='require' name='x2apic'/>
Jul 31 14:46:50 user nova-compute[72239]:     <feature policy='require' name='hypervisor'/>
Jul 31 14:46:50 user nova-compute[72239]:   </cpu>
Jul 31 14:46:50 user nova-compute[72239]:   <clock offset='utc'>
Jul 31 14:46:50 user nova-compute[72239]:     <timer name='pit' tickpolicy='delay'/>
Jul 31 14:46:50 user nova-compute[72239]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 31 14:46:50 user nova-compute[72239]:     <timer name='hpet' present='no'/>
Jul 31 14:46:50 user nova-compute[72239]:   </clock>
Jul 31 14:46:50 user nova-compute[72239]:   <on_poweroff>destroy</on_poweroff>
Jul 31 14:46:50 user nova-compute[72239]:   <on_reboot>restart</on_reboot>
Jul 31 14:46:50 user nova-compute[72239]:   <on_crash>destroy</on_crash>
Jul 31 14:46:50 user nova-compute[72239]:   <devices>
Jul 31 14:46:50 user nova-compute[72239]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 31 14:46:50 user nova-compute[72239]:     <disk type='file' device='disk'>
Jul 31 14:46:50 user nova-compute[72239]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 31 14:46:50 user nova-compute[72239]:       <source file='/opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/disk' index='2'/>
Jul 31 14:46:50 user nova-compute[72239]:       <backingStore type='file' index='3'>
Jul 31 14:46:50 user nova-compute[72239]:         <format type='raw'/>
Jul 31 14:46:50 user nova-compute[72239]:         <source file='/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444'/>
Jul 31 14:46:50 user nova-compute[72239]:         <backingStore/>
Jul 31 14:46:50 user nova-compute[72239]:       </backingStore>
Jul 31 14:46:50 user nova-compute[72239]:       <target dev='vda' bus='virtio'/>
Jul 31 14:46:50 user nova-compute[72239]:       <alias name='virtio-disk0'/>
Jul 31 14:46:50 user nova-compute[72239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 31 14:46:50 user nova-compute[72239]:     </disk>
Jul 31 14:46:50 user nova-compute[72239]:     <disk type='file' device='cdrom'>
Jul 31 14:46:50 user nova-compute[72239]:       <driver name='qemu' type='raw' cache='none'/>
Jul 31 14:46:50 user nova-compute[72239]:       <source file='/opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/disk.config' index='1'/>
Jul 31 14:46:50 user nova-compute[72239]:       <backingStore/>
Jul 31 14:46:50 user nova-compute[72239]:       <target dev='hda' bus='ide'/>
Jul 31 14:46:50 user nova-compute[72239]:       <readonly/>
Jul 31 14:46:50 user nova-compute[72239]:       <alias name='ide0-0-0'/>
Jul 31 14:46:50 user nova-compute[72239]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 31 14:46:50 user nova-compute[72239]:     </disk>
Jul 31 14:46:50 user nova-compute[72239]:     <controller type='usb' index='0' model='none'>
Jul 31 14:46:50 user nova-compute[72239]:       <alias name='usb'/>
Jul 31 14:46:50 user nova-compute[72239]:     </controller>
Jul 31 14:46:50 user nova-compute[72239]:     <controller type='pci' index='0' model='pci-root'>
Jul 31 14:46:50 user nova-compute[72239]:       <alias name='pci.0'/>
Jul 31 14:46:50 user nova-compute[72239]:     </controller>
Jul 31 14:46:50 user nova-compute[72239]:     <controller type='ide' index='0'>
Jul 31 14:46:50 user nova-compute[72239]:       <alias name='ide'/>
Jul 31 14:46:50 user nova-compute[72239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 31 14:46:50 user nova-compute[72239]:     </controller>
Jul 31 14:46:50 user nova-compute[72239]:     <interface type='ethernet'>
Jul 31 14:46:50 user nova-compute[72239]:       <mac address='fa:16:3e:25:8c:a7'/>
Jul 31 14:46:50 user nova-compute[72239]:       <target dev='tapbc41ac8f-b2'/>
Jul 31 14:46:50 user nova-compute[72239]:       <model type='virtio'/>
Jul 31 14:46:50 user nova-compute[72239]:       <mtu size='1442'/>
Jul 31 14:46:50 user nova-compute[72239]:       <alias name='net0'/>
Jul 31 14:46:50 user nova-compute[72239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 31 14:46:50 user nova-compute[72239]:     </interface>
Jul 31 14:46:50 user nova-compute[72239]:     <serial type='pty'>
Jul 31 14:46:50 user nova-compute[72239]:       <source path='/dev/pts/8'/>
Jul 31 14:46:50 user nova-compute[72239]:       <log file='/opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/console.log' append='off'/>
Jul 31 14:46:50 user nova-compute[72239]:       <target type='isa-serial' port='0'>
Jul 31 14:46:50 user nova-compute[72239]:         <model name='isa-serial'/>
Jul 31 14:46:50 user nova-compute[72239]:       </target>
Jul 31 14:46:50 user nova-compute[72239]:       <alias name='serial0'/>
Jul 31 14:46:50 user nova-compute[72239]:     </serial>
Jul 31 14:46:50 user nova-compute[72239]:     <console type='pty' tty='/dev/pts/8'>
Jul 31 14:46:50 user nova-compute[72239]:       <source path='/dev/pts/8'/>
Jul 31 14:46:50 user nova-compute[72239]:       <log file='/opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/console.log' append='off'/>
Jul 31 14:46:50 user nova-compute[72239]:       <target type='serial' port='0'/>
Jul 31 14:46:50 user nova-compute[72239]:       <alias name='serial0'/>
Jul 31 14:46:50 user nova-compute[72239]:     </console>
Jul 31 14:46:50 user nova-compute[72239]:     <input type='mouse' bus='ps2'>
Jul 31 14:46:50 user nova-compute[72239]:       <alias name='input0'/>
Jul 31 14:46:50 user nova-compute[72239]:     </input>
Jul 31 14:46:50 user nova-compute[72239]:     <input type='keyboard' bus='ps2'>
Jul 31 14:46:50 user nova-compute[72239]:       <alias name='input1'/>
Jul 31 14:46:50 user nova-compute[72239]:     </input>
Jul 31 14:46:50 user nova-compute[72239]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Jul 31 14:46:50 user nova-compute[72239]:       <listen type='address' address='0.0.0.0'/>
Jul 31 14:46:50 user nova-compute[72239]:     </graphics>
Jul 31 14:46:50 user nova-compute[72239]:     <audio id='1' type='none'/>
Jul 31 14:46:50 user nova-compute[72239]:     <video>
Jul 31 14:46:50 user nova-compute[72239]:       <model type='virtio' heads='1' primary='yes'/>
Jul 31 14:46:50 user nova-compute[72239]:       <alias name='video0'/>
Jul 31 14:46:50 user nova-compute[72239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 31 14:46:50 user nova-compute[72239]:     </video>
Jul 31 14:46:50 user nova-compute[72239]:     <memballoon model='virtio'>
Jul 31 14:46:50 user nova-compute[72239]:       <stats period='10'/>
Jul 31 14:46:50 user nova-compute[72239]:       <alias name='balloon0'/>
Jul 31 14:46:50 user nova-compute[72239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 31 14:46:50 user nova-compute[72239]:     </memballoon>
Jul 31 14:46:50 user nova-compute[72239]:     <rng model='virtio'>
Jul 31 14:46:50 user nova-compute[72239]:       <backend model='random'>/dev/urandom</backend>
Jul 31 14:46:50 user nova-compute[72239]:       <alias name='rng0'/>
Jul 31 14:46:50 user nova-compute[72239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 31 14:46:50 user nova-compute[72239]:     </rng>
Jul 31 14:46:50 user nova-compute[72239]:   </devices>
Jul 31 14:46:50 user nova-compute[72239]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 31 14:46:50 user nova-compute[72239]:     <label>libvirt-9bd6169a-9a44-4d9c-a406-c10a2542a7b4</label>
Jul 31 14:46:50 user nova-compute[72239]:     <imagelabel>libvirt-9bd6169a-9a44-4d9c-a406-c10a2542a7b4</imagelabel>
Jul 31 14:46:50 user nova-compute[72239]:   </seclabel>
Jul 31 14:46:50 user nova-compute[72239]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 31 14:46:50 user nova-compute[72239]:     <label>+64055:+108</label>
Jul 31 14:46:50 user nova-compute[72239]:     <imagelabel>+64055:+108</imagelabel>
Jul 31 14:46:50 user nova-compute[72239]:   </seclabel>
Jul 31 14:46:50 user nova-compute[72239]: </domain>
Jul 31 14:46:50 user nova-compute[72239]:  {{(pid=72239) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 31 14:46:50 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-4627c361-9a65-4b07-8d62-3922200dd4c4 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Successfully detached device tap377c42af-11 from instance 9bd6169a-9a44-4d9c-a406-c10a2542a7b4 from the live domain config.
Jul 31 14:46:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-4627c361-9a65-4b07-8d62-3922200dd4c4 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1518629609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1518629609',id=9,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkO64Mxo9V45ZvyZddW60Bj3R/wxTnuP74Wl0QbQrxRPpHV5wIIOFOuVL0TXCzmSq9fH99PAiORRcNxyzp52Ts3i5cecEtzUOk3DHNvVsfSIw0FbT8y4KNU2UgxwmOgpg==',key_name='tempest-keypair-1851777278',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:44:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ef0e60cdf6a46cfb149c45d8f5443c6',ramdisk_id='',reservation_id='r-uyqcqdz1',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-99713276',owner_user_name='tempest-TaggedAttachmentsTest-99713276-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:44:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffb1bd7bcf554374b9b3c5bb1fc2b00a',uuid=9bd6169a-9a44-4d9c-a406-c10a2542a7b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "377c42af-1122-41e2-9dba-9986e495c09a", "address": "fa:16:3e:11:fc:32", "network": {"id": "b396cce0-2406-4897-966e-5fa419b42fee", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1921449827", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ef0e60cdf6a46cfb149c45d8f5443c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377c42af-11", "ovs_interfaceid": "377c42af-1122-41e2-9dba-9986e495c09a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:46:50 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-4627c361-9a65-4b07-8d62-3922200dd4c4 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Converting VIF {"id": "377c42af-1122-41e2-9dba-9986e495c09a", "address": "fa:16:3e:11:fc:32", "network": {"id": "b396cce0-2406-4897-966e-5fa419b42fee", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1921449827", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ef0e60cdf6a46cfb149c45d8f5443c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377c42af-11", "ovs_interfaceid": "377c42af-1122-41e2-9dba-9986e495c09a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:46:50 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-4627c361-9a65-4b07-8d62-3922200dd4c4 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:fc:32,bridge_name='br-int',has_traffic_filtering=True,id=377c42af-1122-41e2-9dba-9986e495c09a,network=Network(b396cce0-2406-4897-966e-5fa419b42fee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap377c42af-11') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:46:50 user nova-compute[72239]: DEBUG os_vif [None req-4627c361-9a65-4b07-8d62-3922200dd4c4 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:fc:32,bridge_name='br-int',has_traffic_filtering=True,id=377c42af-1122-41e2-9dba-9986e495c09a,network=Network(b396cce0-2406-4897-966e-5fa419b42fee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap377c42af-11') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:46:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap377c42af-11, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:46:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:46:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:50 user nova-compute[72239]: INFO os_vif [None req-4627c361-9a65-4b07-8d62-3922200dd4c4 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:fc:32,bridge_name='br-int',has_traffic_filtering=True,id=377c42af-1122-41e2-9dba-9986e495c09a,network=Network(b396cce0-2406-4897-966e-5fa419b42fee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap377c42af-11')
Jul 31 14:46:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-4627c361-9a65-4b07-8d62-3922200dd4c4 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:46:50 user nova-compute[72239]:   <nova:package version="0.0.0"/>
Jul 31 14:46:50 user nova-compute[72239]:   <nova:name>tempest-device-tagging-server-1518629609</nova:name>
Jul 31 14:46:50 user nova-compute[72239]:   <nova:creationTime>2023-07-31 14:46:50</nova:creationTime>
Jul 31 14:46:50 user nova-compute[72239]:   <nova:flavor name="m1.tiny">
Jul 31 14:46:50 user nova-compute[72239]:     <nova:memory>512</nova:memory>
Jul 31 14:46:50 user nova-compute[72239]:     <nova:disk>1</nova:disk>
Jul 31 14:46:50 user nova-compute[72239]:     <nova:swap>0</nova:swap>
Jul 31 14:46:50 user nova-compute[72239]:     <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:46:50 user nova-compute[72239]:     <nova:vcpus>1</nova:vcpus>
Jul 31 14:46:50 user nova-compute[72239]:   </nova:flavor>
Jul 31 14:46:50 user nova-compute[72239]:   <nova:owner>
Jul 31 14:46:50 user nova-compute[72239]:     <nova:user uuid="ffb1bd7bcf554374b9b3c5bb1fc2b00a">tempest-TaggedAttachmentsTest-99713276-project-member</nova:user>
Jul 31 14:46:50 user nova-compute[72239]:     <nova:project uuid="0ef0e60cdf6a46cfb149c45d8f5443c6">tempest-TaggedAttachmentsTest-99713276</nova:project>
Jul 31 14:46:50 user nova-compute[72239]:   </nova:owner>
Jul 31 14:46:50 user nova-compute[72239]:   <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:46:50 user nova-compute[72239]:   <nova:ports>
Jul 31 14:46:50 user nova-compute[72239]:     <nova:port uuid="bc41ac8f-b231-4381-9278-64ce17f8833d">
Jul 31 14:46:50 user nova-compute[72239]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 31 14:46:50 user nova-compute[72239]:     </nova:port>
Jul 31 14:46:50 user nova-compute[72239]:   </nova:ports>
Jul 31 14:46:50 user nova-compute[72239]: </nova:instance>
Jul 31 14:46:50 user nova-compute[72239]:  {{(pid=72239) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 31 14:46:50 user nova-compute[72239]: DEBUG nova.compute.manager [req-5d6e9432-0639-4555-be2e-16df0b5d6c2d req-f2961a1d-33cc-493e-b3d5-f923843a9316 service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Received event network-vif-unplugged-377c42af-1122-41e2-9dba-9986e495c09a {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:46:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5d6e9432-0639-4555-be2e-16df0b5d6c2d req-f2961a1d-33cc-493e-b3d5-f923843a9316 service nova] Acquiring lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5d6e9432-0639-4555-be2e-16df0b5d6c2d req-f2961a1d-33cc-493e-b3d5-f923843a9316 service nova] Lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5d6e9432-0639-4555-be2e-16df0b5d6c2d req-f2961a1d-33cc-493e-b3d5-f923843a9316 service nova] Lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:50 user nova-compute[72239]: DEBUG nova.compute.manager [req-5d6e9432-0639-4555-be2e-16df0b5d6c2d req-f2961a1d-33cc-493e-b3d5-f923843a9316 service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] No waiting events found dispatching network-vif-unplugged-377c42af-1122-41e2-9dba-9986e495c09a {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:46:50 user nova-compute[72239]: WARNING nova.compute.manager [req-5d6e9432-0639-4555-be2e-16df0b5d6c2d req-f2961a1d-33cc-493e-b3d5-f923843a9316 service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Received unexpected event network-vif-unplugged-377c42af-1122-41e2-9dba-9986e495c09a for instance with vm_state active and task_state None.
Jul 31 14:46:51 user nova-compute[72239]: DEBUG nova.compute.manager [req-9bdc50a6-07aa-4632-abcd-c4b5fff456ed req-1857b8c1-38b1-40b2-9fbf-dbf4ee1e0e9e service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Received event network-vif-deleted-377c42af-1122-41e2-9dba-9986e495c09a {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:46:51 user nova-compute[72239]: INFO nova.compute.manager [req-9bdc50a6-07aa-4632-abcd-c4b5fff456ed req-1857b8c1-38b1-40b2-9fbf-dbf4ee1e0e9e service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Neutron deleted interface 377c42af-1122-41e2-9dba-9986e495c09a; detaching it from the instance and deleting it from the info cache
Jul 31 14:46:51 user nova-compute[72239]: DEBUG nova.network.neutron [req-9bdc50a6-07aa-4632-abcd-c4b5fff456ed req-1857b8c1-38b1-40b2-9fbf-dbf4ee1e0e9e service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Updating instance_info_cache with network_info: [{"id": "bc41ac8f-b231-4381-9278-64ce17f8833d", "address": "fa:16:3e:25:8c:a7", "network": {"id": "c36e8dbf-183c-4511-bb8d-12d2f61ff51c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1591719384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0e60cdf6a46cfb149c45d8f5443c6", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc41ac8f-b2", "ovs_interfaceid": "bc41ac8f-b231-4381-9278-64ce17f8833d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4627c361-9a65-4b07-8d62-3922200dd4c4 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Acquiring lock "refresh_cache-9bd6169a-9a44-4d9c-a406-c10a2542a7b4" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4627c361-9a65-4b07-8d62-3922200dd4c4 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Acquired lock "refresh_cache-9bd6169a-9a44-4d9c-a406-c10a2542a7b4" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG nova.network.neutron [None req-4627c361-9a65-4b07-8d62-3922200dd4c4 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG nova.objects.instance [req-9bdc50a6-07aa-4632-abcd-c4b5fff456ed req-1857b8c1-38b1-40b2-9fbf-dbf4ee1e0e9e service nova] Lazy-loading 'system_metadata' on Instance uuid 9bd6169a-9a44-4d9c-a406-c10a2542a7b4 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG nova.objects.instance [req-9bdc50a6-07aa-4632-abcd-c4b5fff456ed req-1857b8c1-38b1-40b2-9fbf-dbf4ee1e0e9e service nova] Lazy-loading 'flavor' on Instance uuid 9bd6169a-9a44-4d9c-a406-c10a2542a7b4 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [req-9bdc50a6-07aa-4632-abcd-c4b5fff456ed req-1857b8c1-38b1-40b2-9fbf-dbf4ee1e0e9e service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1518629609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1518629609',id=9,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkO64Mxo9V45ZvyZddW60Bj3R/wxTnuP74Wl0QbQrxRPpHV5wIIOFOuVL0TXCzmSq9fH99PAiORRcNxyzp52Ts3i5cecEtzUOk3DHNvVsfSIw0FbT8y4KNU2UgxwmOgpg==',key_name='tempest-keypair-1851777278',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:44:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ef0e60cdf6a46cfb149c45d8f5443c6',ramdisk_id='',reservation_id='r-uyqcqdz1',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-99713276',owner_user_name='tempest-TaggedAttachmentsTest-99713276-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:44:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffb1bd7bcf554374b9b3c5bb1fc2b00a',uuid=9bd6169a-9a44-4d9c-a406-c10a2542a7b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "377c42af-1122-41e2-9dba-9986e495c09a", "address": "fa:16:3e:11:fc:32", "network": {"id": "b396cce0-2406-4897-966e-5fa419b42fee", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1921449827", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ef0e60cdf6a46cfb149c45d8f5443c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377c42af-11", "ovs_interfaceid": "377c42af-1122-41e2-9dba-9986e495c09a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG nova.network.os_vif_util [req-9bdc50a6-07aa-4632-abcd-c4b5fff456ed req-1857b8c1-38b1-40b2-9fbf-dbf4ee1e0e9e service nova] Converting VIF {"id": "377c42af-1122-41e2-9dba-9986e495c09a", "address": "fa:16:3e:11:fc:32", "network": {"id": "b396cce0-2406-4897-966e-5fa419b42fee", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1921449827", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ef0e60cdf6a46cfb149c45d8f5443c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377c42af-11", "ovs_interfaceid": "377c42af-1122-41e2-9dba-9986e495c09a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG nova.network.os_vif_util [req-9bdc50a6-07aa-4632-abcd-c4b5fff456ed req-1857b8c1-38b1-40b2-9fbf-dbf4ee1e0e9e service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:fc:32,bridge_name='br-int',has_traffic_filtering=True,id=377c42af-1122-41e2-9dba-9986e495c09a,network=Network(b396cce0-2406-4897-966e-5fa419b42fee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap377c42af-11') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [req-9bdc50a6-07aa-4632-abcd-c4b5fff456ed req-1857b8c1-38b1-40b2-9fbf-dbf4ee1e0e9e service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:11:fc:32"/><model type="virtio"/><mtu size="1442"/><target dev="tap377c42af-11"/></interface> {{(pid=72239) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [req-9bdc50a6-07aa-4632-abcd-c4b5fff456ed req-1857b8c1-38b1-40b2-9fbf-dbf4ee1e0e9e service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:11:fc:32"/><model type="virtio"/><mtu size="1442"/><target dev="tap377c42af-11"/></interface>not found in domain: <domain type='kvm' id='9'>
Jul 31 14:46:51 user nova-compute[72239]:   <name>instance-00000009</name>
Jul 31 14:46:51 user nova-compute[72239]:   <uuid>9bd6169a-9a44-4d9c-a406-c10a2542a7b4</uuid>
Jul 31 14:46:51 user nova-compute[72239]:   <metadata>
Jul 31 14:46:51 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:46:51 user nova-compute[72239]:   <nova:package version="0.0.0"/>
Jul 31 14:46:51 user nova-compute[72239]:   <nova:name>tempest-device-tagging-server-1518629609</nova:name>
Jul 31 14:46:51 user nova-compute[72239]:   <nova:creationTime>2023-07-31 14:46:50</nova:creationTime>
Jul 31 14:46:51 user nova-compute[72239]:   <nova:flavor name="m1.tiny">
Jul 31 14:46:51 user nova-compute[72239]:     <nova:memory>512</nova:memory>
Jul 31 14:46:51 user nova-compute[72239]:     <nova:disk>1</nova:disk>
Jul 31 14:46:51 user nova-compute[72239]:     <nova:swap>0</nova:swap>
Jul 31 14:46:51 user nova-compute[72239]:     <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:46:51 user nova-compute[72239]:     <nova:vcpus>1</nova:vcpus>
Jul 31 14:46:51 user nova-compute[72239]:   </nova:flavor>
Jul 31 14:46:51 user nova-compute[72239]:   <nova:owner>
Jul 31 14:46:51 user nova-compute[72239]:     <nova:user uuid="ffb1bd7bcf554374b9b3c5bb1fc2b00a">tempest-TaggedAttachmentsTest-99713276-project-member</nova:user>
Jul 31 14:46:51 user nova-compute[72239]:     <nova:project uuid="0ef0e60cdf6a46cfb149c45d8f5443c6">tempest-TaggedAttachmentsTest-99713276</nova:project>
Jul 31 14:46:51 user nova-compute[72239]:   </nova:owner>
Jul 31 14:46:51 user nova-compute[72239]:   <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:46:51 user nova-compute[72239]:   <nova:ports>
Jul 31 14:46:51 user nova-compute[72239]:     <nova:port uuid="bc41ac8f-b231-4381-9278-64ce17f8833d">
Jul 31 14:46:51 user nova-compute[72239]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 31 14:46:51 user nova-compute[72239]:     </nova:port>
Jul 31 14:46:51 user nova-compute[72239]:   </nova:ports>
Jul 31 14:46:51 user nova-compute[72239]: </nova:instance>
Jul 31 14:46:51 user nova-compute[72239]:   </metadata>
Jul 31 14:46:51 user nova-compute[72239]:   <memory unit='KiB'>524288</memory>
Jul 31 14:46:51 user nova-compute[72239]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 31 14:46:51 user nova-compute[72239]:   <vcpu placement='static'>1</vcpu>
Jul 31 14:46:51 user nova-compute[72239]:   <resource>
Jul 31 14:46:51 user nova-compute[72239]:     <partition>/machine</partition>
Jul 31 14:46:51 user nova-compute[72239]:   </resource>
Jul 31 14:46:51 user nova-compute[72239]:   <sysinfo type='smbios'>
Jul 31 14:46:51 user nova-compute[72239]:     <system>
Jul 31 14:46:51 user nova-compute[72239]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 31 14:46:51 user nova-compute[72239]:       <entry name='product'>OpenStack Nova</entry>
Jul 31 14:46:51 user nova-compute[72239]:       <entry name='version'>0.0.0</entry>
Jul 31 14:46:51 user nova-compute[72239]:       <entry name='serial'>9bd6169a-9a44-4d9c-a406-c10a2542a7b4</entry>
Jul 31 14:46:51 user nova-compute[72239]:       <entry name='uuid'>9bd6169a-9a44-4d9c-a406-c10a2542a7b4</entry>
Jul 31 14:46:51 user nova-compute[72239]:       <entry name='family'>Virtual Machine</entry>
Jul 31 14:46:51 user nova-compute[72239]:     </system>
Jul 31 14:46:51 user nova-compute[72239]:   </sysinfo>
Jul 31 14:46:51 user nova-compute[72239]:   <os>
Jul 31 14:46:51 user nova-compute[72239]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 31 14:46:51 user nova-compute[72239]:     <boot dev='hd'/>
Jul 31 14:46:51 user nova-compute[72239]:     <smbios mode='sysinfo'/>
Jul 31 14:46:51 user nova-compute[72239]:   </os>
Jul 31 14:46:51 user nova-compute[72239]:   <features>
Jul 31 14:46:51 user nova-compute[72239]:     <acpi/>
Jul 31 14:46:51 user nova-compute[72239]:     <apic/>
Jul 31 14:46:51 user nova-compute[72239]:     <vmcoreinfo state='on'/>
Jul 31 14:46:51 user nova-compute[72239]:   </features>
Jul 31 14:46:51 user nova-compute[72239]:   <cpu mode='custom' match='exact' check='full'>
Jul 31 14:46:51 user nova-compute[72239]:     <model fallback='forbid'>Nehalem</model>
Jul 31 14:46:51 user nova-compute[72239]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 31 14:46:51 user nova-compute[72239]:     <feature policy='require' name='vme'/>
Jul 31 14:46:51 user nova-compute[72239]:     <feature policy='require' name='x2apic'/>
Jul 31 14:46:51 user nova-compute[72239]:     <feature policy='require' name='hypervisor'/>
Jul 31 14:46:51 user nova-compute[72239]:   </cpu>
Jul 31 14:46:51 user nova-compute[72239]:   <clock offset='utc'>
Jul 31 14:46:51 user nova-compute[72239]:     <timer name='pit' tickpolicy='delay'/>
Jul 31 14:46:51 user nova-compute[72239]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 31 14:46:51 user nova-compute[72239]:     <timer name='hpet' present='no'/>
Jul 31 14:46:51 user nova-compute[72239]:   </clock>
Jul 31 14:46:51 user nova-compute[72239]:   <on_poweroff>destroy</on_poweroff>
Jul 31 14:46:51 user nova-compute[72239]:   <on_reboot>restart</on_reboot>
Jul 31 14:46:51 user nova-compute[72239]:   <on_crash>destroy</on_crash>
Jul 31 14:46:51 user nova-compute[72239]:   <devices>
Jul 31 14:46:51 user nova-compute[72239]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 31 14:46:51 user nova-compute[72239]:     <disk type='file' device='disk'>
Jul 31 14:46:51 user nova-compute[72239]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 31 14:46:51 user nova-compute[72239]:       <source file='/opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/disk' index='2'/>
Jul 31 14:46:51 user nova-compute[72239]:       <backingStore type='file' index='3'>
Jul 31 14:46:51 user nova-compute[72239]:         <format type='raw'/>
Jul 31 14:46:51 user nova-compute[72239]:         <source file='/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444'/>
Jul 31 14:46:51 user nova-compute[72239]:         <backingStore/>
Jul 31 14:46:51 user nova-compute[72239]:       </backingStore>
Jul 31 14:46:51 user nova-compute[72239]:       <target dev='vda' bus='virtio'/>
Jul 31 14:46:51 user nova-compute[72239]:       <alias name='virtio-disk0'/>
Jul 31 14:46:51 user nova-compute[72239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 31 14:46:51 user nova-compute[72239]:     </disk>
Jul 31 14:46:51 user nova-compute[72239]:     <disk type='file' device='cdrom'>
Jul 31 14:46:51 user nova-compute[72239]:       <driver name='qemu' type='raw' cache='none'/>
Jul 31 14:46:51 user nova-compute[72239]:       <source file='/opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/disk.config' index='1'/>
Jul 31 14:46:51 user nova-compute[72239]:       <backingStore/>
Jul 31 14:46:51 user nova-compute[72239]:       <target dev='hda' bus='ide'/>
Jul 31 14:46:51 user nova-compute[72239]:       <readonly/>
Jul 31 14:46:51 user nova-compute[72239]:       <alias name='ide0-0-0'/>
Jul 31 14:46:51 user nova-compute[72239]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 31 14:46:51 user nova-compute[72239]:     </disk>
Jul 31 14:46:51 user nova-compute[72239]:     <controller type='usb' index='0' model='none'>
Jul 31 14:46:51 user nova-compute[72239]:       <alias name='usb'/>
Jul 31 14:46:51 user nova-compute[72239]:     </controller>
Jul 31 14:46:51 user nova-compute[72239]:     <controller type='pci' index='0' model='pci-root'>
Jul 31 14:46:51 user nova-compute[72239]:       <alias name='pci.0'/>
Jul 31 14:46:51 user nova-compute[72239]:     </controller>
Jul 31 14:46:51 user nova-compute[72239]:     <controller type='ide' index='0'>
Jul 31 14:46:51 user nova-compute[72239]:       <alias name='ide'/>
Jul 31 14:46:51 user nova-compute[72239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 31 14:46:51 user nova-compute[72239]:     </controller>
Jul 31 14:46:51 user nova-compute[72239]:     <interface type='ethernet'>
Jul 31 14:46:51 user nova-compute[72239]:       <mac address='fa:16:3e:25:8c:a7'/>
Jul 31 14:46:51 user nova-compute[72239]:       <target dev='tapbc41ac8f-b2'/>
Jul 31 14:46:51 user nova-compute[72239]:       <model type='virtio'/>
Jul 31 14:46:51 user nova-compute[72239]:       <mtu size='1442'/>
Jul 31 14:46:51 user nova-compute[72239]:       <alias name='net0'/>
Jul 31 14:46:51 user nova-compute[72239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 31 14:46:51 user nova-compute[72239]:     </interface>
Jul 31 14:46:51 user nova-compute[72239]:     <serial type='pty'>
Jul 31 14:46:51 user nova-compute[72239]:       <source path='/dev/pts/8'/>
Jul 31 14:46:51 user nova-compute[72239]:       <log file='/opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/console.log' append='off'/>
Jul 31 14:46:51 user nova-compute[72239]:       <target type='isa-serial' port='0'>
Jul 31 14:46:51 user nova-compute[72239]:         <model name='isa-serial'/>
Jul 31 14:46:51 user nova-compute[72239]:       </target>
Jul 31 14:46:51 user nova-compute[72239]:       <alias name='serial0'/>
Jul 31 14:46:51 user nova-compute[72239]:     </serial>
Jul 31 14:46:51 user nova-compute[72239]:     <console type='pty' tty='/dev/pts/8'>
Jul 31 14:46:51 user nova-compute[72239]:       <source path='/dev/pts/8'/>
Jul 31 14:46:51 user nova-compute[72239]:       <log file='/opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/console.log' append='off'/>
Jul 31 14:46:51 user nova-compute[72239]:       <target type='serial' port='0'/>
Jul 31 14:46:51 user nova-compute[72239]:       <alias name='serial0'/>
Jul 31 14:46:51 user nova-compute[72239]:     </console>
Jul 31 14:46:51 user nova-compute[72239]:     <input type='mouse' bus='ps2'>
Jul 31 14:46:51 user nova-compute[72239]:       <alias name='input0'/>
Jul 31 14:46:51 user nova-compute[72239]:     </input>
Jul 31 14:46:51 user nova-compute[72239]:     <input type='keyboard' bus='ps2'>
Jul 31 14:46:51 user nova-compute[72239]:       <alias name='input1'/>
Jul 31 14:46:51 user nova-compute[72239]:     </input>
Jul 31 14:46:51 user nova-compute[72239]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Jul 31 14:46:51 user nova-compute[72239]:       <listen type='address' address='0.0.0.0'/>
Jul 31 14:46:51 user nova-compute[72239]:     </graphics>
Jul 31 14:46:51 user nova-compute[72239]:     <audio id='1' type='none'/>
Jul 31 14:46:51 user nova-compute[72239]:     <video>
Jul 31 14:46:51 user nova-compute[72239]:       <model type='virtio' heads='1' primary='yes'/>
Jul 31 14:46:51 user nova-compute[72239]:       <alias name='video0'/>
Jul 31 14:46:51 user nova-compute[72239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 31 14:46:51 user nova-compute[72239]:     </video>
Jul 31 14:46:51 user nova-compute[72239]:     <memballoon model='virtio'>
Jul 31 14:46:51 user nova-compute[72239]:       <stats period='10'/>
Jul 31 14:46:51 user nova-compute[72239]:       <alias name='balloon0'/>
Jul 31 14:46:51 user nova-compute[72239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 31 14:46:51 user nova-compute[72239]:     </memballoon>
Jul 31 14:46:51 user nova-compute[72239]:     <rng model='virtio'>
Jul 31 14:46:51 user nova-compute[72239]:       <backend model='random'>/dev/urandom</backend>
Jul 31 14:46:51 user nova-compute[72239]:       <alias name='rng0'/>
Jul 31 14:46:51 user nova-compute[72239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 31 14:46:51 user nova-compute[72239]:     </rng>
Jul 31 14:46:51 user nova-compute[72239]:   </devices>
Jul 31 14:46:51 user nova-compute[72239]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 31 14:46:51 user nova-compute[72239]:     <label>libvirt-9bd6169a-9a44-4d9c-a406-c10a2542a7b4</label>
Jul 31 14:46:51 user nova-compute[72239]:     <imagelabel>libvirt-9bd6169a-9a44-4d9c-a406-c10a2542a7b4</imagelabel>
Jul 31 14:46:51 user nova-compute[72239]:   </seclabel>
Jul 31 14:46:51 user nova-compute[72239]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 31 14:46:51 user nova-compute[72239]:     <label>+64055:+108</label>
Jul 31 14:46:51 user nova-compute[72239]:     <imagelabel>+64055:+108</imagelabel>
Jul 31 14:46:51 user nova-compute[72239]:   </seclabel>
Jul 31 14:46:51 user nova-compute[72239]: </domain>
Jul 31 14:46:51 user nova-compute[72239]:  {{(pid=72239) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [req-9bdc50a6-07aa-4632-abcd-c4b5fff456ed req-1857b8c1-38b1-40b2-9fbf-dbf4ee1e0e9e service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:11:fc:32"/><model type="virtio"/><mtu size="1442"/><target dev="tap377c42af-11"/></interface> {{(pid=72239) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [req-9bdc50a6-07aa-4632-abcd-c4b5fff456ed req-1857b8c1-38b1-40b2-9fbf-dbf4ee1e0e9e service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:11:fc:32"/><model type="virtio"/><mtu size="1442"/><target dev="tap377c42af-11"/></interface>not found in domain: <domain type='kvm' id='9'>
Jul 31 14:46:51 user nova-compute[72239]:   <name>instance-00000009</name>
Jul 31 14:46:51 user nova-compute[72239]:   <uuid>9bd6169a-9a44-4d9c-a406-c10a2542a7b4</uuid>
Jul 31 14:46:51 user nova-compute[72239]:   <metadata>
Jul 31 14:46:51 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:46:51 user nova-compute[72239]:   <nova:package version="0.0.0"/>
Jul 31 14:46:51 user nova-compute[72239]:   <nova:name>tempest-device-tagging-server-1518629609</nova:name>
Jul 31 14:46:51 user nova-compute[72239]:   <nova:creationTime>2023-07-31 14:46:50</nova:creationTime>
Jul 31 14:46:51 user nova-compute[72239]:   <nova:flavor name="m1.tiny">
Jul 31 14:46:51 user nova-compute[72239]:     <nova:memory>512</nova:memory>
Jul 31 14:46:51 user nova-compute[72239]:     <nova:disk>1</nova:disk>
Jul 31 14:46:51 user nova-compute[72239]:     <nova:swap>0</nova:swap>
Jul 31 14:46:51 user nova-compute[72239]:     <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:46:51 user nova-compute[72239]:     <nova:vcpus>1</nova:vcpus>
Jul 31 14:46:51 user nova-compute[72239]:   </nova:flavor>
Jul 31 14:46:51 user nova-compute[72239]:   <nova:owner>
Jul 31 14:46:51 user nova-compute[72239]:     <nova:user uuid="ffb1bd7bcf554374b9b3c5bb1fc2b00a">tempest-TaggedAttachmentsTest-99713276-project-member</nova:user>
Jul 31 14:46:51 user nova-compute[72239]:     <nova:project uuid="0ef0e60cdf6a46cfb149c45d8f5443c6">tempest-TaggedAttachmentsTest-99713276</nova:project>
Jul 31 14:46:51 user nova-compute[72239]:   </nova:owner>
Jul 31 14:46:51 user nova-compute[72239]:   <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:46:51 user nova-compute[72239]:   <nova:ports>
Jul 31 14:46:51 user nova-compute[72239]:     <nova:port uuid="bc41ac8f-b231-4381-9278-64ce17f8833d">
Jul 31 14:46:51 user nova-compute[72239]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 31 14:46:51 user nova-compute[72239]:     </nova:port>
Jul 31 14:46:51 user nova-compute[72239]:   </nova:ports>
Jul 31 14:46:51 user nova-compute[72239]: </nova:instance>
Jul 31 14:46:51 user nova-compute[72239]:   </metadata>
Jul 31 14:46:51 user nova-compute[72239]:   <memory unit='KiB'>524288</memory>
Jul 31 14:46:51 user nova-compute[72239]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 31 14:46:51 user nova-compute[72239]:   <vcpu placement='static'>1</vcpu>
Jul 31 14:46:51 user nova-compute[72239]:   <resource>
Jul 31 14:46:51 user nova-compute[72239]:     <partition>/machine</partition>
Jul 31 14:46:51 user nova-compute[72239]:   </resource>
Jul 31 14:46:51 user nova-compute[72239]:   <sysinfo type='smbios'>
Jul 31 14:46:51 user nova-compute[72239]:     <system>
Jul 31 14:46:51 user nova-compute[72239]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 31 14:46:51 user nova-compute[72239]:       <entry name='product'>OpenStack Nova</entry>
Jul 31 14:46:51 user nova-compute[72239]:       <entry name='version'>0.0.0</entry>
Jul 31 14:46:51 user nova-compute[72239]:       <entry name='serial'>9bd6169a-9a44-4d9c-a406-c10a2542a7b4</entry>
Jul 31 14:46:51 user nova-compute[72239]:       <entry name='uuid'>9bd6169a-9a44-4d9c-a406-c10a2542a7b4</entry>
Jul 31 14:46:51 user nova-compute[72239]:       <entry name='family'>Virtual Machine</entry>
Jul 31 14:46:51 user nova-compute[72239]:     </system>
Jul 31 14:46:51 user nova-compute[72239]:   </sysinfo>
Jul 31 14:46:51 user nova-compute[72239]:   <os>
Jul 31 14:46:51 user nova-compute[72239]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 31 14:46:51 user nova-compute[72239]:     <boot dev='hd'/>
Jul 31 14:46:51 user nova-compute[72239]:     <smbios mode='sysinfo'/>
Jul 31 14:46:51 user nova-compute[72239]:   </os>
Jul 31 14:46:51 user nova-compute[72239]:   <features>
Jul 31 14:46:51 user nova-compute[72239]:     <acpi/>
Jul 31 14:46:51 user nova-compute[72239]:     <apic/>
Jul 31 14:46:51 user nova-compute[72239]:     <vmcoreinfo state='on'/>
Jul 31 14:46:51 user nova-compute[72239]:   </features>
Jul 31 14:46:51 user nova-compute[72239]:   <cpu mode='custom' match='exact' check='full'>
Jul 31 14:46:51 user nova-compute[72239]:     <model fallback='forbid'>Nehalem</model>
Jul 31 14:46:51 user nova-compute[72239]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 31 14:46:51 user nova-compute[72239]:     <feature policy='require' name='vme'/>
Jul 31 14:46:51 user nova-compute[72239]:     <feature policy='require' name='x2apic'/>
Jul 31 14:46:51 user nova-compute[72239]:     <feature policy='require' name='hypervisor'/>
Jul 31 14:46:51 user nova-compute[72239]:   </cpu>
Jul 31 14:46:51 user nova-compute[72239]:   <clock offset='utc'>
Jul 31 14:46:51 user nova-compute[72239]:     <timer name='pit' tickpolicy='delay'/>
Jul 31 14:46:51 user nova-compute[72239]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 31 14:46:51 user nova-compute[72239]:     <timer name='hpet' present='no'/>
Jul 31 14:46:51 user nova-compute[72239]:   </clock>
Jul 31 14:46:51 user nova-compute[72239]:   <on_poweroff>destroy</on_poweroff>
Jul 31 14:46:51 user nova-compute[72239]:   <on_reboot>restart</on_reboot>
Jul 31 14:46:51 user nova-compute[72239]:   <on_crash>destroy</on_crash>
Jul 31 14:46:51 user nova-compute[72239]:   <devices>
Jul 31 14:46:51 user nova-compute[72239]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 31 14:46:51 user nova-compute[72239]:     <disk type='file' device='disk'>
Jul 31 14:46:51 user nova-compute[72239]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 31 14:46:51 user nova-compute[72239]:       <source file='/opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/disk' index='2'/>
Jul 31 14:46:51 user nova-compute[72239]:       <backingStore type='file' index='3'>
Jul 31 14:46:51 user nova-compute[72239]:         <format type='raw'/>
Jul 31 14:46:51 user nova-compute[72239]:         <source file='/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444'/>
Jul 31 14:46:51 user nova-compute[72239]:         <backingStore/>
Jul 31 14:46:51 user nova-compute[72239]:       </backingStore>
Jul 31 14:46:51 user nova-compute[72239]:       <target dev='vda' bus='virtio'/>
Jul 31 14:46:51 user nova-compute[72239]:       <alias name='virtio-disk0'/>
Jul 31 14:46:51 user nova-compute[72239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 31 14:46:51 user nova-compute[72239]:     </disk>
Jul 31 14:46:51 user nova-compute[72239]:     <disk type='file' device='cdrom'>
Jul 31 14:46:51 user nova-compute[72239]:       <driver name='qemu' type='raw' cache='none'/>
Jul 31 14:46:51 user nova-compute[72239]:       <source file='/opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/disk.config' index='1'/>
Jul 31 14:46:51 user nova-compute[72239]:       <backingStore/>
Jul 31 14:46:51 user nova-compute[72239]:       <target dev='hda' bus='ide'/>
Jul 31 14:46:51 user nova-compute[72239]:       <readonly/>
Jul 31 14:46:51 user nova-compute[72239]:       <alias name='ide0-0-0'/>
Jul 31 14:46:51 user nova-compute[72239]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 31 14:46:51 user nova-compute[72239]:     </disk>
Jul 31 14:46:51 user nova-compute[72239]:     <controller type='usb' index='0' model='none'>
Jul 31 14:46:51 user nova-compute[72239]:       <alias name='usb'/>
Jul 31 14:46:51 user nova-compute[72239]:     </controller>
Jul 31 14:46:51 user nova-compute[72239]:     <controller type='pci' index='0' model='pci-root'>
Jul 31 14:46:51 user nova-compute[72239]:       <alias name='pci.0'/>
Jul 31 14:46:51 user nova-compute[72239]:     </controller>
Jul 31 14:46:51 user nova-compute[72239]:     <controller type='ide' index='0'>
Jul 31 14:46:51 user nova-compute[72239]:       <alias name='ide'/>
Jul 31 14:46:51 user nova-compute[72239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 31 14:46:51 user nova-compute[72239]:     </controller>
Jul 31 14:46:51 user nova-compute[72239]:     <interface type='ethernet'>
Jul 31 14:46:51 user nova-compute[72239]:       <mac address='fa:16:3e:25:8c:a7'/>
Jul 31 14:46:51 user nova-compute[72239]:       <target dev='tapbc41ac8f-b2'/>
Jul 31 14:46:51 user nova-compute[72239]:       <model type='virtio'/>
Jul 31 14:46:51 user nova-compute[72239]:       <mtu size='1442'/>
Jul 31 14:46:51 user nova-compute[72239]:       <alias name='net0'/>
Jul 31 14:46:51 user nova-compute[72239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 31 14:46:51 user nova-compute[72239]:     </interface>
Jul 31 14:46:51 user nova-compute[72239]:     <serial type='pty'>
Jul 31 14:46:51 user nova-compute[72239]:       <source path='/dev/pts/8'/>
Jul 31 14:46:51 user nova-compute[72239]:       <log file='/opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/console.log' append='off'/>
Jul 31 14:46:51 user nova-compute[72239]:       <target type='isa-serial' port='0'>
Jul 31 14:46:51 user nova-compute[72239]:         <model name='isa-serial'/>
Jul 31 14:46:51 user nova-compute[72239]:       </target>
Jul 31 14:46:51 user nova-compute[72239]:       <alias name='serial0'/>
Jul 31 14:46:51 user nova-compute[72239]:     </serial>
Jul 31 14:46:51 user nova-compute[72239]:     <console type='pty' tty='/dev/pts/8'>
Jul 31 14:46:51 user nova-compute[72239]:       <source path='/dev/pts/8'/>
Jul 31 14:46:51 user nova-compute[72239]:       <log file='/opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/console.log' append='off'/>
Jul 31 14:46:51 user nova-compute[72239]:       <target type='serial' port='0'/>
Jul 31 14:46:51 user nova-compute[72239]:       <alias name='serial0'/>
Jul 31 14:46:51 user nova-compute[72239]:     </console>
Jul 31 14:46:51 user nova-compute[72239]:     <input type='mouse' bus='ps2'>
Jul 31 14:46:51 user nova-compute[72239]:       <alias name='input0'/>
Jul 31 14:46:51 user nova-compute[72239]:     </input>
Jul 31 14:46:51 user nova-compute[72239]:     <input type='keyboard' bus='ps2'>
Jul 31 14:46:51 user nova-compute[72239]:       <alias name='input1'/>
Jul 31 14:46:51 user nova-compute[72239]:     </input>
Jul 31 14:46:51 user nova-compute[72239]:     <graphics type='vnc' port='5908' autoport='yes' listen='0.0.0.0'>
Jul 31 14:46:51 user nova-compute[72239]:       <listen type='address' address='0.0.0.0'/>
Jul 31 14:46:51 user nova-compute[72239]:     </graphics>
Jul 31 14:46:51 user nova-compute[72239]:     <audio id='1' type='none'/>
Jul 31 14:46:51 user nova-compute[72239]:     <video>
Jul 31 14:46:51 user nova-compute[72239]:       <model type='virtio' heads='1' primary='yes'/>
Jul 31 14:46:51 user nova-compute[72239]:       <alias name='video0'/>
Jul 31 14:46:51 user nova-compute[72239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 31 14:46:51 user nova-compute[72239]:     </video>
Jul 31 14:46:51 user nova-compute[72239]:     <memballoon model='virtio'>
Jul 31 14:46:51 user nova-compute[72239]:       <stats period='10'/>
Jul 31 14:46:51 user nova-compute[72239]:       <alias name='balloon0'/>
Jul 31 14:46:51 user nova-compute[72239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 31 14:46:51 user nova-compute[72239]:     </memballoon>
Jul 31 14:46:51 user nova-compute[72239]:     <rng model='virtio'>
Jul 31 14:46:51 user nova-compute[72239]:       <backend model='random'>/dev/urandom</backend>
Jul 31 14:46:51 user nova-compute[72239]:       <alias name='rng0'/>
Jul 31 14:46:51 user nova-compute[72239]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 31 14:46:51 user nova-compute[72239]:     </rng>
Jul 31 14:46:51 user nova-compute[72239]:   </devices>
Jul 31 14:46:51 user nova-compute[72239]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 31 14:46:51 user nova-compute[72239]:     <label>libvirt-9bd6169a-9a44-4d9c-a406-c10a2542a7b4</label>
Jul 31 14:46:51 user nova-compute[72239]:     <imagelabel>libvirt-9bd6169a-9a44-4d9c-a406-c10a2542a7b4</imagelabel>
Jul 31 14:46:51 user nova-compute[72239]:   </seclabel>
Jul 31 14:46:51 user nova-compute[72239]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 31 14:46:51 user nova-compute[72239]:     <label>+64055:+108</label>
Jul 31 14:46:51 user nova-compute[72239]:     <imagelabel>+64055:+108</imagelabel>
Jul 31 14:46:51 user nova-compute[72239]:   </seclabel>
Jul 31 14:46:51 user nova-compute[72239]: </domain>
Jul 31 14:46:51 user nova-compute[72239]:  {{(pid=72239) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 31 14:46:51 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [req-9bdc50a6-07aa-4632-abcd-c4b5fff456ed req-1857b8c1-38b1-40b2-9fbf-dbf4ee1e0e9e service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Detaching interface fa:16:3e:11:fc:32 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap377c42af-11' not found.
Jul 31 14:46:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [req-9bdc50a6-07aa-4632-abcd-c4b5fff456ed req-1857b8c1-38b1-40b2-9fbf-dbf4ee1e0e9e service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1518629609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1518629609',id=9,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkO64Mxo9V45ZvyZddW60Bj3R/wxTnuP74Wl0QbQrxRPpHV5wIIOFOuVL0TXCzmSq9fH99PAiORRcNxyzp52Ts3i5cecEtzUOk3DHNvVsfSIw0FbT8y4KNU2UgxwmOgpg==',key_name='tempest-keypair-1851777278',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:44:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ef0e60cdf6a46cfb149c45d8f5443c6',ramdisk_id='',reservation_id='r-uyqcqdz1',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-99713276',owner_user_name='tempest-TaggedAttachmentsTest-99713276-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:44:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffb1bd7bcf554374b9b3c5bb1fc2b00a',uuid=9bd6169a-9a44-4d9c-a406-c10a2542a7b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "377c42af-1122-41e2-9dba-9986e495c09a", "address": "fa:16:3e:11:fc:32", "network": {"id": "b396cce0-2406-4897-966e-5fa419b42fee", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1921449827", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ef0e60cdf6a46cfb149c45d8f5443c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377c42af-11", "ovs_interfaceid": "377c42af-1122-41e2-9dba-9986e495c09a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG nova.network.os_vif_util [req-9bdc50a6-07aa-4632-abcd-c4b5fff456ed req-1857b8c1-38b1-40b2-9fbf-dbf4ee1e0e9e service nova] Converting VIF {"id": "377c42af-1122-41e2-9dba-9986e495c09a", "address": "fa:16:3e:11:fc:32", "network": {"id": "b396cce0-2406-4897-966e-5fa419b42fee", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1921449827", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.107", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "0ef0e60cdf6a46cfb149c45d8f5443c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap377c42af-11", "ovs_interfaceid": "377c42af-1122-41e2-9dba-9986e495c09a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG nova.network.os_vif_util [req-9bdc50a6-07aa-4632-abcd-c4b5fff456ed req-1857b8c1-38b1-40b2-9fbf-dbf4ee1e0e9e service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:fc:32,bridge_name='br-int',has_traffic_filtering=True,id=377c42af-1122-41e2-9dba-9986e495c09a,network=Network(b396cce0-2406-4897-966e-5fa419b42fee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap377c42af-11') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG os_vif [req-9bdc50a6-07aa-4632-abcd-c4b5fff456ed req-1857b8c1-38b1-40b2-9fbf-dbf4ee1e0e9e service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:fc:32,bridge_name='br-int',has_traffic_filtering=True,id=377c42af-1122-41e2-9dba-9986e495c09a,network=Network(b396cce0-2406-4897-966e-5fa419b42fee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap377c42af-11') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap377c42af-11, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:46:51 user nova-compute[72239]: INFO os_vif [req-9bdc50a6-07aa-4632-abcd-c4b5fff456ed req-1857b8c1-38b1-40b2-9fbf-dbf4ee1e0e9e service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:fc:32,bridge_name='br-int',has_traffic_filtering=True,id=377c42af-1122-41e2-9dba-9986e495c09a,network=Network(b396cce0-2406-4897-966e-5fa419b42fee),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap377c42af-11')
Jul 31 14:46:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [req-9bdc50a6-07aa-4632-abcd-c4b5fff456ed req-1857b8c1-38b1-40b2-9fbf-dbf4ee1e0e9e service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:46:51 user nova-compute[72239]:   <nova:package version="0.0.0"/>
Jul 31 14:46:51 user nova-compute[72239]:   <nova:name>tempest-device-tagging-server-1518629609</nova:name>
Jul 31 14:46:51 user nova-compute[72239]:   <nova:creationTime>2023-07-31 14:46:51</nova:creationTime>
Jul 31 14:46:51 user nova-compute[72239]:   <nova:flavor name="m1.tiny">
Jul 31 14:46:51 user nova-compute[72239]:     <nova:memory>512</nova:memory>
Jul 31 14:46:51 user nova-compute[72239]:     <nova:disk>1</nova:disk>
Jul 31 14:46:51 user nova-compute[72239]:     <nova:swap>0</nova:swap>
Jul 31 14:46:51 user nova-compute[72239]:     <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:46:51 user nova-compute[72239]:     <nova:vcpus>1</nova:vcpus>
Jul 31 14:46:51 user nova-compute[72239]:   </nova:flavor>
Jul 31 14:46:51 user nova-compute[72239]:   <nova:owner>
Jul 31 14:46:51 user nova-compute[72239]:     <nova:user uuid="ffb1bd7bcf554374b9b3c5bb1fc2b00a">tempest-TaggedAttachmentsTest-99713276-project-member</nova:user>
Jul 31 14:46:51 user nova-compute[72239]:     <nova:project uuid="0ef0e60cdf6a46cfb149c45d8f5443c6">tempest-TaggedAttachmentsTest-99713276</nova:project>
Jul 31 14:46:51 user nova-compute[72239]:   </nova:owner>
Jul 31 14:46:51 user nova-compute[72239]:   <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:46:51 user nova-compute[72239]:   <nova:ports>
Jul 31 14:46:51 user nova-compute[72239]:     <nova:port uuid="bc41ac8f-b231-4381-9278-64ce17f8833d">
Jul 31 14:46:51 user nova-compute[72239]:       <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 31 14:46:51 user nova-compute[72239]:     </nova:port>
Jul 31 14:46:51 user nova-compute[72239]:   </nova:ports>
Jul 31 14:46:51 user nova-compute[72239]: </nova:instance>
Jul 31 14:46:51 user nova-compute[72239]:  {{(pid=72239) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG nova.network.neutron [None req-4627c361-9a65-4b07-8d62-3922200dd4c4 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Updating instance_info_cache with network_info: [{"id": "bc41ac8f-b231-4381-9278-64ce17f8833d", "address": "fa:16:3e:25:8c:a7", "network": {"id": "c36e8dbf-183c-4511-bb8d-12d2f61ff51c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1591719384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0e60cdf6a46cfb149c45d8f5443c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc41ac8f-b2", "ovs_interfaceid": "bc41ac8f-b231-4381-9278-64ce17f8833d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQpfnwvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:46:51 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:46:51 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:46:51 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:46:51 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:46:51 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 14:46:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4627c361-9a65-4b07-8d62-3922200dd4c4 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Releasing lock "refresh_cache-9bd6169a-9a44-4d9c-a406-c10a2542a7b4" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d717e8-d81c-4a65-80cb-2202d9df1826]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 14:46:51 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4627c361-9a65-4b07-8d62-3922200dd4c4 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lock "interface-9bd6169a-9a44-4d9c-a406-c10a2542a7b4-377c42af-1122-41e2-9dba-9986e495c09a" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.440s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7cc6f5-bb8e-44be-964c-60e9abb06df2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89] added
Jul 31 14:46:51 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e153243a-0179-484b-a167-457201f120ca]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a772231f-31df-45f3-b43d-3fe4365ef180]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cQpfnwvd {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cQpfnwvd" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[97484405-45d6-4a46-be17-025a363901c4]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cQpfnwvd'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12c40b8-3f51-4a05-b791-aa2738808cc2]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[62aec405-0e6d-49d4-ad88-52d73777c87b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:46:51 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:46:51 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:46:51 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:46:51 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:46:51 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:46:51 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:46:51 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:46:51 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:46:51 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:46:51 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:46:51 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:46:51 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf3304d-5f73-4087-9d1c-5d5e88b722a6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89, portal: 172.16.0.220,3260]
Jul 31 14:46:51 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89, portal: 172.16.0.220,3260] successful.
Jul 31 14:46:51 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:52 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54f673e-1b3f-43f8-aa89-1fe0df7428cb]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:46:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:52 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82ebf93-1807-4fc5-93cc-12dd06b66e2c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 (non-flash)
Jul 31 14:46:52 user nova-compute[72239]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:46:52 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:46:52 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:46:52 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:46:52 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:46:52 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:46:52 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:46:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 (non-flash)
Jul 31 14:46:52 user nova-compute[72239]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:46:52 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:46:52 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:46:52 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:46:52 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:46:52 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:46:52 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:46:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:46:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 14:46:52 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] HCTL ('39', '-', '-', 0) found on session 12 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 14:46:52 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 14:46:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:52 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c3c73c-c424-4314-86c5-bc02f3ae96d5]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:52 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Searching for a device in session 12 and hctl ['39', '*', '*', 0] yield: None {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:46:52 user nova-compute[72239]: DEBUG nova.compute.manager [req-bfe4943f-d726-4e8e-83ec-9add60df5d55 req-8a2ca19b-859b-49a5-8c9b-732e45bf53c8 service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Received event network-vif-plugged-377c42af-1122-41e2-9dba-9986e495c09a {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:46:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-bfe4943f-d726-4e8e-83ec-9add60df5d55 req-8a2ca19b-859b-49a5-8c9b-732e45bf53c8 service nova] Acquiring lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-bfe4943f-d726-4e8e-83ec-9add60df5d55 req-8a2ca19b-859b-49a5-8c9b-732e45bf53c8 service nova] Lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-bfe4943f-d726-4e8e-83ec-9add60df5d55 req-8a2ca19b-859b-49a5-8c9b-732e45bf53c8 service nova] Lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:52 user nova-compute[72239]: DEBUG nova.compute.manager [req-bfe4943f-d726-4e8e-83ec-9add60df5d55 req-8a2ca19b-859b-49a5-8c9b-732e45bf53c8 service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] No waiting events found dispatching network-vif-plugged-377c42af-1122-41e2-9dba-9986e495c09a {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:46:52 user nova-compute[72239]: WARNING nova.compute.manager [req-bfe4943f-d726-4e8e-83ec-9add60df5d55 req-8a2ca19b-859b-49a5-8c9b-732e45bf53c8 service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Received unexpected event network-vif-plugged-377c42af-1122-41e2-9dba-9986e495c09a for instance with vm_state active and task_state None.
Jul 31 14:46:53 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Searching for a device in session 12 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:46:53 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQpfnwvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 14:46:53 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:46:53 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26232373762396666', 'path': '/dev/sdh'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:46:53 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232373762396666', 'path': '/dev/sdh'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 14:46:53 user nova-compute[72239]: DEBUG nova.objects.instance [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Lazy-loading 'flavor' on Instance uuid f011c736-1a43-4b0e-ac7c-d512bcaa9bdc {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:46:53 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 14:46:53 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:46:53 user nova-compute[72239]:   <source dev="/dev/sdh"/>
Jul 31 14:46:53 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:46:53 user nova-compute[72239]:   <serial>ab681c1d-23c4-4717-80b9-c98d504cca89</serial>
Jul 31 14:46:53 user nova-compute[72239]: </disk>
Jul 31 14:46:53 user nova-compute[72239]:  {{(pid=72239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 14:46:53 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:46:53 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:46:53 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] No VIF found with MAC fa:16:3e:57:47:b5, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:46:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ffeca91e-2d14-4c26-bfbc-dd02046c802f tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Lock "f011c736-1a43-4b0e-ac7c-d512bcaa9bdc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.417s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:54 user nova-compute[72239]: DEBUG nova.compute.manager [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 14:46:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:54 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 14:46:54 user nova-compute[72239]: INFO nova.compute.claims [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Claim successful on node user
Jul 31 14:46:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Acquiring lock "f011c736-1a43-4b0e-ac7c-d512bcaa9bdc" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:46:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Lock "f011c736-1a43-4b0e-ac7c-d512bcaa9bdc" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:46:55 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:46:55 user nova-compute[72239]: DEBUG os_brick.utils [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:46:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:55 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:46:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:55 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f931a3-0efb-4d66-b1b0-d78d0ef2f6ab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:55 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[636785be-155c-446d-8c4e-14d0d6641cf6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:46:55 user nova-compute[72239]: DEBUG nova.compute.manager [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 14:46:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:46:55 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5ee7d5-e600-4d49-998d-775c0a64e1f2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:55 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea978c98-6a35-4c1d-b9f5-5abf4af38d20]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:46:55 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 14:46:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:46:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:46:55 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 14:46:55 user nova-compute[72239]: DEBUG nova.compute.manager [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 14:46:55 user nova-compute[72239]: DEBUG nova.network.neutron [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 14:46:55 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[791c7f58-558d-4a46-b9d5-5d3b34a549af]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:46:55 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 14:46:55 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 14:46:55 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 14:46:55 user nova-compute[72239]: DEBUG os_brick.utils [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:46:55 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 14:46:55 user nova-compute[72239]: DEBUG nova.compute.manager [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 14:46:55 user nova-compute[72239]: INFO nova.virt.block_device [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Booting with blank volume at /dev/vda
Jul 31 14:46:55 user nova-compute[72239]: DEBUG nova.policy [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '94ab9298205143d489f678b28be5b085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8281237f9c417a9685e55826911e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 14:46:55 user nova-compute[72239]: INFO nova.compute.manager [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Swapping volume ab681c1d-23c4-4717-80b9-c98d504cca89 for 2a2c81c9-b792-4eb4-a07f-62845f9465c8
Jul 31 14:46:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:46:56 user nova-compute[72239]: DEBUG nova.network.neutron [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Successfully created port: 91cadad3-732b-4fed-af92-b54692837973 {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:46:56 user nova-compute[72239]: DEBUG nova.network.neutron [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Successfully updated port: 91cadad3-732b-4fed-af92-b54692837973 {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:46:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "refresh_cache-2f11022e-a007-4d4c-adc1-b54ea59b9e6a" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:46:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquired lock "refresh_cache-2f11022e-a007-4d4c-adc1-b54ea59b9e6a" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:46:56 user nova-compute[72239]: DEBUG nova.network.neutron [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:46:56 user nova-compute[72239]: DEBUG nova.compute.manager [req-e9ef440c-d0dd-433b-bc52-69d2891d989f req-d9f0f922-b450-4dd4-a94c-34493cb45c86 service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Received event network-changed-91cadad3-732b-4fed-af92-b54692837973 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:46:56 user nova-compute[72239]: DEBUG nova.compute.manager [req-e9ef440c-d0dd-433b-bc52-69d2891d989f req-d9f0f922-b450-4dd4-a94c-34493cb45c86 service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Refreshing instance network info cache due to event network-changed-91cadad3-732b-4fed-af92-b54692837973. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:46:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e9ef440c-d0dd-433b-bc52-69d2891d989f req-d9f0f922-b450-4dd4-a94c-34493cb45c86 service nova] Acquiring lock "refresh_cache-2f11022e-a007-4d4c-adc1-b54ea59b9e6a" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:46:57 user nova-compute[72239]: DEBUG nova.network.neutron [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:46:57 user nova-compute[72239]: DEBUG nova.network.neutron [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Updating instance_info_cache with network_info: [{"id": "91cadad3-732b-4fed-af92-b54692837973", "address": "fa:16:3e:44:72:66", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91cadad3-73", "ovs_interfaceid": "91cadad3-732b-4fed-af92-b54692837973", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:46:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Releasing lock "refresh_cache-2f11022e-a007-4d4c-adc1-b54ea59b9e6a" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:46:57 user nova-compute[72239]: DEBUG nova.compute.manager [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Instance network_info: |[{"id": "91cadad3-732b-4fed-af92-b54692837973", "address": "fa:16:3e:44:72:66", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91cadad3-73", "ovs_interfaceid": "91cadad3-732b-4fed-af92-b54692837973", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 14:46:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e9ef440c-d0dd-433b-bc52-69d2891d989f req-d9f0f922-b450-4dd4-a94c-34493cb45c86 service nova] Acquired lock "refresh_cache-2f11022e-a007-4d4c-adc1-b54ea59b9e6a" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:46:57 user nova-compute[72239]: DEBUG nova.network.neutron [req-e9ef440c-d0dd-433b-bc52-69d2891d989f req-d9f0f922-b450-4dd4-a94c-34493cb45c86 service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Refreshing network info cache for port 91cadad3-732b-4fed-af92-b54692837973 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:46:57 user nova-compute[72239]: DEBUG nova.compute.manager [req-20756e38-f82b-4bc5-a1d0-3a8a215f26a0 req-0ce9fd39-3de1-49d1-b287-7b2f734caff4 service nova] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Received event network-changed-8bcdec5f-6bd8-4afc-8618-284f21e2d3c5 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:46:57 user nova-compute[72239]: DEBUG nova.compute.manager [req-20756e38-f82b-4bc5-a1d0-3a8a215f26a0 req-0ce9fd39-3de1-49d1-b287-7b2f734caff4 service nova] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Refreshing instance network info cache due to event network-changed-8bcdec5f-6bd8-4afc-8618-284f21e2d3c5. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:46:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-20756e38-f82b-4bc5-a1d0-3a8a215f26a0 req-0ce9fd39-3de1-49d1-b287-7b2f734caff4 service nova] Acquiring lock "refresh_cache-82116af8-3702-401b-8d00-9291d4caeb03" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:46:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-20756e38-f82b-4bc5-a1d0-3a8a215f26a0 req-0ce9fd39-3de1-49d1-b287-7b2f734caff4 service nova] Acquired lock "refresh_cache-82116af8-3702-401b-8d00-9291d4caeb03" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:46:57 user nova-compute[72239]: DEBUG nova.network.neutron [req-20756e38-f82b-4bc5-a1d0-3a8a215f26a0 req-0ce9fd39-3de1-49d1-b287-7b2f734caff4 service nova] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Refreshing network info cache for port 8bcdec5f-6bd8-4afc-8618-284f21e2d3c5 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:46:57 user nova-compute[72239]: DEBUG nova.network.neutron [req-e9ef440c-d0dd-433b-bc52-69d2891d989f req-d9f0f922-b450-4dd4-a94c-34493cb45c86 service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Updated VIF entry in instance network info cache for port 91cadad3-732b-4fed-af92-b54692837973. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:46:57 user nova-compute[72239]: DEBUG nova.network.neutron [req-e9ef440c-d0dd-433b-bc52-69d2891d989f req-d9f0f922-b450-4dd4-a94c-34493cb45c86 service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Updating instance_info_cache with network_info: [{"id": "91cadad3-732b-4fed-af92-b54692837973", "address": "fa:16:3e:44:72:66", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91cadad3-73", "ovs_interfaceid": "91cadad3-732b-4fed-af92-b54692837973", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:46:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e9ef440c-d0dd-433b-bc52-69d2891d989f req-d9f0f922-b450-4dd4-a94c-34493cb45c86 service nova] Releasing lock "refresh_cache-2f11022e-a007-4d4c-adc1-b54ea59b9e6a" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:46:58 user nova-compute[72239]: DEBUG nova.network.neutron [req-20756e38-f82b-4bc5-a1d0-3a8a215f26a0 req-0ce9fd39-3de1-49d1-b287-7b2f734caff4 service nova] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Updated VIF entry in instance network info cache for port 8bcdec5f-6bd8-4afc-8618-284f21e2d3c5. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:46:58 user nova-compute[72239]: DEBUG nova.network.neutron [req-20756e38-f82b-4bc5-a1d0-3a8a215f26a0 req-0ce9fd39-3de1-49d1-b287-7b2f734caff4 service nova] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Updating instance_info_cache with network_info: [{"id": "8bcdec5f-6bd8-4afc-8618-284f21e2d3c5", "address": "fa:16:3e:2e:96:96", "network": {"id": "024fea8e-c1bc-4b21-9965-ac495ab32b25", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1281491819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "464c4d98738c4a58b69e93b15eacda29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bcdec5f-6b", "ovs_interfaceid": "8bcdec5f-6bd8-4afc-8618-284f21e2d3c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:46:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-20756e38-f82b-4bc5-a1d0-3a8a215f26a0 req-0ce9fd39-3de1-49d1-b287-7b2f734caff4 service nova] Releasing lock "refresh_cache-82116af8-3702-401b-8d00-9291d4caeb03" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:46:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:00 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:00 user nova-compute[72239]: DEBUG os_brick.utils [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:47:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d47ba93e-0433-445d-9e1d-48d45832449e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:01 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8110791-85a3-4547-9f7f-853367bd0955]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:01 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e713118f-b102-4565-b9c1-a7eaf9b4e81c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:01 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae3487d-59d8-4bf8-9112-ff37aed7c9b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:47:01 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 14:47:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:47:01 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 14:47:01 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4229d3d-665f-4d3e-bf5b-59c08a9fa7df]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:01 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 14:47:01 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 14:47:01 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 14:47:01 user nova-compute[72239]: DEBUG os_brick.utils [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:47:01 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Updating existing volume attachment record: c996e11f-d179-44dc-b5f7-8a006722ccf2 {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 14:47:01 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690814806.502703, c244056f-d17d-4d92-98bb-7c0de6a4d261 => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:47:01 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] VM Stopped (Lifecycle Event)
Jul 31 14:47:01 user nova-compute[72239]: DEBUG nova.compute.manager [None req-38f8e8a5-223b-4aaa-a5dd-4ad52d576536 None None] [instance: c244056f-d17d-4d92-98bb-7c0de6a4d261] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:47:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Acquiring lock "82116af8-3702-401b-8d00-9291d4caeb03" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "82116af8-3702-401b-8d00-9291d4caeb03" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:02 user nova-compute[72239]: DEBUG nova.objects.instance [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lazy-loading 'flavor' on Instance uuid 82116af8-3702-401b-8d00-9291d4caeb03 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:47:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "82116af8-3702-401b-8d00-9291d4caeb03" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Acquiring lock "82116af8-3702-401b-8d00-9291d4caeb03" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "82116af8-3702-401b-8d00-9291d4caeb03" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:02 user nova-compute[72239]: INFO nova.compute.manager [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Attaching volume 87c13680-fa38-403d-a378-7fc84fc65207 to /dev/vdb
Jul 31 14:47:02 user nova-compute[72239]: DEBUG os_brick.utils [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:47:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:02 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ee7e45-2b93-4dcb-a252-07bd9c749933]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:02 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4d733e-57cb-4ecd-90a8-c8f071ff7fe9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:02 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d4a71b-4283-4f9b-8181-1049d4d91c2e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:02 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f919c1a7-fd7f-46a2-8e76-47a608a5d61d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:47:02 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 14:47:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:47:02 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 14:47:02 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f962823b-c65c-446d-934b-03612b33529d]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:02 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 14:47:02 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 14:47:02 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 14:47:02 user nova-compute[72239]: DEBUG os_brick.utils [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:47:02 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Updating existing volume attachment record: 54e2e97e-fc9e-4fe8-b2a1-1ed9e6350729 {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 14:47:03 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:03 user nova-compute[72239]: DEBUG nova.compute.manager [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dvCfBXja', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f011c736-1a43-4b0e-ac7c-d512bcaa9bdc', 'attached_at': '', 'detached_at': '', 'volume_id': '2a2c81c9-b792-4eb4-a07f-62845f9465c8', 'serial': '2a2c81c9-b792-4eb4-a07f-62845f9465c8'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQpfnwvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': 'f011c736-1a43-4b0e-ac7c-d512bcaa9bdc', 'attached_at': '', 'detached_at': '', 'volume_id': 'ab681c1d-23c4-4717-80b9-c98d504cca89', 'serial'} {{(pid=72239) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Jul 31 14:47:03 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 14:47:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dvCfBXja', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:47:03 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:47:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:47:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:47:03 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:47:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:47:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:47:03 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 14:47:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:03 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[987059b3-5f64-4735-92ce-ddcb0486e662]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 14:47:03 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:03 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7dd4643-a49c-4fe7-aa59-d71a91a1f0a7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8] added
Jul 31 14:47:03 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.092s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4c28cf-3c49-4831-8061-7928b843d02d]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fabee6-b92c-48b6-9a8b-0d9e521d647e]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dvCfBXja {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dvCfBXja" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b911e0-1fcd-45b1-b3f4-c56275203afc]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dvCfBXja'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2472f22-c2dd-45d3-86ae-580c4c6120b6]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6429b2-eff0-4997-8df6-f55f67466c50]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 (non-flash)
Jul 31 14:47:04 user nova-compute[72239]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:47:04 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:47:04 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:47:04 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:47:04 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:47:04 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:47:04 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 (non-flash)
Jul 31 14:47:04 user nova-compute[72239]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:47:04 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:47:04 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:47:04 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:47:04 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:47:04 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:47:04 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c4c857-cd81-484b-bfa0-7d94999d8a34]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8, portal: 172.16.0.220,3260]
Jul 31 14:47:04 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8, portal: 172.16.0.220,3260] successful.
Jul 31 14:47:04 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[af1200fa-3bda-475a-9c8a-dee2f5b932f8]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[34348959-f1ef-4f01-8758-bad4e46ac71e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 (non-flash)
Jul 31 14:47:04 user nova-compute[72239]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)
Jul 31 14:47:04 user nova-compute[72239]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:47:04 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:47:04 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:47:04 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:47:04 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:47:04 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:47:04 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 (non-flash)
Jul 31 14:47:04 user nova-compute[72239]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)
Jul 31 14:47:04 user nova-compute[72239]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:47:04 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:47:04 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:47:04 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:47:04 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:47:04 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:47:04 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.416s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] HCTL ('40', '-', '-', 0) found on session 13 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4a0fc6-12df-4992-8567-f3a3698f2862]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:04 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Searching for a device in session 13 and hctl ['40', '*', '*', 0] yield: None {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:47:05 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Searching for a device in session 13 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:47:05 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dvCfBXja', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 14:47:05 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.450s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:47:05 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] <== connect_volume: return (1451ms) {'type': 'block', 'scsi_wwn': '23034303232356334', 'path': '/dev/sdi'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:47:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034303232356334', 'path': '/dev/sdi'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 14:47:05 user nova-compute[72239]: DEBUG nova.objects.instance [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Lazy-loading 'flavor' on Instance uuid f011c736-1a43-4b0e-ac7c-d512bcaa9bdc {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:47:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 14:47:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] COPY block job progress, current cursor: 141557760 final cursor: 1073741824 {{(pid=72239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 14:47:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] COPY block job progress, current cursor: 200278016 final cursor: 1073741824 {{(pid=72239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 14:47:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] COPY block job progress, current cursor: 352321536 final cursor: 1073741824 {{(pid=72239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 14:47:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] COPY block job progress, current cursor: 508559360 final cursor: 1073741824 {{(pid=72239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 14:47:08 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] COPY block job progress, current cursor: 670040064 final cursor: 1073741824 {{(pid=72239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 14:47:08 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] COPY block job progress, current cursor: 816840704 final cursor: 1073741824 {{(pid=72239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 14:47:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:08 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:47:08 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:47:08 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 14:47:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-7d81b881-b44e-4fb3-8245-9dea634bdec9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:47:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-7d81b881-b44e-4fb3-8245-9dea634bdec9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:47:09 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 14:47:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] COPY block job progress, current cursor: 973078528 final cursor: 1073741824 {{(pid=72239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 14:47:09 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Updating instance_info_cache with network_info: [{"id": "60f70f18-4024-4388-ae64-3c2cca0cafbc", "address": "fa:16:3e:a5:de:4b", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f70f18-40", "ovs_interfaceid": "60f70f18-4024-4388-ae64-3c2cca0cafbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:47:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-7d81b881-b44e-4fb3-8245-9dea634bdec9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:47:09 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 14:47:09 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:47:09 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:47:09 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:47:09 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:47:09 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:47:09 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:47:09 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 14:47:09 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:47:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:09 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 14:47:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 14:47:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQpfnwvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:47:10 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:47:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.048s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[528d3113-975e-49b2-b3e8-3538363b2bbb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[325e0113-4b1b-41e0-a27d-7fc1637de6a1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 (non-flash)
Jul 31 14:47:10 user nova-compute[72239]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)
Jul 31 14:47:10 user nova-compute[72239]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:47:10 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:47:10 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:47:10 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:47:10 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:47:10 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:47:10 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 (non-flash)
Jul 31 14:47:10 user nova-compute[72239]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)
Jul 31 14:47:10 user nova-compute[72239]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:47:10 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:47:10 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:47:10 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:47:10 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:47:10 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:47:10 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41204a6440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89'): ({'sdh'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Removing single pathed devices sdh {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f011c736-1a43-4b0e-ac7c-d512bcaa9bdc/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a154fc-70b9-48bc-847b-a27f137e7332]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc3fa8e-f938-4acd-94af-a5801e99e65d]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Flushing IO for device /dev/sdh {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e466d71-a0e3-447c-8be2-134e6130146e]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f011c736-1a43-4b0e-ac7c-d512bcaa9bdc/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f011c736-1a43-4b0e-ac7c-d512bcaa9bdc/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.045s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c387e742-7342-4312-a583-78d2baf66600]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] SCSI volumes sdh have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5ccb0a-5b8f-4c1e-932d-12fef40a64ad]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG nova.compute.manager [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 14:47:10 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Creating image(s)
Jul 31 14:47:10 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Did not create local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Ensure instance console log exists: /opt/stack/data/nova/instances/2f11022e-a007-4d4c-adc1-b54ea59b9e6a/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Start _get_guest_xml network_info=[{"id": "91cadad3-732b-4fed-af92-b54692837973", "address": "fa:16:3e:44:72:66", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91cadad3-73", "ovs_interfaceid": "91cadad3-732b-4fed-af92-b54692837973", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'c996e11f-d179-44dc-b5f7-8a006722ccf2', 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WBpGanPy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2f11022e-a007-4d4c-adc1-b54ea59b9e6a', 'attached_at': '', 'detached_at': '', 'volume_id': '6b6e6fc1-6c81-4d1f-92e8-ae4f930973da', 'serial': '6b6e6fc1-6c81-4d1f-92e8-ae4f930973da'}, 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f011c736-1a43-4b0e-ac7c-d512bcaa9bdc/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[409c822e-6084-4805-9c28-031451103caf]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89, portal: 172.16.0.220,3260]
Jul 31 14:47:10 user nova-compute[72239]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89, portal: 172.16.0.220,3260] successful.
Jul 31 14:47:10 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:10 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:47:10 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34b28db-cddb-4292-8f4a-865f599ac640]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.469s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] <== disconnect_volume: return (471ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WBpGanPy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:47:10 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:47:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:47:10 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:47:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:47:10 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 14:47:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG nova.compute.manager [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dvCfBXja', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': 'f011c736-1a43-4b0e-ac7c-d512bcaa9bdc', 'attached_at': '', 'detached_at': '', 'volume_id': '2a2c81c9-b792-4eb4-a07f-62845f9465c8', 'serial'} {{(pid=72239) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG nova.compute.manager [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] swap_volume: removing Cinder connection for volume ab681c1d-23c4-4717-80b9-c98d504cca89 {{(pid=72239) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8a7128-115e-4e04-819d-bac709d9b60f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 14:47:10 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acf92b1-f752-4ae7-b341-d919548f28c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da] added
Jul 31 14:47:10 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f516ff6-bfae-48d4-8a69-0667962a0ca6]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e1281d8-1836-4cef-aa8a-47e68eab0e26]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WBpGanPy {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WBpGanPy" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[02259237-d960-4245-ba09-cfbf688994cf]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WBpGanPy'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8155f73-1e3b-4171-8945-532dcc753f76]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1241964d-6c09-43e8-964f-cb26baed345b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)
Jul 31 14:47:10 user nova-compute[72239]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:47:10 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:47:10 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:47:10 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:47:10 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:47:10 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:47:10 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)
Jul 31 14:47:10 user nova-compute[72239]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:47:10 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:47:10 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:47:10 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:47:10 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:47:10 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:47:10 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[357904f5-b7a9-47c2-8419-52ba8895854f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da, portal: 172.16.0.220,3260]
Jul 31 14:47:11 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da, portal: 172.16.0.220,3260] successful.
Jul 31 14:47:11 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7239021d-37a6-4385-9e3a-86845f6042c2]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6537951e-69ed-4450-b175-3a22aed5b58b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)
Jul 31 14:47:11 user nova-compute[72239]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:47:11 user nova-compute[72239]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:47:11 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:47:11 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:47:11 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:47:11 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:47:11 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:47:11 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)
Jul 31 14:47:11 user nova-compute[72239]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:47:11 user nova-compute[72239]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:47:11 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:47:11 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:47:11 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:47:11 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:47:11 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:47:11 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.361s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] HCTL ('39', '-', '-', 0) found on session 14 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2856d9-0db1-4787-94db-ade4fbe03ef4]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Searching for a device in session 14 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WBpGanPy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json" returned: 0 in 0.163s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG nova.compute.manager [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] swap_volume: Updating volume ab681c1d-23c4-4717-80b9-c98d504cca89 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "dvCfBXja", "auth_password": "CGlKRx6kZYzaM3", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "2a2c81c9-b792-4eb4-a07f-62845f9465c8"}, "status": "reserved", "instance": "f011c736-1a43-4b0e-ac7c-d512bcaa9bdc", "attached_at": "", "detached_at": "", "volume_id": "2a2c81c9-b792-4eb4-a07f-62845f9465c8", "serial": "2a2c81c9-b792-4eb4-a07f-62845f9465c8"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '2a2c81c9-b792-4eb4-a07f-62845f9465c8', 'no_device': None, 'attachment_id': 'ec69d1b7-3962-4976-b7ad-e38f5e68e749'} {{(pid=72239) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-af0450ae-69be-4374-a61e-5fa285ae067b tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Lock "f011c736-1a43-4b0e-ac7c-d512bcaa9bdc" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 16.626s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:47:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hFDuSOsf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:47:12 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:47:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.424s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] <== connect_volume: return (1426ms) {'type': 'block', 'scsi_wwn': '23539613534653037', 'path': '/dev/sdh'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539613534653037', 'path': '/dev/sdh'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.006s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:47:12 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:47:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:47:12 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd58adb-8e8e-4177-a10a-070492ff3545]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 14:47:12 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:46:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1216288639',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1216288639',id=14,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d8281237f9c417a9685e55826911e1b',ramdisk_id='',reservation_id='r-0tq8f5us',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-148379254',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:46:55Z,user_data=None,user_id='94ab9298205143d489f678b28be5b085',uuid=2f11022e-a007-4d4c-adc1-b54ea59b9e6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91cadad3-732b-4fed-af92-b54692837973", "address": "fa:16:3e:44:72:66", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91cadad3-73", "ovs_interfaceid": "91cadad3-732b-4fed-af92-b54692837973", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Converting VIF {"id": "91cadad3-732b-4fed-af92-b54692837973", "address": "fa:16:3e:44:72:66", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91cadad3-73", "ovs_interfaceid": "91cadad3-732b-4fed-af92-b54692837973", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:72:66,bridge_name='br-int',has_traffic_filtering=True,id=91cadad3-732b-4fed-af92-b54692837973,network=Network(172fb80f-4bbe-4706-91cf-60540fbceb2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91cadad3-73') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG nova.objects.instance [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f11022e-a007-4d4c-adc1-b54ea59b9e6a {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72965dc-e29b-4b2d-82fd-a7461f2c5bd0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207] added
Jul 31 14:47:12 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62122879-2a72-4ddf-a028-317eda0da465/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a5aef8-1704-4365-bcf8-7873c39bb2de]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:47:12 user nova-compute[72239]:   <uuid>2f11022e-a007-4d4c-adc1-b54ea59b9e6a</uuid>
Jul 31 14:47:12 user nova-compute[72239]:   <name>instance-0000000e</name>
Jul 31 14:47:12 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:47:12 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:47:12 user nova-compute[72239]:   <metadata>
Jul 31 14:47:12 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:47:12 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:47:12 user nova-compute[72239]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1216288639</nova:name>
Jul 31 14:47:12 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:47:10</nova:creationTime>
Jul 31 14:47:12 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:47:12 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:47:12 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:47:12 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:47:12 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:47:12 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:47:12 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:47:12 user nova-compute[72239]:       <nova:owner>
Jul 31 14:47:12 user nova-compute[72239]:         <nova:user uuid="94ab9298205143d489f678b28be5b085">tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member</nova:user>
Jul 31 14:47:12 user nova-compute[72239]:         <nova:project uuid="1d8281237f9c417a9685e55826911e1b">tempest-ServerBootFromVolumeStableRescueTest-148379254</nova:project>
Jul 31 14:47:12 user nova-compute[72239]:       </nova:owner>
Jul 31 14:47:12 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:47:12 user nova-compute[72239]:       <nova:ports>
Jul 31 14:47:12 user nova-compute[72239]:         <nova:port uuid="91cadad3-732b-4fed-af92-b54692837973">
Jul 31 14:47:12 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 31 14:47:12 user nova-compute[72239]:         </nova:port>
Jul 31 14:47:12 user nova-compute[72239]:       </nova:ports>
Jul 31 14:47:12 user nova-compute[72239]:     </nova:instance>
Jul 31 14:47:12 user nova-compute[72239]:   </metadata>
Jul 31 14:47:12 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:47:12 user nova-compute[72239]:     <system>
Jul 31 14:47:12 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:47:12 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:47:12 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:47:12 user nova-compute[72239]:       <entry name="serial">2f11022e-a007-4d4c-adc1-b54ea59b9e6a</entry>
Jul 31 14:47:12 user nova-compute[72239]:       <entry name="uuid">2f11022e-a007-4d4c-adc1-b54ea59b9e6a</entry>
Jul 31 14:47:12 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:47:12 user nova-compute[72239]:     </system>
Jul 31 14:47:12 user nova-compute[72239]:   </sysinfo>
Jul 31 14:47:12 user nova-compute[72239]:   <os>
Jul 31 14:47:12 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:47:12 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:47:12 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:47:12 user nova-compute[72239]:   </os>
Jul 31 14:47:12 user nova-compute[72239]:   <features>
Jul 31 14:47:12 user nova-compute[72239]:     <acpi/>
Jul 31 14:47:12 user nova-compute[72239]:     <apic/>
Jul 31 14:47:12 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:47:12 user nova-compute[72239]:   </features>
Jul 31 14:47:12 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:47:12 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:47:12 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:47:12 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:47:12 user nova-compute[72239]:   </clock>
Jul 31 14:47:12 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:47:12 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:47:12 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:47:12 user nova-compute[72239]:   </cpu>
Jul 31 14:47:12 user nova-compute[72239]:   <devices>
Jul 31 14:47:12 user nova-compute[72239]:     <disk type="block" device="disk">
Jul 31 14:47:12 user nova-compute[72239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:47:12 user nova-compute[72239]:       <source dev="/dev/sdh"/>
Jul 31 14:47:12 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:47:12 user nova-compute[72239]:       <serial>6b6e6fc1-6c81-4d1f-92e8-ae4f930973da</serial>
Jul 31 14:47:12 user nova-compute[72239]:     </disk>
Jul 31 14:47:12 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:47:12 user nova-compute[72239]:       <mac address="fa:16:3e:44:72:66"/>
Jul 31 14:47:12 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:47:12 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:47:12 user nova-compute[72239]:       <target dev="tap91cadad3-73"/>
Jul 31 14:47:12 user nova-compute[72239]:     </interface>
Jul 31 14:47:12 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:47:12 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/2f11022e-a007-4d4c-adc1-b54ea59b9e6a/console.log" append="off"/>
Jul 31 14:47:12 user nova-compute[72239]:     </serial>
Jul 31 14:47:12 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:47:12 user nova-compute[72239]:     <video>
Jul 31 14:47:12 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:47:12 user nova-compute[72239]:     </video>
Jul 31 14:47:12 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:47:12 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:47:12 user nova-compute[72239]:     </rng>
Jul 31 14:47:12 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:47:12 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:47:12 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:47:12 user nova-compute[72239]:     </memballoon>
Jul 31 14:47:12 user nova-compute[72239]:   </devices>
Jul 31 14:47:12 user nova-compute[72239]: </domain>
Jul 31 14:47:12 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:46:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1216288639',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1216288639',id=14,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d8281237f9c417a9685e55826911e1b',ramdisk_id='',reservation_id='r-0tq8f5us',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-148379254',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:46:55Z,user_data=None,user_id='94ab9298205143d489f678b28be5b085',uuid=2f11022e-a007-4d4c-adc1-b54ea59b9e6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91cadad3-732b-4fed-af92-b54692837973", "address": "fa:16:3e:44:72:66", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91cadad3-73", "ovs_interfaceid": "91cadad3-732b-4fed-af92-b54692837973", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Converting VIF {"id": "91cadad3-732b-4fed-af92-b54692837973", "address": "fa:16:3e:44:72:66", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91cadad3-73", "ovs_interfaceid": "91cadad3-732b-4fed-af92-b54692837973", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:72:66,bridge_name='br-int',has_traffic_filtering=True,id=91cadad3-732b-4fed-af92-b54692837973,network=Network(172fb80f-4bbe-4706-91cf-60540fbceb2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91cadad3-73') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG os_vif [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:72:66,bridge_name='br-int',has_traffic_filtering=True,id=91cadad3-732b-4fed-af92-b54692837973,network=Network(172fb80f-4bbe-4706-91cf-60540fbceb2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91cadad3-73') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap91cadad3-73, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap91cadad3-73, col_values=(('external_ids', {'iface-id': '91cadad3-732b-4fed-af92-b54692837973', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:72:66', 'vm-uuid': '2f11022e-a007-4d4c-adc1-b54ea59b9e6a'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[92567363-b0d9-47d8-8265-f596cb5a10cf]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hFDuSOsf {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:12 user nova-compute[72239]: INFO os_vif [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:72:66,bridge_name='br-int',has_traffic_filtering=True,id=91cadad3-732b-4fed-af92-b54692837973,network=Network(172fb80f-4bbe-4706-91cf-60540fbceb2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91cadad3-73')
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hFDuSOsf" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44c7e91-861a-41fe-9352-b364de015174]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hFDuSOsf'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ace2d5-1bae-49c3-9680-da36007221dd]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] No VIF found with MAC fa:16:3e:44:72:66, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62122879-2a72-4ddf-a028-317eda0da465/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62122879-2a72-4ddf-a028-317eda0da465/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc961d4-e1c1-4973-9f66-6ead9e42acda]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)
Jul 31 14:47:12 user nova-compute[72239]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:47:12 user nova-compute[72239]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:47:12 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:47:12 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:47:12 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:47:12 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:47:12 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:47:12 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)
Jul 31 14:47:12 user nova-compute[72239]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:47:12 user nova-compute[72239]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:47:12 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:47:12 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:47:12 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:47:12 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:47:12 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:47:12 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG nova.compute.manager [req-7312aabd-0792-4914-9d53-2c5c930f62c3 req-db0b4cb7-44e7-42ed-852f-9db600989f31 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-changed-c6a37c9e-0be0-4c76-bb14-fcdb3c39061c {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG nova.compute.manager [req-7312aabd-0792-4914-9d53-2c5c930f62c3 req-db0b4cb7-44e7-42ed-852f-9db600989f31 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Refreshing instance network info cache due to event network-changed-c6a37c9e-0be0-4c76-bb14-fcdb3c39061c. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7312aabd-0792-4914-9d53-2c5c930f62c3 req-db0b4cb7-44e7-42ed-852f-9db600989f31 service nova] Acquiring lock "refresh_cache-9203aeaf-2ae9-4e28-9741-05d33df6c915" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7312aabd-0792-4914-9d53-2c5c930f62c3 req-db0b4cb7-44e7-42ed-852f-9db600989f31 service nova] Acquired lock "refresh_cache-9203aeaf-2ae9-4e28-9741-05d33df6c915" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG nova.network.neutron [req-7312aabd-0792-4914-9d53-2c5c930f62c3 req-db0b4cb7-44e7-42ed-852f-9db600989f31 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Refreshing network info cache for port c6a37c9e-0be0-4c76-bb14-fcdb3c39061c {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a2305d-41a5-4a24-8624-bc9daed3e3b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207, portal: 172.16.0.220,3260]
Jul 31 14:47:12 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207, portal: 172.16.0.220,3260] successful.
Jul 31 14:47:12 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62122879-2a72-4ddf-a028-317eda0da465/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45c2375-6fbc-4627-8323-bf0d88795626]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9668890-4db2-423a-9776-c81ee05b9266]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)
Jul 31 14:47:12 user nova-compute[72239]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:47:12 user nova-compute[72239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 (non-flash)
Jul 31 14:47:12 user nova-compute[72239]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:47:12 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:47:12 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:47:12 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:47:12 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:47:12 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:47:12 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)
Jul 31 14:47:12 user nova-compute[72239]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:47:12 user nova-compute[72239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 (non-flash)
Jul 31 14:47:12 user nova-compute[72239]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:47:12 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:47:12 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:47:12 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:47:12 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:47:12 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:47:12 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.455s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] HCTL ('41', '-', '-', 0) found on session 15 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a897a62d-8858-4ffc-9730-ff7fc551d3a8]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Searching for a device in session 15 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hFDuSOsf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814835.933779, 2f11022e-a007-4d4c-adc1-b54ea59b9e6a => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:47:16 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] VM Resumed (Lifecycle Event)
Jul 31 14:47:16 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.215s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] <== connect_volume: return (4220ms) {'type': 'block', 'scsi_wwn': '23431663665353430', 'path': '/dev/sdj'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431663665353430', 'path': '/dev/sdj'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.compute.manager [req-2c1540b3-4bea-46a6-98d6-ebad24223ed8 req-153ffbc2-bd65-4f13-8b38-5195834f41dc service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Received event network-vif-plugged-91cadad3-732b-4fed-af92-b54692837973 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-2c1540b3-4bea-46a6-98d6-ebad24223ed8 req-153ffbc2-bd65-4f13-8b38-5195834f41dc service nova] Acquiring lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-2c1540b3-4bea-46a6-98d6-ebad24223ed8 req-153ffbc2-bd65-4f13-8b38-5195834f41dc service nova] Lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-2c1540b3-4bea-46a6-98d6-ebad24223ed8 req-153ffbc2-bd65-4f13-8b38-5195834f41dc service nova] Lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.compute.manager [req-2c1540b3-4bea-46a6-98d6-ebad24223ed8 req-153ffbc2-bd65-4f13-8b38-5195834f41dc service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] No waiting events found dispatching network-vif-plugged-91cadad3-732b-4fed-af92-b54692837973 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:47:16 user nova-compute[72239]: WARNING nova.compute.manager [req-2c1540b3-4bea-46a6-98d6-ebad24223ed8 req-153ffbc2-bd65-4f13-8b38-5195834f41dc service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Received unexpected event network-vif-plugged-91cadad3-732b-4fed-af92-b54692837973 for instance with vm_state building and task_state spawning.
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.compute.manager [req-2c1540b3-4bea-46a6-98d6-ebad24223ed8 req-153ffbc2-bd65-4f13-8b38-5195834f41dc service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Received event network-vif-plugged-91cadad3-732b-4fed-af92-b54692837973 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-2c1540b3-4bea-46a6-98d6-ebad24223ed8 req-153ffbc2-bd65-4f13-8b38-5195834f41dc service nova] Acquiring lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-2c1540b3-4bea-46a6-98d6-ebad24223ed8 req-153ffbc2-bd65-4f13-8b38-5195834f41dc service nova] Lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-2c1540b3-4bea-46a6-98d6-ebad24223ed8 req-153ffbc2-bd65-4f13-8b38-5195834f41dc service nova] Lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.compute.manager [req-2c1540b3-4bea-46a6-98d6-ebad24223ed8 req-153ffbc2-bd65-4f13-8b38-5195834f41dc service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] No waiting events found dispatching network-vif-plugged-91cadad3-732b-4fed-af92-b54692837973 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:47:16 user nova-compute[72239]: WARNING nova.compute.manager [req-2c1540b3-4bea-46a6-98d6-ebad24223ed8 req-153ffbc2-bd65-4f13-8b38-5195834f41dc service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Received unexpected event network-vif-plugged-91cadad3-732b-4fed-af92-b54692837973 for instance with vm_state building and task_state spawning.
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.compute.manager [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:47:16 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:47:16 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=6934MB free_disk=25.475059509277344GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Acquiring lock "f011c736-1a43-4b0e-ac7c-d512bcaa9bdc" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Lock "f011c736-1a43-4b0e-ac7c-d512bcaa9bdc" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:16 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Instance spawned successfully.
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.objects.instance [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lazy-loading 'flavor' on Instance uuid 82116af8-3702-401b-8d00-9291d4caeb03 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Acquiring lock "9203aeaf-2ae9-4e28-9741-05d33df6c915" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Acquiring lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:16 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814835.935946, 2f11022e-a007-4d4c-adc1-b54ea59b9e6a => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:47:16 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] VM Started (Lifecycle Event)
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 14:47:16 user nova-compute[72239]: INFO nova.compute.manager [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Terminating instance
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.compute.manager [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG os_brick.utils [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5d5f8c-727f-4e9e-bbe8-c69a609d8e31]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 14:47:16 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:47:16 user nova-compute[72239]:   <source dev="/dev/sdj"/>
Jul 31 14:47:16 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:47:16 user nova-compute[72239]:   <serial>87c13680-fa38-403d-a378-7fc84fc65207</serial>
Jul 31 14:47:16 user nova-compute[72239]: </disk>
Jul 31 14:47:16 user nova-compute[72239]:  {{(pid=72239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aee2ca3-f7f5-42b3-b6f1-d694b301a995]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce43961-b076-4bd1-a6f5-f05ba930dfd3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ec611c-288a-4838-9bd4-62d1cf2dc538]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 14:47:16 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:47:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:47:16 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 14:47:16 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[801002f8-e885-489d-902c-5a355ffdcf24]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG os_brick.utils [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:16 user nova-compute[72239]: INFO nova.compute.manager [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Took 6.08 seconds to spawn the instance on the hypervisor.
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.compute.manager [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 20abf743-de5b-4122-aad0-e2124c7804b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 7d81b881-b44e-4fb3-8245-9dea634bdec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 079a5ed7-ee25-495b-a2a4-924d830a670a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance d3e3612b-c6b9-4308-a45a-1ff3805e18bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 97917500-bc78-433b-8d3d-181ed13667dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 62122879-2a72-4ddf-a028-317eda0da465 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 9bd6169a-9a44-4d9c-a406-c10a2542a7b4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance f011c736-1a43-4b0e-ac7c-d512bcaa9bdc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 82116af8-3702-401b-8d00-9291d4caeb03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 9203aeaf-2ae9-4e28-9741-05d33df6c915 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 6258dba2-2e73-45d7-99f0-9a4af065ffcc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 2f11022e-a007-4d4c-adc1-b54ea59b9e6a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:16 user nova-compute[72239]: INFO nova.compute.manager [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Took 22.12 seconds to build instance.
Jul 31 14:47:16 user nova-compute[72239]: INFO nova.compute.manager [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Swapping volume 2a2c81c9-b792-4eb4-a07f-62845f9465c8 for ab681c1d-23c4-4717-80b9-c98d504cca89
Jul 31 14:47:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f040cc74-f0b1-4667-8b98-2a58b0477179 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.223s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.network.neutron [req-7312aabd-0792-4914-9d53-2c5c930f62c3 req-db0b4cb7-44e7-42ed-852f-9db600989f31 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Updated VIF entry in instance network info cache for port c6a37c9e-0be0-4c76-bb14-fcdb3c39061c. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG nova.network.neutron [req-7312aabd-0792-4914-9d53-2c5c930f62c3 req-db0b4cb7-44e7-42ed-852f-9db600989f31 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Updating instance_info_cache with network_info: [{"id": "c6a37c9e-0be0-4c76-bb14-fcdb3c39061c", "address": "fa:16:3e:3e:7d:12", "network": {"id": "a5162307-ddc4-4843-a8a1-dbd8f52a9ae7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1082900222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a37c9e-0b", "ovs_interfaceid": "c6a37c9e-0be0-4c76-bb14-fcdb3c39061c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0ff36fe-c825-4781-a755-951a52252422", "address": "fa:16:3e:8f:14:75", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0ff36fe-c8", "ovs_interfaceid": "b0ff36fe-c825-4781-a755-951a52252422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8a006aee-3f68-4eb2-b214-6cf76db08ffe", "address": "fa:16:3e:01:82:d6", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a006aee-3f", "ovs_interfaceid": "8a006aee-3f68-4eb2-b214-6cf76db08ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ba2d5a24-f668-4413-abb1-c51cf2038a1c", "address": "fa:16:3e:6c:f1:44", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba2d5a24-f6", "ovs_interfaceid": "ba2d5a24-f668-4413-abb1-c51cf2038a1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c9d1f7e0-c42d-4870-9121-293f57196a09", "address": "fa:16:3e:31:22:60", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d1f7e0-c4", "ovs_interfaceid": "c9d1f7e0-c42d-4870-9121-293f57196a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb8f7d6e-9f92-4684-8867-7f8aed33a68c", "address": "fa:16:3e:f4:31:a2", "network": {"id": "a3e00fe3-9848-453f-89ef-136074c0524f", "bridge": "br-int", "label": "tempest-device-tagging-net2-758627650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb8f7d6e-9f", "ovs_interfaceid": "eb8f7d6e-9f92-4684-8867-7f8aed33a68c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0642e4d3-ade9-425b-9860-f306229034b3", "address": "fa:16:3e:d0:43:52", "network": {"id": "a3e00fe3-9848-453f-89ef-136074c0524f", "bridge": "br-int", "label": "tempest-device-tagging-net2-758627650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0642e4d3-ad", "ovs_interfaceid": "0642e4d3-ade9-425b-9860-f306229034b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7312aabd-0792-4914-9d53-2c5c930f62c3 req-db0b4cb7-44e7-42ed-852f-9db600989f31 service nova] Releasing lock "refresh_cache-9203aeaf-2ae9-4e28-9741-05d33df6c915" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:47:16 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:47:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:47:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] No VIF found with MAC fa:16:3e:2e:96:96, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:47:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:17 user nova-compute[72239]: DEBUG nova.compute.manager [req-36ed4da4-dbb3-4ebd-af1c-679e2930550c req-99c82ebc-d367-4b3a-bb20-7f7319bcf16a service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-changed-da58ae48-fdc4-4816-a641-525030c3beb2 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:17 user nova-compute[72239]: DEBUG nova.compute.manager [req-36ed4da4-dbb3-4ebd-af1c-679e2930550c req-99c82ebc-d367-4b3a-bb20-7f7319bcf16a service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Refreshing instance network info cache due to event network-changed-da58ae48-fdc4-4816-a641-525030c3beb2. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:47:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-36ed4da4-dbb3-4ebd-af1c-679e2930550c req-99c82ebc-d367-4b3a-bb20-7f7319bcf16a service nova] Acquiring lock "refresh_cache-6258dba2-2e73-45d7-99f0-9a4af065ffcc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:47:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-36ed4da4-dbb3-4ebd-af1c-679e2930550c req-99c82ebc-d367-4b3a-bb20-7f7319bcf16a service nova] Acquired lock "refresh_cache-6258dba2-2e73-45d7-99f0-9a4af065ffcc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:47:17 user nova-compute[72239]: DEBUG nova.network.neutron [req-36ed4da4-dbb3-4ebd-af1c-679e2930550c req-99c82ebc-d367-4b3a-bb20-7f7319bcf16a service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Refreshing network info cache for port da58ae48-fdc4-4816-a641-525030c3beb2 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:47:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:17 user nova-compute[72239]: DEBUG nova.compute.manager [req-771da990-bc6d-4b47-b5a9-3f1429398a9a req-0eb0f80b-14e7-4927-b546-d1c948c9c6d3 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-vif-unplugged-c6a37c9e-0be0-4c76-bb14-fcdb3c39061c {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-771da990-bc6d-4b47-b5a9-3f1429398a9a req-0eb0f80b-14e7-4927-b546-d1c948c9c6d3 service nova] Acquiring lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-771da990-bc6d-4b47-b5a9-3f1429398a9a req-0eb0f80b-14e7-4927-b546-d1c948c9c6d3 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-771da990-bc6d-4b47-b5a9-3f1429398a9a req-0eb0f80b-14e7-4927-b546-d1c948c9c6d3 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:17 user nova-compute[72239]: DEBUG nova.compute.manager [req-771da990-bc6d-4b47-b5a9-3f1429398a9a req-0eb0f80b-14e7-4927-b546-d1c948c9c6d3 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] No waiting events found dispatching network-vif-unplugged-c6a37c9e-0be0-4c76-bb14-fcdb3c39061c {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:47:17 user nova-compute[72239]: DEBUG nova.compute.manager [req-771da990-bc6d-4b47-b5a9-3f1429398a9a req-0eb0f80b-14e7-4927-b546-d1c948c9c6d3 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-vif-unplugged-c6a37c9e-0be0-4c76-bb14-fcdb3c39061c for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 14:47:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:17 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:47:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5d0737de-4948-4f27-a050-28b4bb166521 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "82116af8-3702-401b-8d00-9291d4caeb03" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.045s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:17 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:47:17 user nova-compute[72239]: DEBUG nova.compute.manager [req-4b9cfa9d-c8b4-4b7b-957b-bf19816ca354 req-7d147a3e-9960-4b88-8d1b-748dcdeaf422 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-vif-unplugged-8a006aee-3f68-4eb2-b214-6cf76db08ffe {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-4b9cfa9d-c8b4-4b7b-957b-bf19816ca354 req-7d147a3e-9960-4b88-8d1b-748dcdeaf422 service nova] Acquiring lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-4b9cfa9d-c8b4-4b7b-957b-bf19816ca354 req-7d147a3e-9960-4b88-8d1b-748dcdeaf422 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-4b9cfa9d-c8b4-4b7b-957b-bf19816ca354 req-7d147a3e-9960-4b88-8d1b-748dcdeaf422 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:17 user nova-compute[72239]: DEBUG nova.compute.manager [req-4b9cfa9d-c8b4-4b7b-957b-bf19816ca354 req-7d147a3e-9960-4b88-8d1b-748dcdeaf422 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] No waiting events found dispatching network-vif-unplugged-8a006aee-3f68-4eb2-b214-6cf76db08ffe {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:47:17 user nova-compute[72239]: DEBUG nova.compute.manager [req-4b9cfa9d-c8b4-4b7b-957b-bf19816ca354 req-7d147a3e-9960-4b88-8d1b-748dcdeaf422 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-vif-unplugged-8a006aee-3f68-4eb2-b214-6cf76db08ffe for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 14:47:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:17 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 14:47:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.870s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG nova.network.neutron [req-36ed4da4-dbb3-4ebd-af1c-679e2930550c req-99c82ebc-d367-4b3a-bb20-7f7319bcf16a service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Updated VIF entry in instance network info cache for port da58ae48-fdc4-4816-a641-525030c3beb2. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG nova.network.neutron [req-36ed4da4-dbb3-4ebd-af1c-679e2930550c req-99c82ebc-d367-4b3a-bb20-7f7319bcf16a service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Updating instance_info_cache with network_info: [{"id": "da58ae48-fdc4-4816-a641-525030c3beb2", "address": "fa:16:3e:9e:5d:97", "network": {"id": "245d91f7-48d7-400e-80a3-b6d5b3aae4c8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-368247279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda58ae48-fd", "ovs_interfaceid": "da58ae48-fdc4-4816-a641-525030c3beb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd", "address": "fa:16:3e:22:52:9b", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap403cc6d2-3c", "ovs_interfaceid": "403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "57f80e07-cfe0-47a5-9b99-10166cdcf351", "address": "fa:16:3e:81:bd:5b", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f80e07-cf", "ovs_interfaceid": "57f80e07-cfe0-47a5-9b99-10166cdcf351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01e36afb-4b92-42af-a2da-900e447e474e", "address": "fa:16:3e:10:e1:8d", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e36afb-4b", "ovs_interfaceid": "01e36afb-4b92-42af-a2da-900e447e474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "87d5bb80-ad2c-4137-89f2-03bc494de37d", "address": "fa:16:3e:9e:00:eb", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87d5bb80-ad", "ovs_interfaceid": "87d5bb80-ad2c-4137-89f2-03bc494de37d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c330e2c1-2507-406a-b255-6e72d82c689e", "address": "fa:16:3e:1d:8b:68", "network": {"id": "6ffbd985-4f07-4813-901c-fa0af7d3588b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1064713526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc330e2c1-25", "ovs_interfaceid": "c330e2c1-2507-406a-b255-6e72d82c689e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6fba6d4e-0137-4514-9525-29e86356c1eb", "address": "fa:16:3e:87:eb:18", "network": {"id": "6ffbd985-4f07-4813-901c-fa0af7d3588b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1064713526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fba6d4e-01", "ovs_interfaceid": "6fba6d4e-0137-4514-9525-29e86356c1eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-36ed4da4-dbb3-4ebd-af1c-679e2930550c req-99c82ebc-d367-4b3a-bb20-7f7319bcf16a service nova] Releasing lock "refresh_cache-6258dba2-2e73-45d7-99f0-9a4af065ffcc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:47:18 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Instance destroyed successfully.
Jul 31 14:47:18 user nova-compute[72239]: DEBUG nova.objects.instance [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Lazy-loading 'resources' on Instance uuid 9203aeaf-2ae9-4e28-9741-05d33df6c915 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1510454801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1510454801',id=12,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj91NKpHCG6YAcTFuL1E1sIYEk6UEjzcW4uiWf7wJ4UIXs0zlsKhy6oi1xz+Wxei0QYcAxUEjMiBpf7nXPNrwTw/ni1DTL7Cx3bEOOrKrK1r6MSmIKCGfXhsl93me04jA==',key_name='tempest-keypair-1897128663',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:45:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0b2f9834cbe42a68ee0db1b04d842ae',ramdisk_id='',reservation_id='r-6ineiaxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-503086043',owner_user_name='tempest-TaggedBootDevicesTest-503086043-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:45:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d245935ff53452dbd98fa3c45f0c5b7',uuid=9203aeaf-2ae9-4e28-9741-05d33df6c915,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6a37c9e-0be0-4c76-bb14-fcdb3c39061c", "address": "fa:16:3e:3e:7d:12", "network": {"id": "a5162307-ddc4-4843-a8a1-dbd8f52a9ae7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1082900222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a37c9e-0b", "ovs_interfaceid": "c6a37c9e-0be0-4c76-bb14-fcdb3c39061c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converting VIF {"id": "c6a37c9e-0be0-4c76-bb14-fcdb3c39061c", "address": "fa:16:3e:3e:7d:12", "network": {"id": "a5162307-ddc4-4843-a8a1-dbd8f52a9ae7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1082900222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a37c9e-0b", "ovs_interfaceid": "c6a37c9e-0be0-4c76-bb14-fcdb3c39061c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:7d:12,bridge_name='br-int',has_traffic_filtering=True,id=c6a37c9e-0be0-4c76-bb14-fcdb3c39061c,network=Network(a5162307-ddc4-4843-a8a1-dbd8f52a9ae7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6a37c9e-0b') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG os_vif [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:7d:12,bridge_name='br-int',has_traffic_filtering=True,id=c6a37c9e-0be0-4c76-bb14-fcdb3c39061c,network=Network(a5162307-ddc4-4843-a8a1-dbd8f52a9ae7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6a37c9e-0b') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc6a37c9e-0b, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:18 user nova-compute[72239]: INFO os_vif [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:7d:12,bridge_name='br-int',has_traffic_filtering=True,id=c6a37c9e-0be0-4c76-bb14-fcdb3c39061c,network=Network(a5162307-ddc4-4843-a8a1-dbd8f52a9ae7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6a37c9e-0b')
Jul 31 14:47:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1510454801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1510454801',id=12,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj91NKpHCG6YAcTFuL1E1sIYEk6UEjzcW4uiWf7wJ4UIXs0zlsKhy6oi1xz+Wxei0QYcAxUEjMiBpf7nXPNrwTw/ni1DTL7Cx3bEOOrKrK1r6MSmIKCGfXhsl93me04jA==',key_name='tempest-keypair-1897128663',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:45:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0b2f9834cbe42a68ee0db1b04d842ae',ramdisk_id='',reservation_id='r-6ineiaxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-503086043',owner_user_name='tempest-TaggedBootDevicesTest-503086043-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:45:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d245935ff53452dbd98fa3c45f0c5b7',uuid=9203aeaf-2ae9-4e28-9741-05d33df6c915,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b0ff36fe-c825-4781-a755-951a52252422", "address": "fa:16:3e:8f:14:75", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0ff36fe-c8", "ovs_interfaceid": "b0ff36fe-c825-4781-a755-951a52252422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converting VIF {"id": "b0ff36fe-c825-4781-a755-951a52252422", "address": "fa:16:3e:8f:14:75", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0ff36fe-c8", "ovs_interfaceid": "b0ff36fe-c825-4781-a755-951a52252422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:14:75,bridge_name='br-int',has_traffic_filtering=True,id=b0ff36fe-c825-4781-a755-951a52252422,network=Network(fd06ec07-887e-47f8-9d06-277094ea6a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb0ff36fe-c8') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG os_vif [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:14:75,bridge_name='br-int',has_traffic_filtering=True,id=b0ff36fe-c825-4781-a755-951a52252422,network=Network(fd06ec07-887e-47f8-9d06-277094ea6a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb0ff36fe-c8') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb0ff36fe-c8, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:18 user nova-compute[72239]: INFO os_vif [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:14:75,bridge_name='br-int',has_traffic_filtering=True,id=b0ff36fe-c825-4781-a755-951a52252422,network=Network(fd06ec07-887e-47f8-9d06-277094ea6a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb0ff36fe-c8')
Jul 31 14:47:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1510454801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1510454801',id=12,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj91NKpHCG6YAcTFuL1E1sIYEk6UEjzcW4uiWf7wJ4UIXs0zlsKhy6oi1xz+Wxei0QYcAxUEjMiBpf7nXPNrwTw/ni1DTL7Cx3bEOOrKrK1r6MSmIKCGfXhsl93me04jA==',key_name='tempest-keypair-1897128663',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:45:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0b2f9834cbe42a68ee0db1b04d842ae',ramdisk_id='',reservation_id='r-6ineiaxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-503086043',owner_user_name='tempest-TaggedBootDevicesTest-503086043-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:45:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d245935ff53452dbd98fa3c45f0c5b7',uuid=9203aeaf-2ae9-4e28-9741-05d33df6c915,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a006aee-3f68-4eb2-b214-6cf76db08ffe", "address": "fa:16:3e:01:82:d6", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a006aee-3f", "ovs_interfaceid": "8a006aee-3f68-4eb2-b214-6cf76db08ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converting VIF {"id": "8a006aee-3f68-4eb2-b214-6cf76db08ffe", "address": "fa:16:3e:01:82:d6", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a006aee-3f", "ovs_interfaceid": "8a006aee-3f68-4eb2-b214-6cf76db08ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:82:d6,bridge_name='br-int',has_traffic_filtering=True,id=8a006aee-3f68-4eb2-b214-6cf76db08ffe,network=Network(fd06ec07-887e-47f8-9d06-277094ea6a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8a006aee-3f') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG os_vif [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:82:d6,bridge_name='br-int',has_traffic_filtering=True,id=8a006aee-3f68-4eb2-b214-6cf76db08ffe,network=Network(fd06ec07-887e-47f8-9d06-277094ea6a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8a006aee-3f') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a006aee-3f, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:18 user nova-compute[72239]: INFO os_vif [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:82:d6,bridge_name='br-int',has_traffic_filtering=True,id=8a006aee-3f68-4eb2-b214-6cf76db08ffe,network=Network(fd06ec07-887e-47f8-9d06-277094ea6a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8a006aee-3f')
Jul 31 14:47:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1510454801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1510454801',id=12,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj91NKpHCG6YAcTFuL1E1sIYEk6UEjzcW4uiWf7wJ4UIXs0zlsKhy6oi1xz+Wxei0QYcAxUEjMiBpf7nXPNrwTw/ni1DTL7Cx3bEOOrKrK1r6MSmIKCGfXhsl93me04jA==',key_name='tempest-keypair-1897128663',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:45:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0b2f9834cbe42a68ee0db1b04d842ae',ramdisk_id='',reservation_id='r-6ineiaxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-503086043',owner_user_name='tempest-TaggedBootDevicesTest-503086043-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:45:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d245935ff53452dbd98fa3c45f0c5b7',uuid=9203aeaf-2ae9-4e28-9741-05d33df6c915,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba2d5a24-f668-4413-abb1-c51cf2038a1c", "address": "fa:16:3e:6c:f1:44", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba2d5a24-f6", "ovs_interfaceid": "ba2d5a24-f668-4413-abb1-c51cf2038a1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converting VIF {"id": "ba2d5a24-f668-4413-abb1-c51cf2038a1c", "address": "fa:16:3e:6c:f1:44", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba2d5a24-f6", "ovs_interfaceid": "ba2d5a24-f668-4413-abb1-c51cf2038a1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6c:f1:44,bridge_name='br-int',has_traffic_filtering=True,id=ba2d5a24-f668-4413-abb1-c51cf2038a1c,network=Network(fd06ec07-887e-47f8-9d06-277094ea6a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba2d5a24-f6') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG os_vif [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:f1:44,bridge_name='br-int',has_traffic_filtering=True,id=ba2d5a24-f668-4413-abb1-c51cf2038a1c,network=Network(fd06ec07-887e-47f8-9d06-277094ea6a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba2d5a24-f6') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba2d5a24-f6, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:18 user nova-compute[72239]: INFO os_vif [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6c:f1:44,bridge_name='br-int',has_traffic_filtering=True,id=ba2d5a24-f668-4413-abb1-c51cf2038a1c,network=Network(fd06ec07-887e-47f8-9d06-277094ea6a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapba2d5a24-f6')
Jul 31 14:47:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1510454801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1510454801',id=12,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj91NKpHCG6YAcTFuL1E1sIYEk6UEjzcW4uiWf7wJ4UIXs0zlsKhy6oi1xz+Wxei0QYcAxUEjMiBpf7nXPNrwTw/ni1DTL7Cx3bEOOrKrK1r6MSmIKCGfXhsl93me04jA==',key_name='tempest-keypair-1897128663',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:45:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0b2f9834cbe42a68ee0db1b04d842ae',ramdisk_id='',reservation_id='r-6ineiaxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-503086043',owner_user_name='tempest-TaggedBootDevicesTest-503086043-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:45:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d245935ff53452dbd98fa3c45f0c5b7',uuid=9203aeaf-2ae9-4e28-9741-05d33df6c915,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9d1f7e0-c42d-4870-9121-293f57196a09", "address": "fa:16:3e:31:22:60", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d1f7e0-c4", "ovs_interfaceid": "c9d1f7e0-c42d-4870-9121-293f57196a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converting VIF {"id": "c9d1f7e0-c42d-4870-9121-293f57196a09", "address": "fa:16:3e:31:22:60", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d1f7e0-c4", "ovs_interfaceid": "c9d1f7e0-c42d-4870-9121-293f57196a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:22:60,bridge_name='br-int',has_traffic_filtering=True,id=c9d1f7e0-c42d-4870-9121-293f57196a09,network=Network(fd06ec07-887e-47f8-9d06-277094ea6a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9d1f7e0-c4') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG os_vif [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:22:60,bridge_name='br-int',has_traffic_filtering=True,id=c9d1f7e0-c42d-4870-9121-293f57196a09,network=Network(fd06ec07-887e-47f8-9d06-277094ea6a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9d1f7e0-c4') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9d1f7e0-c4, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:18 user nova-compute[72239]: INFO os_vif [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:22:60,bridge_name='br-int',has_traffic_filtering=True,id=c9d1f7e0-c42d-4870-9121-293f57196a09,network=Network(fd06ec07-887e-47f8-9d06-277094ea6a05),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9d1f7e0-c4')
Jul 31 14:47:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1510454801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1510454801',id=12,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj91NKpHCG6YAcTFuL1E1sIYEk6UEjzcW4uiWf7wJ4UIXs0zlsKhy6oi1xz+Wxei0QYcAxUEjMiBpf7nXPNrwTw/ni1DTL7Cx3bEOOrKrK1r6MSmIKCGfXhsl93me04jA==',key_name='tempest-keypair-1897128663',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:45:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0b2f9834cbe42a68ee0db1b04d842ae',ramdisk_id='',reservation_id='r-6ineiaxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-503086043',owner_user_name='tempest-TaggedBootDevicesTest-503086043-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:45:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d245935ff53452dbd98fa3c45f0c5b7',uuid=9203aeaf-2ae9-4e28-9741-05d33df6c915,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb8f7d6e-9f92-4684-8867-7f8aed33a68c", "address": "fa:16:3e:f4:31:a2", "network": {"id": "a3e00fe3-9848-453f-89ef-136074c0524f", "bridge": "br-int", "label": "tempest-device-tagging-net2-758627650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb8f7d6e-9f", "ovs_interfaceid": "eb8f7d6e-9f92-4684-8867-7f8aed33a68c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converting VIF {"id": "eb8f7d6e-9f92-4684-8867-7f8aed33a68c", "address": "fa:16:3e:f4:31:a2", "network": {"id": "a3e00fe3-9848-453f-89ef-136074c0524f", "bridge": "br-int", "label": "tempest-device-tagging-net2-758627650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb8f7d6e-9f", "ovs_interfaceid": "eb8f7d6e-9f92-4684-8867-7f8aed33a68c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:31:a2,bridge_name='br-int',has_traffic_filtering=True,id=eb8f7d6e-9f92-4684-8867-7f8aed33a68c,network=Network(a3e00fe3-9848-453f-89ef-136074c0524f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb8f7d6e-9f') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG os_vif [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:31:a2,bridge_name='br-int',has_traffic_filtering=True,id=eb8f7d6e-9f92-4684-8867-7f8aed33a68c,network=Network(a3e00fe3-9848-453f-89ef-136074c0524f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb8f7d6e-9f') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb8f7d6e-9f, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:18 user nova-compute[72239]: INFO os_vif [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:31:a2,bridge_name='br-int',has_traffic_filtering=True,id=eb8f7d6e-9f92-4684-8867-7f8aed33a68c,network=Network(a3e00fe3-9848-453f-89ef-136074c0524f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb8f7d6e-9f')
Jul 31 14:47:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1510454801',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1510454801',id=12,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKj91NKpHCG6YAcTFuL1E1sIYEk6UEjzcW4uiWf7wJ4UIXs0zlsKhy6oi1xz+Wxei0QYcAxUEjMiBpf7nXPNrwTw/ni1DTL7Cx3bEOOrKrK1r6MSmIKCGfXhsl93me04jA==',key_name='tempest-keypair-1897128663',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:45:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0b2f9834cbe42a68ee0db1b04d842ae',ramdisk_id='',reservation_id='r-6ineiaxx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-503086043',owner_user_name='tempest-TaggedBootDevicesTest-503086043-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:45:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d245935ff53452dbd98fa3c45f0c5b7',uuid=9203aeaf-2ae9-4e28-9741-05d33df6c915,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0642e4d3-ade9-425b-9860-f306229034b3", "address": "fa:16:3e:d0:43:52", "network": {"id": "a3e00fe3-9848-453f-89ef-136074c0524f", "bridge": "br-int", "label": "tempest-device-tagging-net2-758627650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0642e4d3-ad", "ovs_interfaceid": "0642e4d3-ade9-425b-9860-f306229034b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converting VIF {"id": "0642e4d3-ade9-425b-9860-f306229034b3", "address": "fa:16:3e:d0:43:52", "network": {"id": "a3e00fe3-9848-453f-89ef-136074c0524f", "bridge": "br-int", "label": "tempest-device-tagging-net2-758627650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0642e4d3-ad", "ovs_interfaceid": "0642e4d3-ade9-425b-9860-f306229034b3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:43:52,bridge_name='br-int',has_traffic_filtering=True,id=0642e4d3-ade9-425b-9860-f306229034b3,network=Network(a3e00fe3-9848-453f-89ef-136074c0524f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0642e4d3-ad') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG os_vif [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:43:52,bridge_name='br-int',has_traffic_filtering=True,id=0642e4d3-ade9-425b-9860-f306229034b3,network=Network(a3e00fe3-9848-453f-89ef-136074c0524f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0642e4d3-ad') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0642e4d3-ad, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:47:18 user nova-compute[72239]: INFO os_vif [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:43:52,bridge_name='br-int',has_traffic_filtering=True,id=0642e4d3-ade9-425b-9860-f306229034b3,network=Network(a3e00fe3-9848-453f-89ef-136074c0524f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0642e4d3-ad')
Jul 31 14:47:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IcgDofRQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:47:18 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:47:18 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[17787d78-2c1a-4b8c-b550-8d080834fdb5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[071c1775-3ddf-41b8-82fd-f5aac641e580]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)
Jul 31 14:47:18 user nova-compute[72239]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:47:18 user nova-compute[72239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 (non-flash)
Jul 31 14:47:18 user nova-compute[72239]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:47:18 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:47:18 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:47:18 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:47:18 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:47:18 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:47:18 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)
Jul 31 14:47:18 user nova-compute[72239]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:47:18 user nova-compute[72239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 (non-flash)
Jul 31 14:47:18 user nova-compute[72239]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 (non-flash)
Jul 31 14:47:18 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:47:18 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:47:18 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:47:18 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:47:18 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:47:18 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4126ab4670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8'): ({'sdb'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Removing single pathed devices sdb {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b128e703-5d17-40b0-8ab7-07f7ec493dd9]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a87040-96b5-4d5c-bfe6-fc6931aa29df]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Flushing IO for device /dev/sdb {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[05539742-056b-4a21-8b74-4e2e5a2c972e]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4c87be-8a37-4194-8eac-261b40cfee94]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[edae095b-361c-46d7-b065-98bb9ebc7a3f]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:18 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07abad1-f35f-49b1-8a35-8891e511dbf1]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8, portal: 172.16.0.220,3260]
Jul 31 14:47:19 user nova-compute[72239]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8, portal: 172.16.0.220,3260] successful.
Jul 31 14:47:19 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cb24618d-3cca-4d31-a104-7684353332d8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77d7a77-9478-4268-9ed5-5ee40e4b4d14]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.361s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] <== disconnect_volume: return (362ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MxRKqpOL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:47:19 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:47:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bb2329-10be-4c3f-a95d-a7a760b06360]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1e9fba-47d2-40f6-b582-a34c7359f925]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)
Jul 31 14:47:19 user nova-compute[72239]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:47:19 user nova-compute[72239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 (non-flash)
Jul 31 14:47:19 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:47:19 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:47:19 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:47:19 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:47:19 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:47:19 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)
Jul 31 14:47:19 user nova-compute[72239]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:47:19 user nova-compute[72239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 (non-flash)
Jul 31 14:47:19 user nova-compute[72239]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 (non-flash)
Jul 31 14:47:19 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:47:19 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:47:19 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:47:19 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:47:19 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4121486f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051'): ({'sdc'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Removing single pathed devices sdc {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb07296-7b93-41af-b8ea-2f39a55ad826]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c94b868-1b3b-4190-9d40-2064043656eb]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Flushing IO for device /dev/sdc {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3390758-a387-4107-8897-e089e79a7173]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-e32883a8-4b9b-4474-82c0-9c6d59276041 req-4bce7103-c050-40d5-bbde-c92df3cae0a3 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-vif-plugged-c6a37c9e-0be0-4c76-bb14-fcdb3c39061c {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e32883a8-4b9b-4474-82c0-9c6d59276041 req-4bce7103-c050-40d5-bbde-c92df3cae0a3 service nova] Acquiring lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e32883a8-4b9b-4474-82c0-9c6d59276041 req-4bce7103-c050-40d5-bbde-c92df3cae0a3 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e32883a8-4b9b-4474-82c0-9c6d59276041 req-4bce7103-c050-40d5-bbde-c92df3cae0a3 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-e32883a8-4b9b-4474-82c0-9c6d59276041 req-4bce7103-c050-40d5-bbde-c92df3cae0a3 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] No waiting events found dispatching network-vif-plugged-c6a37c9e-0be0-4c76-bb14-fcdb3c39061c {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:47:19 user nova-compute[72239]: WARNING nova.compute.manager [req-e32883a8-4b9b-4474-82c0-9c6d59276041 req-4bce7103-c050-40d5-bbde-c92df3cae0a3 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received unexpected event network-vif-plugged-c6a37c9e-0be0-4c76-bb14-fcdb3c39061c for instance with vm_state active and task_state deleting.
Jul 31 14:47:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-e32883a8-4b9b-4474-82c0-9c6d59276041 req-4bce7103-c050-40d5-bbde-c92df3cae0a3 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-vif-unplugged-b0ff36fe-c825-4781-a755-951a52252422 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e32883a8-4b9b-4474-82c0-9c6d59276041 req-4bce7103-c050-40d5-bbde-c92df3cae0a3 service nova] Acquiring lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e32883a8-4b9b-4474-82c0-9c6d59276041 req-4bce7103-c050-40d5-bbde-c92df3cae0a3 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e32883a8-4b9b-4474-82c0-9c6d59276041 req-4bce7103-c050-40d5-bbde-c92df3cae0a3 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-e32883a8-4b9b-4474-82c0-9c6d59276041 req-4bce7103-c050-40d5-bbde-c92df3cae0a3 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] No waiting events found dispatching network-vif-unplugged-b0ff36fe-c825-4781-a755-951a52252422 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-e32883a8-4b9b-4474-82c0-9c6d59276041 req-4bce7103-c050-40d5-bbde-c92df3cae0a3 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-vif-unplugged-b0ff36fe-c825-4781-a755-951a52252422 for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-e32883a8-4b9b-4474-82c0-9c6d59276041 req-4bce7103-c050-40d5-bbde-c92df3cae0a3 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-vif-plugged-b0ff36fe-c825-4781-a755-951a52252422 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e32883a8-4b9b-4474-82c0-9c6d59276041 req-4bce7103-c050-40d5-bbde-c92df3cae0a3 service nova] Acquiring lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e32883a8-4b9b-4474-82c0-9c6d59276041 req-4bce7103-c050-40d5-bbde-c92df3cae0a3 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e32883a8-4b9b-4474-82c0-9c6d59276041 req-4bce7103-c050-40d5-bbde-c92df3cae0a3 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-e32883a8-4b9b-4474-82c0-9c6d59276041 req-4bce7103-c050-40d5-bbde-c92df3cae0a3 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] No waiting events found dispatching network-vif-plugged-b0ff36fe-c825-4781-a755-951a52252422 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:47:19 user nova-compute[72239]: WARNING nova.compute.manager [req-e32883a8-4b9b-4474-82c0-9c6d59276041 req-4bce7103-c050-40d5-bbde-c92df3cae0a3 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received unexpected event network-vif-plugged-b0ff36fe-c825-4781-a755-951a52252422 for instance with vm_state active and task_state deleting.
Jul 31 14:47:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-e32883a8-4b9b-4474-82c0-9c6d59276041 req-4bce7103-c050-40d5-bbde-c92df3cae0a3 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-vif-unplugged-c9d1f7e0-c42d-4870-9121-293f57196a09 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e32883a8-4b9b-4474-82c0-9c6d59276041 req-4bce7103-c050-40d5-bbde-c92df3cae0a3 service nova] Acquiring lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e32883a8-4b9b-4474-82c0-9c6d59276041 req-4bce7103-c050-40d5-bbde-c92df3cae0a3 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e32883a8-4b9b-4474-82c0-9c6d59276041 req-4bce7103-c050-40d5-bbde-c92df3cae0a3 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-e32883a8-4b9b-4474-82c0-9c6d59276041 req-4bce7103-c050-40d5-bbde-c92df3cae0a3 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] No waiting events found dispatching network-vif-unplugged-c9d1f7e0-c42d-4870-9121-293f57196a09 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-e32883a8-4b9b-4474-82c0-9c6d59276041 req-4bce7103-c050-40d5-bbde-c92df3cae0a3 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-vif-unplugged-c9d1f7e0-c42d-4870-9121-293f57196a09 for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-e32883a8-4b9b-4474-82c0-9c6d59276041 req-4bce7103-c050-40d5-bbde-c92df3cae0a3 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-vif-plugged-c9d1f7e0-c42d-4870-9121-293f57196a09 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e32883a8-4b9b-4474-82c0-9c6d59276041 req-4bce7103-c050-40d5-bbde-c92df3cae0a3 service nova] Acquiring lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e32883a8-4b9b-4474-82c0-9c6d59276041 req-4bce7103-c050-40d5-bbde-c92df3cae0a3 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e32883a8-4b9b-4474-82c0-9c6d59276041 req-4bce7103-c050-40d5-bbde-c92df3cae0a3 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-e32883a8-4b9b-4474-82c0-9c6d59276041 req-4bce7103-c050-40d5-bbde-c92df3cae0a3 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] No waiting events found dispatching network-vif-plugged-c9d1f7e0-c42d-4870-9121-293f57196a09 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:47:19 user nova-compute[72239]: WARNING nova.compute.manager [req-e32883a8-4b9b-4474-82c0-9c6d59276041 req-4bce7103-c050-40d5-bbde-c92df3cae0a3 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received unexpected event network-vif-plugged-c9d1f7e0-c42d-4870-9121-293f57196a09 for instance with vm_state active and task_state deleting.
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4f153f7-79a1-49e3-a21e-57d5ee8f92dc]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] SCSI volumes sdc have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[516ac7cd-c0fc-4116-b20f-aa2201a75215]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-b6735d96-afb3-4708-9d5a-bf55925dea72 req-fd2a7faa-fe47-42b8-b682-a9e215983e61 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-vif-plugged-8a006aee-3f68-4eb2-b214-6cf76db08ffe {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b6735d96-afb3-4708-9d5a-bf55925dea72 req-fd2a7faa-fe47-42b8-b682-a9e215983e61 service nova] Acquiring lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b6735d96-afb3-4708-9d5a-bf55925dea72 req-fd2a7faa-fe47-42b8-b682-a9e215983e61 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b6735d96-afb3-4708-9d5a-bf55925dea72 req-fd2a7faa-fe47-42b8-b682-a9e215983e61 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-b6735d96-afb3-4708-9d5a-bf55925dea72 req-fd2a7faa-fe47-42b8-b682-a9e215983e61 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] No waiting events found dispatching network-vif-plugged-8a006aee-3f68-4eb2-b214-6cf76db08ffe {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:47:19 user nova-compute[72239]: WARNING nova.compute.manager [req-b6735d96-afb3-4708-9d5a-bf55925dea72 req-fd2a7faa-fe47-42b8-b682-a9e215983e61 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received unexpected event network-vif-plugged-8a006aee-3f68-4eb2-b214-6cf76db08ffe for instance with vm_state active and task_state deleting.
Jul 31 14:47:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-b6735d96-afb3-4708-9d5a-bf55925dea72 req-fd2a7faa-fe47-42b8-b682-a9e215983e61 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-vif-unplugged-ba2d5a24-f668-4413-abb1-c51cf2038a1c {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b6735d96-afb3-4708-9d5a-bf55925dea72 req-fd2a7faa-fe47-42b8-b682-a9e215983e61 service nova] Acquiring lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b6735d96-afb3-4708-9d5a-bf55925dea72 req-fd2a7faa-fe47-42b8-b682-a9e215983e61 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b6735d96-afb3-4708-9d5a-bf55925dea72 req-fd2a7faa-fe47-42b8-b682-a9e215983e61 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-b6735d96-afb3-4708-9d5a-bf55925dea72 req-fd2a7faa-fe47-42b8-b682-a9e215983e61 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] No waiting events found dispatching network-vif-unplugged-ba2d5a24-f668-4413-abb1-c51cf2038a1c {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-b6735d96-afb3-4708-9d5a-bf55925dea72 req-fd2a7faa-fe47-42b8-b682-a9e215983e61 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-vif-unplugged-ba2d5a24-f668-4413-abb1-c51cf2038a1c for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-b6735d96-afb3-4708-9d5a-bf55925dea72 req-fd2a7faa-fe47-42b8-b682-a9e215983e61 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-vif-plugged-ba2d5a24-f668-4413-abb1-c51cf2038a1c {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b6735d96-afb3-4708-9d5a-bf55925dea72 req-fd2a7faa-fe47-42b8-b682-a9e215983e61 service nova] Acquiring lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b6735d96-afb3-4708-9d5a-bf55925dea72 req-fd2a7faa-fe47-42b8-b682-a9e215983e61 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b6735d96-afb3-4708-9d5a-bf55925dea72 req-fd2a7faa-fe47-42b8-b682-a9e215983e61 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-b6735d96-afb3-4708-9d5a-bf55925dea72 req-fd2a7faa-fe47-42b8-b682-a9e215983e61 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] No waiting events found dispatching network-vif-plugged-ba2d5a24-f668-4413-abb1-c51cf2038a1c {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:47:19 user nova-compute[72239]: WARNING nova.compute.manager [req-b6735d96-afb3-4708-9d5a-bf55925dea72 req-fd2a7faa-fe47-42b8-b682-a9e215983e61 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received unexpected event network-vif-plugged-ba2d5a24-f668-4413-abb1-c51cf2038a1c for instance with vm_state active and task_state deleting.
Jul 31 14:47:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-b6735d96-afb3-4708-9d5a-bf55925dea72 req-fd2a7faa-fe47-42b8-b682-a9e215983e61 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-vif-unplugged-0642e4d3-ade9-425b-9860-f306229034b3 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b6735d96-afb3-4708-9d5a-bf55925dea72 req-fd2a7faa-fe47-42b8-b682-a9e215983e61 service nova] Acquiring lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b6735d96-afb3-4708-9d5a-bf55925dea72 req-fd2a7faa-fe47-42b8-b682-a9e215983e61 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b6735d96-afb3-4708-9d5a-bf55925dea72 req-fd2a7faa-fe47-42b8-b682-a9e215983e61 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-b6735d96-afb3-4708-9d5a-bf55925dea72 req-fd2a7faa-fe47-42b8-b682-a9e215983e61 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] No waiting events found dispatching network-vif-unplugged-0642e4d3-ade9-425b-9860-f306229034b3 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-b6735d96-afb3-4708-9d5a-bf55925dea72 req-fd2a7faa-fe47-42b8-b682-a9e215983e61 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-vif-unplugged-0642e4d3-ade9-425b-9860-f306229034b3 for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-b6735d96-afb3-4708-9d5a-bf55925dea72 req-fd2a7faa-fe47-42b8-b682-a9e215983e61 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-vif-plugged-0642e4d3-ade9-425b-9860-f306229034b3 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b6735d96-afb3-4708-9d5a-bf55925dea72 req-fd2a7faa-fe47-42b8-b682-a9e215983e61 service nova] Acquiring lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b6735d96-afb3-4708-9d5a-bf55925dea72 req-fd2a7faa-fe47-42b8-b682-a9e215983e61 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b6735d96-afb3-4708-9d5a-bf55925dea72 req-fd2a7faa-fe47-42b8-b682-a9e215983e61 service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-b6735d96-afb3-4708-9d5a-bf55925dea72 req-fd2a7faa-fe47-42b8-b682-a9e215983e61 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] No waiting events found dispatching network-vif-plugged-0642e4d3-ade9-425b-9860-f306229034b3 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:47:19 user nova-compute[72239]: WARNING nova.compute.manager [req-b6735d96-afb3-4708-9d5a-bf55925dea72 req-fd2a7faa-fe47-42b8-b682-a9e215983e61 service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received unexpected event network-vif-plugged-0642e4d3-ade9-425b-9860-f306229034b3 for instance with vm_state active and task_state deleting.
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 -p 172.16.0.220:3260 --logout" returned: 0 in 0.095s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c177bcab-6a7d-474e-b6ad-aacb1c8f1848]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051, portal: 172.16.0.220,3260]
Jul 31 14:47:19 user nova-compute[72239]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051, portal: 172.16.0.220,3260] successful.
Jul 31 14:47:19 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:24a7c8cf-bf98-4c59-8ee1-2b371357a051 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[111cc1c0-7fdc-4524-bad0-237fbcbaf8d1]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] <== disconnect_volume: return (363ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EfFSLqya', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:47:19 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:47:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35b9ccc-3e3c-40eb-af15-7b68ab33061f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[66678182-2723-4b9c-913d-0308f88179d8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)
Jul 31 14:47:19 user nova-compute[72239]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:47:19 user nova-compute[72239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 (non-flash)
Jul 31 14:47:19 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:47:19 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:47:19 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:47:19 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:47:19 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)
Jul 31 14:47:19 user nova-compute[72239]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:47:19 user nova-compute[72239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 (non-flash)
Jul 31 14:47:19 user nova-compute[72239]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 (non-flash)
Jul 31 14:47:19 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:47:19 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:47:19 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:47:19 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4120156cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406'): ({'sdd'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Removing single pathed devices sdd {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a99a27-d442-4b74-91d2-05712dfa7833]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa6f85c-3bee-4ffe-b235-6fe73a2b4026]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Flushing IO for device /dev/sdd {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[587312b6-b6fd-4120-9b32-805ecb43d92a]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[67eaa71d-220a-46e6-a486-48184d9d0cf7]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] SCSI volumes sdd have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e57637-033e-4c50-9440-864858f07e94]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfad1b12-100d-463b-b17d-838f221e91bb]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406, portal: 172.16.0.220,3260]
Jul 31 14:47:19 user nova-compute[72239]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406, portal: 172.16.0.220,3260] successful.
Jul 31 14:47:19 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d75c85fd-3eb9-43a3-b677-2d8b157b8406 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[025a0c28-40ce-44f1-9de1-e52906f1e127]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] <== disconnect_volume: return (334ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 14:47:19 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Deleting instance files /opt/stack/data/nova/instances/9203aeaf-2ae9-4e28-9741-05d33df6c915_del
Jul 31 14:47:19 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Deletion of /opt/stack/data/nova/instances/9203aeaf-2ae9-4e28-9741-05d33df6c915_del complete
Jul 31 14:47:19 user nova-compute[72239]: INFO nova.compute.manager [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Took 3.39 seconds to destroy the instance on the hypervisor.
Jul 31 14:47:19 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 14:47:19 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 14:47:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Acquiring lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Acquiring lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:20 user nova-compute[72239]: INFO nova.compute.manager [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Terminating instance
Jul 31 14:47:20 user nova-compute[72239]: DEBUG nova.compute.manager [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 14:47:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:20 user nova-compute[72239]: DEBUG nova.compute.manager [req-00b227bd-489b-4415-9f5a-8f24b2e94d49 req-2b78e4ff-0bfe-4735-a058-35a34225cc48 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-vif-unplugged-01e36afb-4b92-42af-a2da-900e447e474e {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-00b227bd-489b-4415-9f5a-8f24b2e94d49 req-2b78e4ff-0bfe-4735-a058-35a34225cc48 service nova] Acquiring lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-00b227bd-489b-4415-9f5a-8f24b2e94d49 req-2b78e4ff-0bfe-4735-a058-35a34225cc48 service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-00b227bd-489b-4415-9f5a-8f24b2e94d49 req-2b78e4ff-0bfe-4735-a058-35a34225cc48 service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:20 user nova-compute[72239]: DEBUG nova.compute.manager [req-00b227bd-489b-4415-9f5a-8f24b2e94d49 req-2b78e4ff-0bfe-4735-a058-35a34225cc48 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] No waiting events found dispatching network-vif-unplugged-01e36afb-4b92-42af-a2da-900e447e474e {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:47:20 user nova-compute[72239]: DEBUG nova.compute.manager [req-00b227bd-489b-4415-9f5a-8f24b2e94d49 req-2b78e4ff-0bfe-4735-a058-35a34225cc48 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-vif-unplugged-01e36afb-4b92-42af-a2da-900e447e474e for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 14:47:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:21 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:21 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:21 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:21 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:21 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:21 user nova-compute[72239]: DEBUG nova.compute.manager [req-ba29746d-c7fb-4eff-b231-b5846daa078b req-20145f9c-09bb-42c5-83b0-2c5f0b51fe9a service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-vif-unplugged-eb8f7d6e-9f92-4684-8867-7f8aed33a68c {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ba29746d-c7fb-4eff-b231-b5846daa078b req-20145f9c-09bb-42c5-83b0-2c5f0b51fe9a service nova] Acquiring lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ba29746d-c7fb-4eff-b231-b5846daa078b req-20145f9c-09bb-42c5-83b0-2c5f0b51fe9a service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ba29746d-c7fb-4eff-b231-b5846daa078b req-20145f9c-09bb-42c5-83b0-2c5f0b51fe9a service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:21 user nova-compute[72239]: DEBUG nova.compute.manager [req-ba29746d-c7fb-4eff-b231-b5846daa078b req-20145f9c-09bb-42c5-83b0-2c5f0b51fe9a service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] No waiting events found dispatching network-vif-unplugged-eb8f7d6e-9f92-4684-8867-7f8aed33a68c {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:47:21 user nova-compute[72239]: DEBUG nova.compute.manager [req-ba29746d-c7fb-4eff-b231-b5846daa078b req-20145f9c-09bb-42c5-83b0-2c5f0b51fe9a service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-vif-unplugged-eb8f7d6e-9f92-4684-8867-7f8aed33a68c for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 14:47:21 user nova-compute[72239]: DEBUG nova.compute.manager [req-ba29746d-c7fb-4eff-b231-b5846daa078b req-20145f9c-09bb-42c5-83b0-2c5f0b51fe9a service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-vif-plugged-eb8f7d6e-9f92-4684-8867-7f8aed33a68c {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ba29746d-c7fb-4eff-b231-b5846daa078b req-20145f9c-09bb-42c5-83b0-2c5f0b51fe9a service nova] Acquiring lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ba29746d-c7fb-4eff-b231-b5846daa078b req-20145f9c-09bb-42c5-83b0-2c5f0b51fe9a service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ba29746d-c7fb-4eff-b231-b5846daa078b req-20145f9c-09bb-42c5-83b0-2c5f0b51fe9a service nova] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:21 user nova-compute[72239]: DEBUG nova.compute.manager [req-ba29746d-c7fb-4eff-b231-b5846daa078b req-20145f9c-09bb-42c5-83b0-2c5f0b51fe9a service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] No waiting events found dispatching network-vif-plugged-eb8f7d6e-9f92-4684-8867-7f8aed33a68c {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:47:21 user nova-compute[72239]: WARNING nova.compute.manager [req-ba29746d-c7fb-4eff-b231-b5846daa078b req-20145f9c-09bb-42c5-83b0-2c5f0b51fe9a service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received unexpected event network-vif-plugged-eb8f7d6e-9f92-4684-8867-7f8aed33a68c for instance with vm_state active and task_state deleting.
Jul 31 14:47:21 user nova-compute[72239]: DEBUG nova.compute.manager [req-ba29746d-c7fb-4eff-b231-b5846daa078b req-20145f9c-09bb-42c5-83b0-2c5f0b51fe9a service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-vif-unplugged-57f80e07-cfe0-47a5-9b99-10166cdcf351 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ba29746d-c7fb-4eff-b231-b5846daa078b req-20145f9c-09bb-42c5-83b0-2c5f0b51fe9a service nova] Acquiring lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ba29746d-c7fb-4eff-b231-b5846daa078b req-20145f9c-09bb-42c5-83b0-2c5f0b51fe9a service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ba29746d-c7fb-4eff-b231-b5846daa078b req-20145f9c-09bb-42c5-83b0-2c5f0b51fe9a service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:21 user nova-compute[72239]: DEBUG nova.compute.manager [req-ba29746d-c7fb-4eff-b231-b5846daa078b req-20145f9c-09bb-42c5-83b0-2c5f0b51fe9a service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] No waiting events found dispatching network-vif-unplugged-57f80e07-cfe0-47a5-9b99-10166cdcf351 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:47:21 user nova-compute[72239]: DEBUG nova.compute.manager [req-ba29746d-c7fb-4eff-b231-b5846daa078b req-20145f9c-09bb-42c5-83b0-2c5f0b51fe9a service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-vif-unplugged-57f80e07-cfe0-47a5-9b99-10166cdcf351 for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 14:47:21 user nova-compute[72239]: DEBUG nova.compute.manager [req-59df0d51-33e6-409b-b9e6-3abab69bc3af req-642b5d34-a7a7-47e2-8440-4be25b10cfec service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-vif-unplugged-da58ae48-fdc4-4816-a641-525030c3beb2 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-59df0d51-33e6-409b-b9e6-3abab69bc3af req-642b5d34-a7a7-47e2-8440-4be25b10cfec service nova] Acquiring lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-59df0d51-33e6-409b-b9e6-3abab69bc3af req-642b5d34-a7a7-47e2-8440-4be25b10cfec service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-59df0d51-33e6-409b-b9e6-3abab69bc3af req-642b5d34-a7a7-47e2-8440-4be25b10cfec service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:21 user nova-compute[72239]: DEBUG nova.compute.manager [req-59df0d51-33e6-409b-b9e6-3abab69bc3af req-642b5d34-a7a7-47e2-8440-4be25b10cfec service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] No waiting events found dispatching network-vif-unplugged-da58ae48-fdc4-4816-a641-525030c3beb2 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:47:21 user nova-compute[72239]: DEBUG nova.compute.manager [req-59df0d51-33e6-409b-b9e6-3abab69bc3af req-642b5d34-a7a7-47e2-8440-4be25b10cfec service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-vif-unplugged-da58ae48-fdc4-4816-a641-525030c3beb2 for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 14:47:21 user nova-compute[72239]: DEBUG nova.compute.manager [req-59df0d51-33e6-409b-b9e6-3abab69bc3af req-642b5d34-a7a7-47e2-8440-4be25b10cfec service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-vif-plugged-da58ae48-fdc4-4816-a641-525030c3beb2 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-59df0d51-33e6-409b-b9e6-3abab69bc3af req-642b5d34-a7a7-47e2-8440-4be25b10cfec service nova] Acquiring lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-59df0d51-33e6-409b-b9e6-3abab69bc3af req-642b5d34-a7a7-47e2-8440-4be25b10cfec service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-59df0d51-33e6-409b-b9e6-3abab69bc3af req-642b5d34-a7a7-47e2-8440-4be25b10cfec service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:21 user nova-compute[72239]: DEBUG nova.compute.manager [req-59df0d51-33e6-409b-b9e6-3abab69bc3af req-642b5d34-a7a7-47e2-8440-4be25b10cfec service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] No waiting events found dispatching network-vif-plugged-da58ae48-fdc4-4816-a641-525030c3beb2 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:47:21 user nova-compute[72239]: WARNING nova.compute.manager [req-59df0d51-33e6-409b-b9e6-3abab69bc3af req-642b5d34-a7a7-47e2-8440-4be25b10cfec service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received unexpected event network-vif-plugged-da58ae48-fdc4-4816-a641-525030c3beb2 for instance with vm_state active and task_state deleting.
Jul 31 14:47:21 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:21 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:22 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Instance destroyed successfully.
Jul 31 14:47:22 user nova-compute[72239]: DEBUG nova.objects.instance [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Lazy-loading 'resources' on Instance uuid 6258dba2-2e73-45d7-99f0-9a4af065ffcc {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605782098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605782098',id=13,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpKbTGDD8BwGgSdEXNFU/kgZ4CS7lBrgW9p330ZYVzRoXQCuSG9mbPl9ey2qy8JUlwoQ9iLL4YkyPBXWoTWqF5sScqhisosAmfWBywL1scHiKs+813BAmNo37qXdI9tpQ==',key_name='tempest-keypair-1210180061',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:46:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f63f7e945de84876beec594d5cbb6682',ramdisk_id='',reservation_id='r-jm590dnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-686662005',owner_user_name='tempest-TaggedBootDevicesTest_v242-686662005-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:46:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0281b9c87b9459bb375351257cac77b',uuid=6258dba2-2e73-45d7-99f0-9a4af065ffcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da58ae48-fdc4-4816-a641-525030c3beb2", "address": "fa:16:3e:9e:5d:97", "network": {"id": "245d91f7-48d7-400e-80a3-b6d5b3aae4c8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-368247279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda58ae48-fd", "ovs_interfaceid": "da58ae48-fdc4-4816-a641-525030c3beb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converting VIF {"id": "da58ae48-fdc4-4816-a641-525030c3beb2", "address": "fa:16:3e:9e:5d:97", "network": {"id": "245d91f7-48d7-400e-80a3-b6d5b3aae4c8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-368247279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda58ae48-fd", "ovs_interfaceid": "da58ae48-fdc4-4816-a641-525030c3beb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:5d:97,bridge_name='br-int',has_traffic_filtering=True,id=da58ae48-fdc4-4816-a641-525030c3beb2,network=Network(245d91f7-48d7-400e-80a3-b6d5b3aae4c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda58ae48-fd') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG os_vif [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:5d:97,bridge_name='br-int',has_traffic_filtering=True,id=da58ae48-fdc4-4816-a641-525030c3beb2,network=Network(245d91f7-48d7-400e-80a3-b6d5b3aae4c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda58ae48-fd') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda58ae48-fd, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:22 user nova-compute[72239]: INFO os_vif [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:5d:97,bridge_name='br-int',has_traffic_filtering=True,id=da58ae48-fdc4-4816-a641-525030c3beb2,network=Network(245d91f7-48d7-400e-80a3-b6d5b3aae4c8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda58ae48-fd')
Jul 31 14:47:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605782098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605782098',id=13,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpKbTGDD8BwGgSdEXNFU/kgZ4CS7lBrgW9p330ZYVzRoXQCuSG9mbPl9ey2qy8JUlwoQ9iLL4YkyPBXWoTWqF5sScqhisosAmfWBywL1scHiKs+813BAmNo37qXdI9tpQ==',key_name='tempest-keypair-1210180061',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:46:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f63f7e945de84876beec594d5cbb6682',ramdisk_id='',reservation_id='r-jm590dnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-686662005',owner_user_name='tempest-TaggedBootDevicesTest_v242-686662005-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:46:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0281b9c87b9459bb375351257cac77b',uuid=6258dba2-2e73-45d7-99f0-9a4af065ffcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd", "address": "fa:16:3e:22:52:9b", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap403cc6d2-3c", "ovs_interfaceid": "403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converting VIF {"id": "403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd", "address": "fa:16:3e:22:52:9b", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap403cc6d2-3c", "ovs_interfaceid": "403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:52:9b,bridge_name='br-int',has_traffic_filtering=True,id=403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd,network=Network(422a5380-ec3d-4faf-b208-5146c95093fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap403cc6d2-3c') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG os_vif [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:52:9b,bridge_name='br-int',has_traffic_filtering=True,id=403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd,network=Network(422a5380-ec3d-4faf-b208-5146c95093fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap403cc6d2-3c') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap403cc6d2-3c, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:22 user nova-compute[72239]: INFO os_vif [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:52:9b,bridge_name='br-int',has_traffic_filtering=True,id=403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd,network=Network(422a5380-ec3d-4faf-b208-5146c95093fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap403cc6d2-3c')
Jul 31 14:47:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605782098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605782098',id=13,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpKbTGDD8BwGgSdEXNFU/kgZ4CS7lBrgW9p330ZYVzRoXQCuSG9mbPl9ey2qy8JUlwoQ9iLL4YkyPBXWoTWqF5sScqhisosAmfWBywL1scHiKs+813BAmNo37qXdI9tpQ==',key_name='tempest-keypair-1210180061',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:46:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f63f7e945de84876beec594d5cbb6682',ramdisk_id='',reservation_id='r-jm590dnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-686662005',owner_user_name='tempest-TaggedBootDevicesTest_v242-686662005-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:46:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0281b9c87b9459bb375351257cac77b',uuid=6258dba2-2e73-45d7-99f0-9a4af065ffcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57f80e07-cfe0-47a5-9b99-10166cdcf351", "address": "fa:16:3e:81:bd:5b", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f80e07-cf", "ovs_interfaceid": "57f80e07-cfe0-47a5-9b99-10166cdcf351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converting VIF {"id": "57f80e07-cfe0-47a5-9b99-10166cdcf351", "address": "fa:16:3e:81:bd:5b", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f80e07-cf", "ovs_interfaceid": "57f80e07-cfe0-47a5-9b99-10166cdcf351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:bd:5b,bridge_name='br-int',has_traffic_filtering=True,id=57f80e07-cfe0-47a5-9b99-10166cdcf351,network=Network(422a5380-ec3d-4faf-b208-5146c95093fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap57f80e07-cf') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG os_vif [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:bd:5b,bridge_name='br-int',has_traffic_filtering=True,id=57f80e07-cfe0-47a5-9b99-10166cdcf351,network=Network(422a5380-ec3d-4faf-b208-5146c95093fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap57f80e07-cf') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57f80e07-cf, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:22 user nova-compute[72239]: INFO os_vif [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:bd:5b,bridge_name='br-int',has_traffic_filtering=True,id=57f80e07-cfe0-47a5-9b99-10166cdcf351,network=Network(422a5380-ec3d-4faf-b208-5146c95093fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap57f80e07-cf')
Jul 31 14:47:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605782098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605782098',id=13,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpKbTGDD8BwGgSdEXNFU/kgZ4CS7lBrgW9p330ZYVzRoXQCuSG9mbPl9ey2qy8JUlwoQ9iLL4YkyPBXWoTWqF5sScqhisosAmfWBywL1scHiKs+813BAmNo37qXdI9tpQ==',key_name='tempest-keypair-1210180061',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:46:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f63f7e945de84876beec594d5cbb6682',ramdisk_id='',reservation_id='r-jm590dnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-686662005',owner_user_name='tempest-TaggedBootDevicesTest_v242-686662005-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:46:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0281b9c87b9459bb375351257cac77b',uuid=6258dba2-2e73-45d7-99f0-9a4af065ffcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "01e36afb-4b92-42af-a2da-900e447e474e", "address": "fa:16:3e:10:e1:8d", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e36afb-4b", "ovs_interfaceid": "01e36afb-4b92-42af-a2da-900e447e474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converting VIF {"id": "01e36afb-4b92-42af-a2da-900e447e474e", "address": "fa:16:3e:10:e1:8d", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e36afb-4b", "ovs_interfaceid": "01e36afb-4b92-42af-a2da-900e447e474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:10:e1:8d,bridge_name='br-int',has_traffic_filtering=True,id=01e36afb-4b92-42af-a2da-900e447e474e,network=Network(422a5380-ec3d-4faf-b208-5146c95093fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01e36afb-4b') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG os_vif [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:e1:8d,bridge_name='br-int',has_traffic_filtering=True,id=01e36afb-4b92-42af-a2da-900e447e474e,network=Network(422a5380-ec3d-4faf-b208-5146c95093fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01e36afb-4b') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap01e36afb-4b, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:22 user nova-compute[72239]: INFO os_vif [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:10:e1:8d,bridge_name='br-int',has_traffic_filtering=True,id=01e36afb-4b92-42af-a2da-900e447e474e,network=Network(422a5380-ec3d-4faf-b208-5146c95093fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap01e36afb-4b')
Jul 31 14:47:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605782098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605782098',id=13,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpKbTGDD8BwGgSdEXNFU/kgZ4CS7lBrgW9p330ZYVzRoXQCuSG9mbPl9ey2qy8JUlwoQ9iLL4YkyPBXWoTWqF5sScqhisosAmfWBywL1scHiKs+813BAmNo37qXdI9tpQ==',key_name='tempest-keypair-1210180061',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:46:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f63f7e945de84876beec594d5cbb6682',ramdisk_id='',reservation_id='r-jm590dnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-686662005',owner_user_name='tempest-TaggedBootDevicesTest_v242-686662005-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:46:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0281b9c87b9459bb375351257cac77b',uuid=6258dba2-2e73-45d7-99f0-9a4af065ffcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87d5bb80-ad2c-4137-89f2-03bc494de37d", "address": "fa:16:3e:9e:00:eb", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87d5bb80-ad", "ovs_interfaceid": "87d5bb80-ad2c-4137-89f2-03bc494de37d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converting VIF {"id": "87d5bb80-ad2c-4137-89f2-03bc494de37d", "address": "fa:16:3e:9e:00:eb", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87d5bb80-ad", "ovs_interfaceid": "87d5bb80-ad2c-4137-89f2-03bc494de37d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:00:eb,bridge_name='br-int',has_traffic_filtering=True,id=87d5bb80-ad2c-4137-89f2-03bc494de37d,network=Network(422a5380-ec3d-4faf-b208-5146c95093fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87d5bb80-ad') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG os_vif [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:00:eb,bridge_name='br-int',has_traffic_filtering=True,id=87d5bb80-ad2c-4137-89f2-03bc494de37d,network=Network(422a5380-ec3d-4faf-b208-5146c95093fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87d5bb80-ad') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87d5bb80-ad, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:22 user nova-compute[72239]: INFO os_vif [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:00:eb,bridge_name='br-int',has_traffic_filtering=True,id=87d5bb80-ad2c-4137-89f2-03bc494de37d,network=Network(422a5380-ec3d-4faf-b208-5146c95093fb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap87d5bb80-ad')
Jul 31 14:47:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605782098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605782098',id=13,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpKbTGDD8BwGgSdEXNFU/kgZ4CS7lBrgW9p330ZYVzRoXQCuSG9mbPl9ey2qy8JUlwoQ9iLL4YkyPBXWoTWqF5sScqhisosAmfWBywL1scHiKs+813BAmNo37qXdI9tpQ==',key_name='tempest-keypair-1210180061',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:46:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f63f7e945de84876beec594d5cbb6682',ramdisk_id='',reservation_id='r-jm590dnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-686662005',owner_user_name='tempest-TaggedBootDevicesTest_v242-686662005-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:46:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0281b9c87b9459bb375351257cac77b',uuid=6258dba2-2e73-45d7-99f0-9a4af065ffcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c330e2c1-2507-406a-b255-6e72d82c689e", "address": "fa:16:3e:1d:8b:68", "network": {"id": "6ffbd985-4f07-4813-901c-fa0af7d3588b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1064713526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc330e2c1-25", "ovs_interfaceid": "c330e2c1-2507-406a-b255-6e72d82c689e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converting VIF {"id": "c330e2c1-2507-406a-b255-6e72d82c689e", "address": "fa:16:3e:1d:8b:68", "network": {"id": "6ffbd985-4f07-4813-901c-fa0af7d3588b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1064713526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc330e2c1-25", "ovs_interfaceid": "c330e2c1-2507-406a-b255-6e72d82c689e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1d:8b:68,bridge_name='br-int',has_traffic_filtering=True,id=c330e2c1-2507-406a-b255-6e72d82c689e,network=Network(6ffbd985-4f07-4813-901c-fa0af7d3588b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc330e2c1-25') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG os_vif [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:8b:68,bridge_name='br-int',has_traffic_filtering=True,id=c330e2c1-2507-406a-b255-6e72d82c689e,network=Network(6ffbd985-4f07-4813-901c-fa0af7d3588b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc330e2c1-25') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc330e2c1-25, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:22 user nova-compute[72239]: INFO os_vif [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1d:8b:68,bridge_name='br-int',has_traffic_filtering=True,id=c330e2c1-2507-406a-b255-6e72d82c689e,network=Network(6ffbd985-4f07-4813-901c-fa0af7d3588b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc330e2c1-25')
Jul 31 14:47:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:45:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-605782098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-605782098',id=13,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpKbTGDD8BwGgSdEXNFU/kgZ4CS7lBrgW9p330ZYVzRoXQCuSG9mbPl9ey2qy8JUlwoQ9iLL4YkyPBXWoTWqF5sScqhisosAmfWBywL1scHiKs+813BAmNo37qXdI9tpQ==',key_name='tempest-keypair-1210180061',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:46:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f63f7e945de84876beec594d5cbb6682',ramdisk_id='',reservation_id='r-jm590dnm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-686662005',owner_user_name='tempest-TaggedBootDevicesTest_v242-686662005-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:46:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b0281b9c87b9459bb375351257cac77b',uuid=6258dba2-2e73-45d7-99f0-9a4af065ffcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6fba6d4e-0137-4514-9525-29e86356c1eb", "address": "fa:16:3e:87:eb:18", "network": {"id": "6ffbd985-4f07-4813-901c-fa0af7d3588b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1064713526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fba6d4e-01", "ovs_interfaceid": "6fba6d4e-0137-4514-9525-29e86356c1eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converting VIF {"id": "6fba6d4e-0137-4514-9525-29e86356c1eb", "address": "fa:16:3e:87:eb:18", "network": {"id": "6ffbd985-4f07-4813-901c-fa0af7d3588b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1064713526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fba6d4e-01", "ovs_interfaceid": "6fba6d4e-0137-4514-9525-29e86356c1eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:eb:18,bridge_name='br-int',has_traffic_filtering=True,id=6fba6d4e-0137-4514-9525-29e86356c1eb,network=Network(6ffbd985-4f07-4813-901c-fa0af7d3588b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fba6d4e-01') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG os_vif [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:eb:18,bridge_name='br-int',has_traffic_filtering=True,id=6fba6d4e-0137-4514-9525-29e86356c1eb,network=Network(6ffbd985-4f07-4813-901c-fa0af7d3588b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fba6d4e-01') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6fba6d4e-01, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:22 user nova-compute[72239]: INFO os_vif [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:eb:18,bridge_name='br-int',has_traffic_filtering=True,id=6fba6d4e-0137-4514-9525-29e86356c1eb,network=Network(6ffbd985-4f07-4813-901c-fa0af7d3588b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fba6d4e-01')
Jul 31 14:47:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'McwxSsyt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:47:22 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:47:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6e41c5-2951-42fc-8573-23b4f1a1737f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c9ba6e-0ee7-4d7a-869d-e73ee95d4f98]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)
Jul 31 14:47:22 user nova-compute[72239]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:47:22 user nova-compute[72239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 (non-flash)
Jul 31 14:47:22 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:47:22 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:47:22 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:47:22 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)
Jul 31 14:47:22 user nova-compute[72239]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:47:22 user nova-compute[72239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 (non-flash)
Jul 31 14:47:22 user nova-compute[72239]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 (non-flash)
Jul 31 14:47:22 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:47:22 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:47:22 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4120405900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7'): ({'sde'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Removing single pathed devices sde {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c68f00-1e43-4edf-8170-10a87e480de4]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7798137-8ede-492d-b06c-bdfbb036969b]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Flushing IO for device /dev/sde {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5a06de-243f-489d-89fa-cbc6483517eb]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d95f95b-7ff2-4b12-97c9-060922db0d9e]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] SCSI volumes sde have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8abceaa-f56b-4dd7-8fcc-db13583960d6]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4b1634-5c52-4588-b06d-c3116ef574c0]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7, portal: 172.16.0.220,3260]
Jul 31 14:47:22 user nova-compute[72239]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7, portal: 172.16.0.220,3260] successful.
Jul 31 14:47:22 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9373b07a-291c-4687-9779-41418a02fad7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[402b5576-2162-4b58-9485-5f028223c66b]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] <== disconnect_volume: return (310ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TVREJrtD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:47:22 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:47:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8517eb34-dc0d-4d52-88a7-815d4999219a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[845e54ba-46f1-49b1-a1c0-990cc9123eb8]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)
Jul 31 14:47:22 user nova-compute[72239]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:47:22 user nova-compute[72239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 (non-flash)
Jul 31 14:47:22 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:47:22 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:47:22 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)
Jul 31 14:47:22 user nova-compute[72239]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:47:22 user nova-compute[72239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 (non-flash)
Jul 31 14:47:22 user nova-compute[72239]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a (non-flash)
Jul 31 14:47:22 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:47:22 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4126ab7880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a'): ({'sdf'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Removing single pathed devices sdf {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11fdd37-6daa-4661-9d0a-691e63875a73]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0048ebe8-9649-4925-bcb7-b778b0e2d217]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Flushing IO for device /dev/sdf {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d386df8-d98e-482f-a20d-446c3ab820a7]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.052s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f969d3d7-2328-4d54-961d-71c4499bc321]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] SCSI volumes sdf have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bbe217-8570-4f5c-8630-aefd0488c024]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG nova.compute.manager [req-aa0161a6-353e-4d08-816c-bacbd291197f req-715bb556-d316-462a-a88e-4ff17e594715 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-vif-plugged-01e36afb-4b92-42af-a2da-900e447e474e {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-aa0161a6-353e-4d08-816c-bacbd291197f req-715bb556-d316-462a-a88e-4ff17e594715 service nova] Acquiring lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-aa0161a6-353e-4d08-816c-bacbd291197f req-715bb556-d316-462a-a88e-4ff17e594715 service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-aa0161a6-353e-4d08-816c-bacbd291197f req-715bb556-d316-462a-a88e-4ff17e594715 service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG nova.compute.manager [req-aa0161a6-353e-4d08-816c-bacbd291197f req-715bb556-d316-462a-a88e-4ff17e594715 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] No waiting events found dispatching network-vif-plugged-01e36afb-4b92-42af-a2da-900e447e474e {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:47:22 user nova-compute[72239]: WARNING nova.compute.manager [req-aa0161a6-353e-4d08-816c-bacbd291197f req-715bb556-d316-462a-a88e-4ff17e594715 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received unexpected event network-vif-plugged-01e36afb-4b92-42af-a2da-900e447e474e for instance with vm_state active and task_state deleting.
Jul 31 14:47:22 user nova-compute[72239]: DEBUG nova.compute.manager [req-aa0161a6-353e-4d08-816c-bacbd291197f req-715bb556-d316-462a-a88e-4ff17e594715 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-vif-unplugged-87d5bb80-ad2c-4137-89f2-03bc494de37d {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-aa0161a6-353e-4d08-816c-bacbd291197f req-715bb556-d316-462a-a88e-4ff17e594715 service nova] Acquiring lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-aa0161a6-353e-4d08-816c-bacbd291197f req-715bb556-d316-462a-a88e-4ff17e594715 service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-aa0161a6-353e-4d08-816c-bacbd291197f req-715bb556-d316-462a-a88e-4ff17e594715 service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG nova.compute.manager [req-aa0161a6-353e-4d08-816c-bacbd291197f req-715bb556-d316-462a-a88e-4ff17e594715 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] No waiting events found dispatching network-vif-unplugged-87d5bb80-ad2c-4137-89f2-03bc494de37d {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG nova.compute.manager [req-aa0161a6-353e-4d08-816c-bacbd291197f req-715bb556-d316-462a-a88e-4ff17e594715 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-vif-unplugged-87d5bb80-ad2c-4137-89f2-03bc494de37d for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG nova.compute.manager [req-aa0161a6-353e-4d08-816c-bacbd291197f req-715bb556-d316-462a-a88e-4ff17e594715 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-vif-plugged-87d5bb80-ad2c-4137-89f2-03bc494de37d {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-aa0161a6-353e-4d08-816c-bacbd291197f req-715bb556-d316-462a-a88e-4ff17e594715 service nova] Acquiring lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-aa0161a6-353e-4d08-816c-bacbd291197f req-715bb556-d316-462a-a88e-4ff17e594715 service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-aa0161a6-353e-4d08-816c-bacbd291197f req-715bb556-d316-462a-a88e-4ff17e594715 service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG nova.compute.manager [req-aa0161a6-353e-4d08-816c-bacbd291197f req-715bb556-d316-462a-a88e-4ff17e594715 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] No waiting events found dispatching network-vif-plugged-87d5bb80-ad2c-4137-89f2-03bc494de37d {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:47:22 user nova-compute[72239]: WARNING nova.compute.manager [req-aa0161a6-353e-4d08-816c-bacbd291197f req-715bb556-d316-462a-a88e-4ff17e594715 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received unexpected event network-vif-plugged-87d5bb80-ad2c-4137-89f2-03bc494de37d for instance with vm_state active and task_state deleting.
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a403b2e-ced7-4ad9-985e-8332655455a1]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a, portal: 172.16.0.220,3260]
Jul 31 14:47:22 user nova-compute[72239]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a, portal: 172.16.0.220,3260] successful.
Jul 31 14:47:22 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c6970ccf-414d-409e-8c4d-cf3a5efa487a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d627a3a-0cb7-4a53-a31a-af663188068e]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] <== disconnect_volume: return (308ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LlexnRAa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:47:23 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:47:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f041036-675b-4b03-937f-d10d66066572]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4449c7fd-2847-454a-9a92-33dba46e0b48]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)
Jul 31 14:47:23 user nova-compute[72239]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:47:23 user nova-compute[72239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 (non-flash)
Jul 31 14:47:23 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:47:23 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)
Jul 31 14:47:23 user nova-compute[72239]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:47:23 user nova-compute[72239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 (non-flash)
Jul 31 14:47:23 user nova-compute[72239]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 (non-flash)
Jul 31 14:47:23 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4126ab7880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4'): ({'sdg'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Removing single pathed devices sdg {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ffcf25-ee55-4bce-801b-d2cd62af2259]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98b69ef-daa9-4607-b50e-7708d212a036]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Flushing IO for device /dev/sdg {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[41107f9f-6950-4f9f-a45c-96a82d44b745]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.035s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c76543f0-3790-4be9-bcaf-98b811f9ba83]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] SCSI volumes sdg have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde9a471-4cbb-4ef3-b3e7-112d45e303db]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3710d82d-aa44-4330-a598-7b912ca9633d]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4, portal: 172.16.0.220,3260]
Jul 31 14:47:23 user nova-compute[72239]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4, portal: 172.16.0.220,3260] successful.
Jul 31 14:47:23 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aac36111-3590-450f-a7c0-5d37ab6004f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[12de4e46-6056-4dea-9663-5efd87179595]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] <== disconnect_volume: return (284ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 14:47:23 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Deleting instance files /opt/stack/data/nova/instances/6258dba2-2e73-45d7-99f0-9a4af065ffcc_del
Jul 31 14:47:23 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Deletion of /opt/stack/data/nova/instances/6258dba2-2e73-45d7-99f0-9a4af065ffcc_del complete
Jul 31 14:47:23 user nova-compute[72239]: DEBUG nova.compute.manager [req-931d424b-1e6b-485a-9988-a02d5a7a9c3a req-c0d2f7a6-12f6-47b4-b145-cc6d57d3630f service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-vif-plugged-57f80e07-cfe0-47a5-9b99-10166cdcf351 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-931d424b-1e6b-485a-9988-a02d5a7a9c3a req-c0d2f7a6-12f6-47b4-b145-cc6d57d3630f service nova] Acquiring lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-931d424b-1e6b-485a-9988-a02d5a7a9c3a req-c0d2f7a6-12f6-47b4-b145-cc6d57d3630f service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-931d424b-1e6b-485a-9988-a02d5a7a9c3a req-c0d2f7a6-12f6-47b4-b145-cc6d57d3630f service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG nova.compute.manager [req-931d424b-1e6b-485a-9988-a02d5a7a9c3a req-c0d2f7a6-12f6-47b4-b145-cc6d57d3630f service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] No waiting events found dispatching network-vif-plugged-57f80e07-cfe0-47a5-9b99-10166cdcf351 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:47:23 user nova-compute[72239]: WARNING nova.compute.manager [req-931d424b-1e6b-485a-9988-a02d5a7a9c3a req-c0d2f7a6-12f6-47b4-b145-cc6d57d3630f service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received unexpected event network-vif-plugged-57f80e07-cfe0-47a5-9b99-10166cdcf351 for instance with vm_state active and task_state deleting.
Jul 31 14:47:23 user nova-compute[72239]: DEBUG nova.compute.manager [req-931d424b-1e6b-485a-9988-a02d5a7a9c3a req-c0d2f7a6-12f6-47b4-b145-cc6d57d3630f service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-vif-unplugged-c330e2c1-2507-406a-b255-6e72d82c689e {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-931d424b-1e6b-485a-9988-a02d5a7a9c3a req-c0d2f7a6-12f6-47b4-b145-cc6d57d3630f service nova] Acquiring lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-931d424b-1e6b-485a-9988-a02d5a7a9c3a req-c0d2f7a6-12f6-47b4-b145-cc6d57d3630f service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-931d424b-1e6b-485a-9988-a02d5a7a9c3a req-c0d2f7a6-12f6-47b4-b145-cc6d57d3630f service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG nova.compute.manager [req-931d424b-1e6b-485a-9988-a02d5a7a9c3a req-c0d2f7a6-12f6-47b4-b145-cc6d57d3630f service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] No waiting events found dispatching network-vif-unplugged-c330e2c1-2507-406a-b255-6e72d82c689e {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG nova.compute.manager [req-931d424b-1e6b-485a-9988-a02d5a7a9c3a req-c0d2f7a6-12f6-47b4-b145-cc6d57d3630f service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-vif-unplugged-c330e2c1-2507-406a-b255-6e72d82c689e for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG nova.compute.manager [req-931d424b-1e6b-485a-9988-a02d5a7a9c3a req-c0d2f7a6-12f6-47b4-b145-cc6d57d3630f service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-vif-plugged-c330e2c1-2507-406a-b255-6e72d82c689e {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-931d424b-1e6b-485a-9988-a02d5a7a9c3a req-c0d2f7a6-12f6-47b4-b145-cc6d57d3630f service nova] Acquiring lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-931d424b-1e6b-485a-9988-a02d5a7a9c3a req-c0d2f7a6-12f6-47b4-b145-cc6d57d3630f service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-931d424b-1e6b-485a-9988-a02d5a7a9c3a req-c0d2f7a6-12f6-47b4-b145-cc6d57d3630f service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG nova.compute.manager [req-931d424b-1e6b-485a-9988-a02d5a7a9c3a req-c0d2f7a6-12f6-47b4-b145-cc6d57d3630f service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] No waiting events found dispatching network-vif-plugged-c330e2c1-2507-406a-b255-6e72d82c689e {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:47:23 user nova-compute[72239]: WARNING nova.compute.manager [req-931d424b-1e6b-485a-9988-a02d5a7a9c3a req-c0d2f7a6-12f6-47b4-b145-cc6d57d3630f service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received unexpected event network-vif-plugged-c330e2c1-2507-406a-b255-6e72d82c689e for instance with vm_state active and task_state deleting.
Jul 31 14:47:23 user nova-compute[72239]: DEBUG nova.compute.manager [req-931d424b-1e6b-485a-9988-a02d5a7a9c3a req-c0d2f7a6-12f6-47b4-b145-cc6d57d3630f service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-vif-unplugged-6fba6d4e-0137-4514-9525-29e86356c1eb {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-931d424b-1e6b-485a-9988-a02d5a7a9c3a req-c0d2f7a6-12f6-47b4-b145-cc6d57d3630f service nova] Acquiring lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-931d424b-1e6b-485a-9988-a02d5a7a9c3a req-c0d2f7a6-12f6-47b4-b145-cc6d57d3630f service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-931d424b-1e6b-485a-9988-a02d5a7a9c3a req-c0d2f7a6-12f6-47b4-b145-cc6d57d3630f service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG nova.compute.manager [req-931d424b-1e6b-485a-9988-a02d5a7a9c3a req-c0d2f7a6-12f6-47b4-b145-cc6d57d3630f service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] No waiting events found dispatching network-vif-unplugged-6fba6d4e-0137-4514-9525-29e86356c1eb {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG nova.compute.manager [req-931d424b-1e6b-485a-9988-a02d5a7a9c3a req-c0d2f7a6-12f6-47b4-b145-cc6d57d3630f service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-vif-unplugged-6fba6d4e-0137-4514-9525-29e86356c1eb for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG nova.compute.manager [req-931d424b-1e6b-485a-9988-a02d5a7a9c3a req-c0d2f7a6-12f6-47b4-b145-cc6d57d3630f service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-vif-plugged-6fba6d4e-0137-4514-9525-29e86356c1eb {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-931d424b-1e6b-485a-9988-a02d5a7a9c3a req-c0d2f7a6-12f6-47b4-b145-cc6d57d3630f service nova] Acquiring lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-931d424b-1e6b-485a-9988-a02d5a7a9c3a req-c0d2f7a6-12f6-47b4-b145-cc6d57d3630f service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-931d424b-1e6b-485a-9988-a02d5a7a9c3a req-c0d2f7a6-12f6-47b4-b145-cc6d57d3630f service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG nova.compute.manager [req-931d424b-1e6b-485a-9988-a02d5a7a9c3a req-c0d2f7a6-12f6-47b4-b145-cc6d57d3630f service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] No waiting events found dispatching network-vif-plugged-6fba6d4e-0137-4514-9525-29e86356c1eb {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:47:23 user nova-compute[72239]: WARNING nova.compute.manager [req-931d424b-1e6b-485a-9988-a02d5a7a9c3a req-c0d2f7a6-12f6-47b4-b145-cc6d57d3630f service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received unexpected event network-vif-plugged-6fba6d4e-0137-4514-9525-29e86356c1eb for instance with vm_state active and task_state deleting.
Jul 31 14:47:23 user nova-compute[72239]: DEBUG nova.compute.manager [req-931d424b-1e6b-485a-9988-a02d5a7a9c3a req-c0d2f7a6-12f6-47b4-b145-cc6d57d3630f service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-vif-deleted-0642e4d3-ade9-425b-9860-f306229034b3 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:23 user nova-compute[72239]: INFO nova.compute.manager [req-931d424b-1e6b-485a-9988-a02d5a7a9c3a req-c0d2f7a6-12f6-47b4-b145-cc6d57d3630f service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Neutron deleted interface 0642e4d3-ade9-425b-9860-f306229034b3; detaching it from the instance and deleting it from the info cache
Jul 31 14:47:23 user nova-compute[72239]: DEBUG nova.network.neutron [req-931d424b-1e6b-485a-9988-a02d5a7a9c3a req-c0d2f7a6-12f6-47b4-b145-cc6d57d3630f service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Updating instance_info_cache with network_info: [{"id": "c6a37c9e-0be0-4c76-bb14-fcdb3c39061c", "address": "fa:16:3e:3e:7d:12", "network": {"id": "a5162307-ddc4-4843-a8a1-dbd8f52a9ae7", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1082900222-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6a37c9e-0b", "ovs_interfaceid": "c6a37c9e-0be0-4c76-bb14-fcdb3c39061c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b0ff36fe-c825-4781-a755-951a52252422", "address": "fa:16:3e:8f:14:75", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.40", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb0ff36fe-c8", "ovs_interfaceid": "b0ff36fe-c825-4781-a755-951a52252422", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8a006aee-3f68-4eb2-b214-6cf76db08ffe", "address": "fa:16:3e:01:82:d6", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.57", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a006aee-3f", "ovs_interfaceid": "8a006aee-3f68-4eb2-b214-6cf76db08ffe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ba2d5a24-f668-4413-abb1-c51cf2038a1c", "address": "fa:16:3e:6c:f1:44", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.205", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba2d5a24-f6", "ovs_interfaceid": "ba2d5a24-f668-4413-abb1-c51cf2038a1c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c9d1f7e0-c42d-4870-9121-293f57196a09", "address": "fa:16:3e:31:22:60", "network": {"id": "fd06ec07-887e-47f8-9d06-277094ea6a05", "bridge": "br-int", "label": "tempest-device-tagging-net1-2069252322", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.126", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9d1f7e0-c4", "ovs_interfaceid": "c9d1f7e0-c42d-4870-9121-293f57196a09", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb8f7d6e-9f92-4684-8867-7f8aed33a68c", "address": "fa:16:3e:f4:31:a2", "network": {"id": "a3e00fe3-9848-453f-89ef-136074c0524f", "bridge": "br-int", "label": "tempest-device-tagging-net2-758627650", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "b0b2f9834cbe42a68ee0db1b04d842ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb8f7d6e-9f", "ovs_interfaceid": "eb8f7d6e-9f92-4684-8867-7f8aed33a68c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG nova.compute.manager [req-931d424b-1e6b-485a-9988-a02d5a7a9c3a req-c0d2f7a6-12f6-47b4-b145-cc6d57d3630f service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Detach interface failed, port_id=0642e4d3-ade9-425b-9860-f306229034b3, reason: Instance 9203aeaf-2ae9-4e28-9741-05d33df6c915 could not be found. {{(pid=72239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 14:47:23 user nova-compute[72239]: INFO nova.compute.manager [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Took 3.21 seconds to destroy the instance on the hypervisor.
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG nova.compute.manager [req-ee1d1630-56bc-44fa-985e-45eca05d9f2f req-85dbf9a1-bc8d-4799-9405-36ff0b09c037 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-vif-unplugged-403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ee1d1630-56bc-44fa-985e-45eca05d9f2f req-85dbf9a1-bc8d-4799-9405-36ff0b09c037 service nova] Acquiring lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ee1d1630-56bc-44fa-985e-45eca05d9f2f req-85dbf9a1-bc8d-4799-9405-36ff0b09c037 service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ee1d1630-56bc-44fa-985e-45eca05d9f2f req-85dbf9a1-bc8d-4799-9405-36ff0b09c037 service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG nova.compute.manager [req-ee1d1630-56bc-44fa-985e-45eca05d9f2f req-85dbf9a1-bc8d-4799-9405-36ff0b09c037 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] No waiting events found dispatching network-vif-unplugged-403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG nova.compute.manager [req-ee1d1630-56bc-44fa-985e-45eca05d9f2f req-85dbf9a1-bc8d-4799-9405-36ff0b09c037 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-vif-unplugged-403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG nova.compute.manager [req-ee1d1630-56bc-44fa-985e-45eca05d9f2f req-85dbf9a1-bc8d-4799-9405-36ff0b09c037 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-vif-plugged-403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ee1d1630-56bc-44fa-985e-45eca05d9f2f req-85dbf9a1-bc8d-4799-9405-36ff0b09c037 service nova] Acquiring lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ee1d1630-56bc-44fa-985e-45eca05d9f2f req-85dbf9a1-bc8d-4799-9405-36ff0b09c037 service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ee1d1630-56bc-44fa-985e-45eca05d9f2f req-85dbf9a1-bc8d-4799-9405-36ff0b09c037 service nova] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:23 user nova-compute[72239]: DEBUG nova.compute.manager [req-ee1d1630-56bc-44fa-985e-45eca05d9f2f req-85dbf9a1-bc8d-4799-9405-36ff0b09c037 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] No waiting events found dispatching network-vif-plugged-403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:47:23 user nova-compute[72239]: WARNING nova.compute.manager [req-ee1d1630-56bc-44fa-985e-45eca05d9f2f req-85dbf9a1-bc8d-4799-9405-36ff0b09c037 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received unexpected event network-vif-plugged-403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd for instance with vm_state active and task_state deleting.
Jul 31 14:47:23 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:25 user nova-compute[72239]: DEBUG nova.compute.manager [req-4be5ca90-be9d-497e-822e-ead7cc08af0f req-b2bd52a4-3842-4507-902e-debde82acc32 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-vif-deleted-87d5bb80-ad2c-4137-89f2-03bc494de37d {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:25 user nova-compute[72239]: INFO nova.compute.manager [req-4be5ca90-be9d-497e-822e-ead7cc08af0f req-b2bd52a4-3842-4507-902e-debde82acc32 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Neutron deleted interface 87d5bb80-ad2c-4137-89f2-03bc494de37d; detaching it from the instance and deleting it from the info cache
Jul 31 14:47:25 user nova-compute[72239]: DEBUG nova.network.neutron [req-4be5ca90-be9d-497e-822e-ead7cc08af0f req-b2bd52a4-3842-4507-902e-debde82acc32 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Updating instance_info_cache with network_info: [{"id": "da58ae48-fdc4-4816-a641-525030c3beb2", "address": "fa:16:3e:9e:5d:97", "network": {"id": "245d91f7-48d7-400e-80a3-b6d5b3aae4c8", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-368247279-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda58ae48-fd", "ovs_interfaceid": "da58ae48-fdc4-4816-a641-525030c3beb2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd", "address": "fa:16:3e:22:52:9b", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap403cc6d2-3c", "ovs_interfaceid": "403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "57f80e07-cfe0-47a5-9b99-10166cdcf351", "address": "fa:16:3e:81:bd:5b", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f80e07-cf", "ovs_interfaceid": "57f80e07-cfe0-47a5-9b99-10166cdcf351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01e36afb-4b92-42af-a2da-900e447e474e", "address": "fa:16:3e:10:e1:8d", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e36afb-4b", "ovs_interfaceid": "01e36afb-4b92-42af-a2da-900e447e474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c330e2c1-2507-406a-b255-6e72d82c689e", "address": "fa:16:3e:1d:8b:68", "network": {"id": "6ffbd985-4f07-4813-901c-fa0af7d3588b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1064713526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc330e2c1-25", "ovs_interfaceid": "c330e2c1-2507-406a-b255-6e72d82c689e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6fba6d4e-0137-4514-9525-29e86356c1eb", "address": "fa:16:3e:87:eb:18", "network": {"id": "6ffbd985-4f07-4813-901c-fa0af7d3588b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1064713526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fba6d4e-01", "ovs_interfaceid": "6fba6d4e-0137-4514-9525-29e86356c1eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:47:25 user nova-compute[72239]: DEBUG nova.compute.manager [req-4be5ca90-be9d-497e-822e-ead7cc08af0f req-b2bd52a4-3842-4507-902e-debde82acc32 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Detach interface failed, port_id=87d5bb80-ad2c-4137-89f2-03bc494de37d, reason: Instance 6258dba2-2e73-45d7-99f0-9a4af065ffcc could not be found. {{(pid=72239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 14:47:25 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:47:25 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Took 5.38 seconds to deallocate network for instance.
Jul 31 14:47:25 user nova-compute[72239]: DEBUG nova.compute.manager [req-83f9a862-3f82-48a3-ba7d-6a86ebf7db54 req-dd552062-3171-419c-b1db-3e6a85f2a62c service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-vif-deleted-c9d1f7e0-c42d-4870-9121-293f57196a09 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:25 user nova-compute[72239]: DEBUG nova.compute.manager [req-83f9a862-3f82-48a3-ba7d-6a86ebf7db54 req-dd552062-3171-419c-b1db-3e6a85f2a62c service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-vif-deleted-c6a37c9e-0be0-4c76-bb14-fcdb3c39061c {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:25 user nova-compute[72239]: DEBUG nova.compute.manager [req-83f9a862-3f82-48a3-ba7d-6a86ebf7db54 req-dd552062-3171-419c-b1db-3e6a85f2a62c service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-vif-deleted-ba2d5a24-f668-4413-abb1-c51cf2038a1c {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:25 user nova-compute[72239]: DEBUG nova.compute.manager [req-83f9a862-3f82-48a3-ba7d-6a86ebf7db54 req-dd552062-3171-419c-b1db-3e6a85f2a62c service nova] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Received event network-vif-deleted-eb8f7d6e-9f92-4684-8867-7f8aed33a68c {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG nova.compute.manager [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQpfnwvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f011c736-1a43-4b0e-ac7c-d512bcaa9bdc', 'attached_at': '', 'detached_at': '', 'volume_id': 'ab681c1d-23c4-4717-80b9-c98d504cca89', 'serial': 'ab681c1d-23c4-4717-80b9-c98d504cca89'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dvCfBXja', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': '2a2c81c9-b792-4eb4-a07f-62845f9465c8'}, 'status': 'reserved', 'instance': 'f011c736-1a43-4b0e-ac7c-d512bcaa9bdc', 'attached_at': '', 'detached_at': '', 'volume_id': '2a2c81c9-b792-4eb4-a07f-62845f9465c8', 'serial'} {{(pid=72239) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQpfnwvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:47:26 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:47:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:47:26 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:47:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:47:26 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 14:47:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce9c3c1-9b95-4a38-b845-281017384566]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 14:47:26 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88817d3-94ea-4105-b2d6-b58ed36a2eeb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89] added
Jul 31 14:47:26 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83da948-1414-4530-b066-4f80949e4d14]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[439972ad-04d7-4494-ac68-46448f3ebe47]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cQpfnwvd {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cQpfnwvd" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccec7b3b-3436-4fcc-bed2-95111176e843]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cQpfnwvd'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[049900ab-0ed7-4551-8e79-931b79b63ffd]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d680d171-438d-4c86-b93a-8dff0a7b4cde]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)
Jul 31 14:47:26 user nova-compute[72239]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:47:26 user nova-compute[72239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 (non-flash)
Jul 31 14:47:26 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)
Jul 31 14:47:26 user nova-compute[72239]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:47:26 user nova-compute[72239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 (non-flash)
Jul 31 14:47:26 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b17878-a8c8-4634-8f82-3d06b3bc4689]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89, portal: 172.16.0.220,3260]
Jul 31 14:47:26 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89, portal: 172.16.0.220,3260] successful.
Jul 31 14:47:26 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[992fa6b7-d16d-4b9e-8de6-55c05291237a]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[43653d5d-29da-43c6-8fd2-069b0ea82dd5]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)
Jul 31 14:47:26 user nova-compute[72239]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:47:26 user nova-compute[72239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 (non-flash)
Jul 31 14:47:26 user nova-compute[72239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 (non-flash)
Jul 31 14:47:26 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)
Jul 31 14:47:26 user nova-compute[72239]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:47:26 user nova-compute[72239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 (non-flash)
Jul 31 14:47:26 user nova-compute[72239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 (non-flash)
Jul 31 14:47:26 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Scanning host 33 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[02cdf27d-0e9e-45d6-9af4-88d7ee52e7df]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:26 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: None {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:47:27 user nova-compute[72239]: DEBUG nova.compute.manager [req-1d8db50f-6daf-4646-a2bb-e46e677dac52 req-50183dd3-92d4-4077-b978-25d293659ea5 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-vif-deleted-da58ae48-fdc4-4816-a641-525030c3beb2 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:27 user nova-compute[72239]: INFO nova.compute.manager [req-1d8db50f-6daf-4646-a2bb-e46e677dac52 req-50183dd3-92d4-4077-b978-25d293659ea5 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Neutron deleted interface da58ae48-fdc4-4816-a641-525030c3beb2; detaching it from the instance and deleting it from the info cache
Jul 31 14:47:27 user nova-compute[72239]: DEBUG nova.network.neutron [req-1d8db50f-6daf-4646-a2bb-e46e677dac52 req-50183dd3-92d4-4077-b978-25d293659ea5 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Updating instance_info_cache with network_info: [{"id": "403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd", "address": "fa:16:3e:22:52:9b", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap403cc6d2-3c", "ovs_interfaceid": "403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "57f80e07-cfe0-47a5-9b99-10166cdcf351", "address": "fa:16:3e:81:bd:5b", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f80e07-cf", "ovs_interfaceid": "57f80e07-cfe0-47a5-9b99-10166cdcf351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01e36afb-4b92-42af-a2da-900e447e474e", "address": "fa:16:3e:10:e1:8d", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e36afb-4b", "ovs_interfaceid": "01e36afb-4b92-42af-a2da-900e447e474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c330e2c1-2507-406a-b255-6e72d82c689e", "address": "fa:16:3e:1d:8b:68", "network": {"id": "6ffbd985-4f07-4813-901c-fa0af7d3588b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1064713526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc330e2c1-25", "ovs_interfaceid": "c330e2c1-2507-406a-b255-6e72d82c689e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6fba6d4e-0137-4514-9525-29e86356c1eb", "address": "fa:16:3e:87:eb:18", "network": {"id": "6ffbd985-4f07-4813-901c-fa0af7d3588b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1064713526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fba6d4e-01", "ovs_interfaceid": "6fba6d4e-0137-4514-9525-29e86356c1eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:47:27 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:47:27 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Took 3.84 seconds to deallocate network for instance.
Jul 31 14:47:27 user nova-compute[72239]: DEBUG nova.compute.manager [req-1d8db50f-6daf-4646-a2bb-e46e677dac52 req-50183dd3-92d4-4077-b978-25d293659ea5 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Detach interface failed, port_id=da58ae48-fdc4-4816-a641-525030c3beb2, reason: Instance 6258dba2-2e73-45d7-99f0-9a4af065ffcc could not be found. {{(pid=72239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 14:47:27 user nova-compute[72239]: DEBUG nova.compute.manager [req-1d8db50f-6daf-4646-a2bb-e46e677dac52 req-50183dd3-92d4-4077-b978-25d293659ea5 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-vif-deleted-c330e2c1-2507-406a-b255-6e72d82c689e {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:27 user nova-compute[72239]: INFO nova.compute.manager [req-1d8db50f-6daf-4646-a2bb-e46e677dac52 req-50183dd3-92d4-4077-b978-25d293659ea5 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Neutron deleted interface c330e2c1-2507-406a-b255-6e72d82c689e; detaching it from the instance and deleting it from the info cache
Jul 31 14:47:27 user nova-compute[72239]: DEBUG nova.network.neutron [req-1d8db50f-6daf-4646-a2bb-e46e677dac52 req-50183dd3-92d4-4077-b978-25d293659ea5 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Updating instance_info_cache with network_info: [{"id": "403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd", "address": "fa:16:3e:22:52:9b", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap403cc6d2-3c", "ovs_interfaceid": "403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "57f80e07-cfe0-47a5-9b99-10166cdcf351", "address": "fa:16:3e:81:bd:5b", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f80e07-cf", "ovs_interfaceid": "57f80e07-cfe0-47a5-9b99-10166cdcf351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01e36afb-4b92-42af-a2da-900e447e474e", "address": "fa:16:3e:10:e1:8d", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e36afb-4b", "ovs_interfaceid": "01e36afb-4b92-42af-a2da-900e447e474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6fba6d4e-0137-4514-9525-29e86356c1eb", "address": "fa:16:3e:87:eb:18", "network": {"id": "6ffbd985-4f07-4813-901c-fa0af7d3588b", "bridge": "br-int", "label": "tempest-device-tagging-net2-1064713526", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fba6d4e-01", "ovs_interfaceid": "6fba6d4e-0137-4514-9525-29e86356c1eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:47:27 user nova-compute[72239]: DEBUG nova.compute.manager [req-1d8db50f-6daf-4646-a2bb-e46e677dac52 req-50183dd3-92d4-4077-b978-25d293659ea5 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Detach interface failed, port_id=c330e2c1-2507-406a-b255-6e72d82c689e, reason: Instance 6258dba2-2e73-45d7-99f0-9a4af065ffcc could not be found. {{(pid=72239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 14:47:27 user nova-compute[72239]: DEBUG nova.compute.manager [req-1d8db50f-6daf-4646-a2bb-e46e677dac52 req-50183dd3-92d4-4077-b978-25d293659ea5 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-vif-deleted-6fba6d4e-0137-4514-9525-29e86356c1eb {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:27 user nova-compute[72239]: INFO nova.compute.manager [req-1d8db50f-6daf-4646-a2bb-e46e677dac52 req-50183dd3-92d4-4077-b978-25d293659ea5 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Neutron deleted interface 6fba6d4e-0137-4514-9525-29e86356c1eb; detaching it from the instance and deleting it from the info cache
Jul 31 14:47:27 user nova-compute[72239]: DEBUG nova.network.neutron [req-1d8db50f-6daf-4646-a2bb-e46e677dac52 req-50183dd3-92d4-4077-b978-25d293659ea5 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Updating instance_info_cache with network_info: [{"id": "403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd", "address": "fa:16:3e:22:52:9b", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap403cc6d2-3c", "ovs_interfaceid": "403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "57f80e07-cfe0-47a5-9b99-10166cdcf351", "address": "fa:16:3e:81:bd:5b", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f80e07-cf", "ovs_interfaceid": "57f80e07-cfe0-47a5-9b99-10166cdcf351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "01e36afb-4b92-42af-a2da-900e447e474e", "address": "fa:16:3e:10:e1:8d", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.185", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap01e36afb-4b", "ovs_interfaceid": "01e36afb-4b92-42af-a2da-900e447e474e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:47:27 user nova-compute[72239]: DEBUG nova.compute.manager [req-1d8db50f-6daf-4646-a2bb-e46e677dac52 req-50183dd3-92d4-4077-b978-25d293659ea5 service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Detach interface failed, port_id=6fba6d4e-0137-4514-9525-29e86356c1eb, reason: Instance 6258dba2-2e73-45d7-99f0-9a4af065ffcc could not be found. {{(pid=72239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 14:47:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:27 user nova-compute[72239]: INFO nova.compute.manager [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Took 2.48 seconds to detach 3 volumes for instance.
Jul 31 14:47:27 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:47:27 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQpfnwvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 14:47:27 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:47:27 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26232373762396666', 'path': '/dev/sdb'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:47:27 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232373762396666', 'path': '/dev/sdb'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 14:47:27 user nova-compute[72239]: DEBUG nova.objects.instance [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Lazy-loading 'flavor' on Instance uuid f011c736-1a43-4b0e-ac7c-d512bcaa9bdc {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:47:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:28 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=72239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 14:47:28 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:47:28 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:47:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.602s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:28 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Deleted allocations for instance 9203aeaf-2ae9-4e28-9741-05d33df6c915
Jul 31 14:47:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0a3873ef-8552-4da0-9ccb-e42c328718d7 tempest-TaggedBootDevicesTest-503086043 tempest-TaggedBootDevicesTest-503086043-project-member] Lock "9203aeaf-2ae9-4e28-9741-05d33df6c915" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.053s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:28 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] COPY block job progress, current cursor: 27262976 final cursor: 1073741824 {{(pid=72239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 14:47:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:29 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] COPY block job progress, current cursor: 169869312 final cursor: 1073741824 {{(pid=72239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 14:47:29 user nova-compute[72239]: DEBUG nova.compute.manager [req-ac59cc76-638c-478b-bed9-433e6b35d72d req-495cee53-20fb-4873-aeec-c8f728ebac7a service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Received event network-vif-deleted-01e36afb-4b92-42af-a2da-900e447e474e {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:29 user nova-compute[72239]: INFO nova.compute.manager [req-ac59cc76-638c-478b-bed9-433e6b35d72d req-495cee53-20fb-4873-aeec-c8f728ebac7a service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Neutron deleted interface 01e36afb-4b92-42af-a2da-900e447e474e; detaching it from the instance and deleting it from the info cache
Jul 31 14:47:29 user nova-compute[72239]: DEBUG nova.network.neutron [req-ac59cc76-638c-478b-bed9-433e6b35d72d req-495cee53-20fb-4873-aeec-c8f728ebac7a service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Updating instance_info_cache with network_info: [{"id": "403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd", "address": "fa:16:3e:22:52:9b", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap403cc6d2-3c", "ovs_interfaceid": "403cc6d2-3c04-4e84-9f1f-dd1b1c0911dd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "57f80e07-cfe0-47a5-9b99-10166cdcf351", "address": "fa:16:3e:81:bd:5b", "network": {"id": "422a5380-ec3d-4faf-b208-5146c95093fb", "bridge": "br-int", "label": "tempest-device-tagging-net1-356345871", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.221", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "f63f7e945de84876beec594d5cbb6682", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57f80e07-cf", "ovs_interfaceid": "57f80e07-cfe0-47a5-9b99-10166cdcf351", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:47:29 user nova-compute[72239]: DEBUG nova.compute.manager [req-ac59cc76-638c-478b-bed9-433e6b35d72d req-495cee53-20fb-4873-aeec-c8f728ebac7a service nova] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Detach interface failed, port_id=01e36afb-4b92-42af-a2da-900e447e474e, reason: Instance 6258dba2-2e73-45d7-99f0-9a4af065ffcc could not be found. {{(pid=72239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 14:47:29 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] COPY block job progress, current cursor: 293601280 final cursor: 1073741824 {{(pid=72239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 14:47:30 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] COPY block job progress, current cursor: 384827392 final cursor: 1073741824 {{(pid=72239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 14:47:30 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] COPY block job progress, current cursor: 509607936 final cursor: 1073741824 {{(pid=72239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 14:47:30 user nova-compute[72239]: INFO nova.compute.manager [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Took 3.51 seconds to detach 3 volumes for instance.
Jul 31 14:47:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:31 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] COPY block job progress, current cursor: 574619648 final cursor: 1073741824 {{(pid=72239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 14:47:31 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:47:31 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:47:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.483s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:31 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] COPY block job progress, current cursor: 719323136 final cursor: 1073741824 {{(pid=72239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 14:47:31 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Deleted allocations for instance 6258dba2-2e73-45d7-99f0-9a4af065ffcc
Jul 31 14:47:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-95122390-be97-4e67-a17e-37a79d42e8df tempest-TaggedBootDevicesTest_v242-686662005 tempest-TaggedBootDevicesTest_v242-686662005-project-member] Lock "6258dba2-2e73-45d7-99f0-9a4af065ffcc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.750s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:32 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] COPY block job progress, current cursor: 891289600 final cursor: 1073741824 {{(pid=72239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 14:47:32 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:32 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] COPY block job progress, current cursor: 1066401792 final cursor: 1073741824 {{(pid=72239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=72239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690814838.3104463, 9203aeaf-2ae9-4e28-9741-05d33df6c915 => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:47:33 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] VM Stopped (Lifecycle Event)
Jul 31 14:47:33 user nova-compute[72239]: DEBUG nova.compute.manager [None req-a98702e9-612c-422c-a29f-713cca2138d3 None None] [instance: 9203aeaf-2ae9-4e28-9741-05d33df6c915] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dvCfBXja', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': '2a2c81c9-b792-4eb4-a07f-62845f9465c8'}, None), 'kwargs': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:47:33 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:47:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5aeafc-0295-4f51-b58f-4243dc44b790]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[39febe17-1925-4ec4-aa79-f201851ec94d]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)
Jul 31 14:47:33 user nova-compute[72239]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:47:33 user nova-compute[72239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 (non-flash)
Jul 31 14:47:33 user nova-compute[72239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 (non-flash)
Jul 31 14:47:33 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 (non-flash)
Jul 31 14:47:33 user nova-compute[72239]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:47:33 user nova-compute[72239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 (non-flash)
Jul 31 14:47:33 user nova-compute[72239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 (non-flash)
Jul 31 14:47:33 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4126b35e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8'): ({'sdi'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Removing single pathed devices sdi {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1f0a17-026e-4de4-bb56-e923026b26e1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[509b2987-f7ff-405d-8c14-54c079ea24b0]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Flushing IO for device /dev/sdi {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f7e1fc-4eef-4943-985d-0a2d7babb611]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.042s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d25fe7f-9969-4a60-ab7c-e38cab13107e]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] SCSI volumes sdi have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00ba54d-8a03-49af-b723-4af626f9e380]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb79b480-db2e-4249-8fa8-42e8871fa638]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8, portal: 172.16.0.220,3260]
Jul 31 14:47:33 user nova-compute[72239]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8, portal: 172.16.0.220,3260] successful.
Jul 31 14:47:33 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a2c81c9-b792-4eb4-a07f-62845f9465c8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[25cdc282-0d2c-47b2-972e-20aedb22a76f]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] <== disconnect_volume: return (284ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG nova.compute.manager [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQpfnwvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'f011c736-1a43-4b0e-ac7c-d512bcaa9bdc', 'attached_at': '', 'detached_at': '', 'volume_id': 'ab681c1d-23c4-4717-80b9-c98d504cca89', 'serial'} {{(pid=72239) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG nova.compute.manager [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] swap_volume: removing Cinder connection for volume 2a2c81c9-b792-4eb4-a07f-62845f9465c8 {{(pid=72239) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Jul 31 14:47:33 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:34 user nova-compute[72239]: DEBUG nova.compute.manager [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] swap_volume: Updating volume 2a2c81c9-b792-4eb4-a07f-62845f9465c8 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "cQpfnwvd", "auth_password": "FGjZUiC7RJw4oD", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdb", "volume_id": "ab681c1d-23c4-4717-80b9-c98d504cca89"}, "status": "reserved", "instance": "f011c736-1a43-4b0e-ac7c-d512bcaa9bdc", "attached_at": "", "detached_at": "", "volume_id": "ab681c1d-23c4-4717-80b9-c98d504cca89", "serial": "ab681c1d-23c4-4717-80b9-c98d504cca89"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'ab681c1d-23c4-4717-80b9-c98d504cca89', 'no_device': None, 'attachment_id': '326732a7-92cb-460c-9d87-f7bfda752b6b'} {{(pid=72239) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Jul 31 14:47:34 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-127de174-47c6-434a-b91c-93d457cf5998 tempest-TestVolumeSwap-1577002915 tempest-TestVolumeSwap-1577002915-project-admin] Lock "f011c736-1a43-4b0e-ac7c-d512bcaa9bdc" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 18.135s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-65d3e2a0-bb42-416b-a884-507ac31f1b83 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Acquiring lock "f011c736-1a43-4b0e-ac7c-d512bcaa9bdc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-65d3e2a0-bb42-416b-a884-507ac31f1b83 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Lock "f011c736-1a43-4b0e-ac7c-d512bcaa9bdc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:35 user nova-compute[72239]: INFO nova.compute.manager [None req-65d3e2a0-bb42-416b-a884-507ac31f1b83 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Detaching volume ab681c1d-23c4-4717-80b9-c98d504cca89
Jul 31 14:47:35 user nova-compute[72239]: INFO nova.virt.block_device [None req-65d3e2a0-bb42-416b-a884-507ac31f1b83 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Attempting to driver detach volume ab681c1d-23c4-4717-80b9-c98d504cca89 from mountpoint /dev/vdb
Jul 31 14:47:35 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-65d3e2a0-bb42-416b-a884-507ac31f1b83 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Attempting to detach device vdb from instance f011c736-1a43-4b0e-ac7c-d512bcaa9bdc from the persistent domain config. {{(pid=72239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 14:47:35 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-65d3e2a0-bb42-416b-a884-507ac31f1b83 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 14:47:35 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:47:35 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 14:47:35 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:47:35 user nova-compute[72239]:   <serial>ab681c1d-23c4-4717-80b9-c98d504cca89</serial>
Jul 31 14:47:35 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 14:47:35 user nova-compute[72239]: </disk>
Jul 31 14:47:35 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 14:47:35 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-65d3e2a0-bb42-416b-a884-507ac31f1b83 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Successfully detached device vdb from instance f011c736-1a43-4b0e-ac7c-d512bcaa9bdc from the persistent domain config.
Jul 31 14:47:35 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-65d3e2a0-bb42-416b-a884-507ac31f1b83 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f011c736-1a43-4b0e-ac7c-d512bcaa9bdc from the live domain config. {{(pid=72239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 14:47:35 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-65d3e2a0-bb42-416b-a884-507ac31f1b83 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 14:47:35 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:47:35 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 14:47:35 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:47:35 user nova-compute[72239]:   <serial>ab681c1d-23c4-4717-80b9-c98d504cca89</serial>
Jul 31 14:47:35 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 14:47:35 user nova-compute[72239]: </disk>
Jul 31 14:47:35 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Received event <DeviceRemovedEvent: 1690814856.0893533, f011c736-1a43-4b0e-ac7c-d512bcaa9bdc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72239) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-65d3e2a0-bb42-416b-a884-507ac31f1b83 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f011c736-1a43-4b0e-ac7c-d512bcaa9bdc {{(pid=72239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 14:47:36 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-65d3e2a0-bb42-416b-a884-507ac31f1b83 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Successfully detached device vdb from instance f011c736-1a43-4b0e-ac7c-d512bcaa9bdc from the live domain config.
Jul 31 14:47:36 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65d3e2a0-bb42-416b-a884-507ac31f1b83 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d3e2a0-bb42-416b-a884-507ac31f1b83 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cQpfnwvd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'volume_id': 'ab681c1d-23c4-4717-80b9-c98d504cca89'}, None), 'kwargs': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:47:36 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-65d3e2a0-bb42-416b-a884-507ac31f1b83 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:47:36 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-65d3e2a0-bb42-416b-a884-507ac31f1b83 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-65d3e2a0-bb42-416b-a884-507ac31f1b83 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d3e2a0-bb42-416b-a884-507ac31f1b83 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3f2f22-06a5-47c7-9e37-fbc2abd20db2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[381de03f-82a5-43cc-99d9-50815aca4d16]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d3e2a0-bb42-416b-a884-507ac31f1b83 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:47:36 user nova-compute[72239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 (non-flash)
Jul 31 14:47:36 user nova-compute[72239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 (non-flash)
Jul 31 14:47:36 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d3e2a0-bb42-416b-a884-507ac31f1b83 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:47:36 user nova-compute[72239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 (non-flash)
Jul 31 14:47:36 user nova-compute[72239]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 (non-flash)
Jul 31 14:47:36 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d3e2a0-bb42-416b-a884-507ac31f1b83 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f412043a9e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89'): ({'sdb'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-65d3e2a0-bb42-416b-a884-507ac31f1b83 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Removing single pathed devices sdb {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b8351c-aace-4e5d-b561-8f80de85cb33]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[230c7923-28bb-4cc1-8a20-8e222f23a495]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-65d3e2a0-bb42-416b-a884-507ac31f1b83 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Flushing IO for device /dev/sdb {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70ee05d-94a8-4951-917e-a72fb72837e6]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-65d3e2a0-bb42-416b-a884-507ac31f1b83 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.034s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7a126a-39ec-4d70-b336-3d080e049991]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-65d3e2a0-bb42-416b-a884-507ac31f1b83 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-65d3e2a0-bb42-416b-a884-507ac31f1b83 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d3e2a0-bb42-416b-a884-507ac31f1b83 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c34da7e-a07f-4cbb-beaa-0298d06a41e3]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d3e2a0-bb42-416b-a884-507ac31f1b83 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[936bb898-22a3-4ac2-ba92-68aa9c414e4e]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d3e2a0-bb42-416b-a884-507ac31f1b83 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89, portal: 172.16.0.220,3260]
Jul 31 14:47:36 user nova-compute[72239]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89, portal: 172.16.0.220,3260] successful.
Jul 31 14:47:36 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab681c1d-23c4-4717-80b9-c98d504cca89 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fda33b5-7cee-4bca-aa60-3102a5595d93]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d3e2a0-bb42-416b-a884-507ac31f1b83 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-65d3e2a0-bb42-416b-a884-507ac31f1b83 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-65d3e2a0-bb42-416b-a884-507ac31f1b83 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] <== disconnect_volume: return (301ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:47:36 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65d3e2a0-bb42-416b-a884-507ac31f1b83 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 14:47:37 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690814842.0256698, 6258dba2-2e73-45d7-99f0-9a4af065ffcc => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:47:37 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] VM Stopped (Lifecycle Event)
Jul 31 14:47:37 user nova-compute[72239]: DEBUG nova.compute.manager [None req-45c72c4e-49a1-4166-b00d-983f803eaa20 None None] [instance: 6258dba2-2e73-45d7-99f0-9a4af065ffcc] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:47:37 user nova-compute[72239]: DEBUG nova.objects.instance [None req-65d3e2a0-bb42-416b-a884-507ac31f1b83 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Lazy-loading 'flavor' on Instance uuid f011c736-1a43-4b0e-ac7c-d512bcaa9bdc {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:47:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-65d3e2a0-bb42-416b-a884-507ac31f1b83 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Lock "f011c736-1a43-4b0e-ac7c-d512bcaa9bdc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.859s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Acquiring lock "0d9bc124-66f7-4ccf-91f6-dcc4c2d78997" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "0d9bc124-66f7-4ccf-91f6-dcc4c2d78997" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:37 user nova-compute[72239]: DEBUG nova.compute.manager [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 14:47:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:37 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 14:47:37 user nova-compute[72239]: INFO nova.compute.claims [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Claim successful on node user
Jul 31 14:47:37 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:47:37 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:47:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:37 user nova-compute[72239]: DEBUG nova.compute.manager [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 14:47:38 user nova-compute[72239]: DEBUG nova.compute.manager [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 14:47:38 user nova-compute[72239]: DEBUG nova.network.neutron [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 14:47:38 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 14:47:38 user nova-compute[72239]: DEBUG nova.compute.manager [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 14:47:38 user nova-compute[72239]: DEBUG nova.policy [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c6f0cfea2c0f4ec8bfa115354e65da96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6aad7d4ecc24425a8571cc2ac8041628', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 14:47:38 user nova-compute[72239]: DEBUG nova.compute.manager [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 14:47:38 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 14:47:38 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Creating image(s)
Jul 31 14:47:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Acquiring lock "/opt/stack/data/nova/instances/0d9bc124-66f7-4ccf-91f6-dcc4c2d78997/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "/opt/stack/data/nova/instances/0d9bc124-66f7-4ccf-91f6-dcc4c2d78997/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "/opt/stack/data/nova/instances/0d9bc124-66f7-4ccf-91f6-dcc4c2d78997/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:38 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:38 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.133s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Acquiring lock "ca449065000c92aac3b7b9fa685f9a7710929444" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:38 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:38 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.145s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:38 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/0d9bc124-66f7-4ccf-91f6-dcc4c2d78997/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:38 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/0d9bc124-66f7-4ccf-91f6-dcc4c2d78997/disk 1073741824" returned: 0 in 0.051s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:38 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:38 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.135s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:38 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0d9bc124-66f7-4ccf-91f6-dcc4c2d78997/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 14:47:38 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d9bc124-66f7-4ccf-91f6-dcc4c2d78997/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:38 user nova-compute[72239]: DEBUG nova.network.neutron [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Successfully created port: e085294c-8c7d-4ba1-9fed-fe8e2f13e022 {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:47:38 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d9bc124-66f7-4ccf-91f6-dcc4c2d78997/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:38 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Cannot resize image /opt/stack/data/nova/instances/0d9bc124-66f7-4ccf-91f6-dcc4c2d78997/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 14:47:38 user nova-compute[72239]: DEBUG nova.objects.instance [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lazy-loading 'migration_context' on Instance uuid 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:47:38 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 14:47:38 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Ensure instance console log exists: /opt/stack/data/nova/instances/0d9bc124-66f7-4ccf-91f6-dcc4c2d78997/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 14:47:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:38 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG nova.network.neutron [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Successfully updated port: e085294c-8c7d-4ba1-9fed-fe8e2f13e022 {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Acquiring lock "refresh_cache-0d9bc124-66f7-4ccf-91f6-dcc4c2d78997" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Acquired lock "refresh_cache-0d9bc124-66f7-4ccf-91f6-dcc4c2d78997" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG nova.network.neutron [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG nova.compute.manager [req-546ea361-829c-41e9-b2c5-e0fe83fa8ece req-2d0a724d-d16b-431c-9bcc-72b1bbb17bda service nova] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Received event network-changed-e085294c-8c7d-4ba1-9fed-fe8e2f13e022 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG nova.compute.manager [req-546ea361-829c-41e9-b2c5-e0fe83fa8ece req-2d0a724d-d16b-431c-9bcc-72b1bbb17bda service nova] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Refreshing instance network info cache due to event network-changed-e085294c-8c7d-4ba1-9fed-fe8e2f13e022. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-546ea361-829c-41e9-b2c5-e0fe83fa8ece req-2d0a724d-d16b-431c-9bcc-72b1bbb17bda service nova] Acquiring lock "refresh_cache-0d9bc124-66f7-4ccf-91f6-dcc4c2d78997" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG nova.network.neutron [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG nova.network.neutron [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Updating instance_info_cache with network_info: [{"id": "e085294c-8c7d-4ba1-9fed-fe8e2f13e022", "address": "fa:16:3e:05:1b:99", "network": {"id": "f05d7a54-33c7-463e-a73e-8d726fe2a9b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-181910970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aad7d4ecc24425a8571cc2ac8041628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape085294c-8c", "ovs_interfaceid": "e085294c-8c7d-4ba1-9fed-fe8e2f13e022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Releasing lock "refresh_cache-0d9bc124-66f7-4ccf-91f6-dcc4c2d78997" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG nova.compute.manager [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Instance network_info: |[{"id": "e085294c-8c7d-4ba1-9fed-fe8e2f13e022", "address": "fa:16:3e:05:1b:99", "network": {"id": "f05d7a54-33c7-463e-a73e-8d726fe2a9b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-181910970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aad7d4ecc24425a8571cc2ac8041628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape085294c-8c", "ovs_interfaceid": "e085294c-8c7d-4ba1-9fed-fe8e2f13e022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-546ea361-829c-41e9-b2c5-e0fe83fa8ece req-2d0a724d-d16b-431c-9bcc-72b1bbb17bda service nova] Acquired lock "refresh_cache-0d9bc124-66f7-4ccf-91f6-dcc4c2d78997" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG nova.network.neutron [req-546ea361-829c-41e9-b2c5-e0fe83fa8ece req-2d0a724d-d16b-431c-9bcc-72b1bbb17bda service nova] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Refreshing network info cache for port e085294c-8c7d-4ba1-9fed-fe8e2f13e022 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Start _get_guest_xml network_info=[{"id": "e085294c-8c7d-4ba1-9fed-fe8e2f13e022", "address": "fa:16:3e:05:1b:99", "network": {"id": "f05d7a54-33c7-463e-a73e-8d726fe2a9b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-181910970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aad7d4ecc24425a8571cc2ac8041628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape085294c-8c", "ovs_interfaceid": "e085294c-8c7d-4ba1-9fed-fe8e2f13e022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:47:39 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:47:39 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:47:39 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:47:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1488453940',display_name='tempest-VolumesAdminNegativeTest-server-1488453940',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1488453940',id=15,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6aad7d4ecc24425a8571cc2ac8041628',ramdisk_id='',reservation_id='r-8dsprsya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1841650306',owner_user_name='tempest-VolumesAdminNegativeTest-1841650306-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:47:38Z,user_data=None,user_id='c6f0cfea2c0f4ec8bfa115354e65da96',uuid=0d9bc124-66f7-4ccf-91f6-dcc4c2d78997,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e085294c-8c7d-4ba1-9fed-fe8e2f13e022", "address": "fa:16:3e:05:1b:99", "network": {"id": "f05d7a54-33c7-463e-a73e-8d726fe2a9b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-181910970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aad7d4ecc24425a8571cc2ac8041628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape085294c-8c", "ovs_interfaceid": "e085294c-8c7d-4ba1-9fed-fe8e2f13e022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Converting VIF {"id": "e085294c-8c7d-4ba1-9fed-fe8e2f13e022", "address": "fa:16:3e:05:1b:99", "network": {"id": "f05d7a54-33c7-463e-a73e-8d726fe2a9b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-181910970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aad7d4ecc24425a8571cc2ac8041628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape085294c-8c", "ovs_interfaceid": "e085294c-8c7d-4ba1-9fed-fe8e2f13e022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:1b:99,bridge_name='br-int',has_traffic_filtering=True,id=e085294c-8c7d-4ba1-9fed-fe8e2f13e022,network=Network(f05d7a54-33c7-463e-a73e-8d726fe2a9b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape085294c-8c') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG nova.objects.instance [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lazy-loading 'pci_devices' on Instance uuid 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:47:39 user nova-compute[72239]:   <uuid>0d9bc124-66f7-4ccf-91f6-dcc4c2d78997</uuid>
Jul 31 14:47:39 user nova-compute[72239]:   <name>instance-0000000f</name>
Jul 31 14:47:39 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:47:39 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:47:39 user nova-compute[72239]:   <metadata>
Jul 31 14:47:39 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:47:39 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:47:39 user nova-compute[72239]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1488453940</nova:name>
Jul 31 14:47:39 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:47:39</nova:creationTime>
Jul 31 14:47:39 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:47:39 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:47:39 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:47:39 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:47:39 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:47:39 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:47:39 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:47:39 user nova-compute[72239]:       <nova:owner>
Jul 31 14:47:39 user nova-compute[72239]:         <nova:user uuid="c6f0cfea2c0f4ec8bfa115354e65da96">tempest-VolumesAdminNegativeTest-1841650306-project-member</nova:user>
Jul 31 14:47:39 user nova-compute[72239]:         <nova:project uuid="6aad7d4ecc24425a8571cc2ac8041628">tempest-VolumesAdminNegativeTest-1841650306</nova:project>
Jul 31 14:47:39 user nova-compute[72239]:       </nova:owner>
Jul 31 14:47:39 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:47:39 user nova-compute[72239]:       <nova:ports>
Jul 31 14:47:39 user nova-compute[72239]:         <nova:port uuid="e085294c-8c7d-4ba1-9fed-fe8e2f13e022">
Jul 31 14:47:39 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 31 14:47:39 user nova-compute[72239]:         </nova:port>
Jul 31 14:47:39 user nova-compute[72239]:       </nova:ports>
Jul 31 14:47:39 user nova-compute[72239]:     </nova:instance>
Jul 31 14:47:39 user nova-compute[72239]:   </metadata>
Jul 31 14:47:39 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:47:39 user nova-compute[72239]:     <system>
Jul 31 14:47:39 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:47:39 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:47:39 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:47:39 user nova-compute[72239]:       <entry name="serial">0d9bc124-66f7-4ccf-91f6-dcc4c2d78997</entry>
Jul 31 14:47:39 user nova-compute[72239]:       <entry name="uuid">0d9bc124-66f7-4ccf-91f6-dcc4c2d78997</entry>
Jul 31 14:47:39 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:47:39 user nova-compute[72239]:     </system>
Jul 31 14:47:39 user nova-compute[72239]:   </sysinfo>
Jul 31 14:47:39 user nova-compute[72239]:   <os>
Jul 31 14:47:39 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:47:39 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:47:39 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:47:39 user nova-compute[72239]:   </os>
Jul 31 14:47:39 user nova-compute[72239]:   <features>
Jul 31 14:47:39 user nova-compute[72239]:     <acpi/>
Jul 31 14:47:39 user nova-compute[72239]:     <apic/>
Jul 31 14:47:39 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:47:39 user nova-compute[72239]:   </features>
Jul 31 14:47:39 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:47:39 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:47:39 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:47:39 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:47:39 user nova-compute[72239]:   </clock>
Jul 31 14:47:39 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:47:39 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:47:39 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:47:39 user nova-compute[72239]:   </cpu>
Jul 31 14:47:39 user nova-compute[72239]:   <devices>
Jul 31 14:47:39 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:47:39 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:47:39 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/0d9bc124-66f7-4ccf-91f6-dcc4c2d78997/disk"/>
Jul 31 14:47:39 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:47:39 user nova-compute[72239]:     </disk>
Jul 31 14:47:39 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:47:39 user nova-compute[72239]:       <mac address="fa:16:3e:05:1b:99"/>
Jul 31 14:47:39 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:47:39 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:47:39 user nova-compute[72239]:       <target dev="tape085294c-8c"/>
Jul 31 14:47:39 user nova-compute[72239]:     </interface>
Jul 31 14:47:39 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:47:39 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/0d9bc124-66f7-4ccf-91f6-dcc4c2d78997/console.log" append="off"/>
Jul 31 14:47:39 user nova-compute[72239]:     </serial>
Jul 31 14:47:39 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:47:39 user nova-compute[72239]:     <video>
Jul 31 14:47:39 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:47:39 user nova-compute[72239]:     </video>
Jul 31 14:47:39 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:47:39 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:47:39 user nova-compute[72239]:     </rng>
Jul 31 14:47:39 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:47:39 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:47:39 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:47:39 user nova-compute[72239]:     </memballoon>
Jul 31 14:47:39 user nova-compute[72239]:   </devices>
Jul 31 14:47:39 user nova-compute[72239]: </domain>
Jul 31 14:47:39 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:47:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1488453940',display_name='tempest-VolumesAdminNegativeTest-server-1488453940',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1488453940',id=15,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6aad7d4ecc24425a8571cc2ac8041628',ramdisk_id='',reservation_id='r-8dsprsya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1841650306',owner_user_name='tempest-VolumesAdminNegativeTest-1841650306-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:47:38Z,user_data=None,user_id='c6f0cfea2c0f4ec8bfa115354e65da96',uuid=0d9bc124-66f7-4ccf-91f6-dcc4c2d78997,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e085294c-8c7d-4ba1-9fed-fe8e2f13e022", "address": "fa:16:3e:05:1b:99", "network": {"id": "f05d7a54-33c7-463e-a73e-8d726fe2a9b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-181910970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aad7d4ecc24425a8571cc2ac8041628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape085294c-8c", "ovs_interfaceid": "e085294c-8c7d-4ba1-9fed-fe8e2f13e022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Converting VIF {"id": "e085294c-8c7d-4ba1-9fed-fe8e2f13e022", "address": "fa:16:3e:05:1b:99", "network": {"id": "f05d7a54-33c7-463e-a73e-8d726fe2a9b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-181910970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aad7d4ecc24425a8571cc2ac8041628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape085294c-8c", "ovs_interfaceid": "e085294c-8c7d-4ba1-9fed-fe8e2f13e022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:1b:99,bridge_name='br-int',has_traffic_filtering=True,id=e085294c-8c7d-4ba1-9fed-fe8e2f13e022,network=Network(f05d7a54-33c7-463e-a73e-8d726fe2a9b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape085294c-8c') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG os_vif [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:1b:99,bridge_name='br-int',has_traffic_filtering=True,id=e085294c-8c7d-4ba1-9fed-fe8e2f13e022,network=Network(f05d7a54-33c7-463e-a73e-8d726fe2a9b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape085294c-8c') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape085294c-8c, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape085294c-8c, col_values=(('external_ids', {'iface-id': 'e085294c-8c7d-4ba1-9fed-fe8e2f13e022', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:1b:99', 'vm-uuid': '0d9bc124-66f7-4ccf-91f6-dcc4c2d78997'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:47:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:39 user nova-compute[72239]: INFO os_vif [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:1b:99,bridge_name='br-int',has_traffic_filtering=True,id=e085294c-8c7d-4ba1-9fed-fe8e2f13e022,network=Network(f05d7a54-33c7-463e-a73e-8d726fe2a9b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape085294c-8c')
Jul 31 14:47:40 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:47:40 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] No VIF found with MAC fa:16:3e:05:1b:99, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:47:40 user nova-compute[72239]: DEBUG nova.network.neutron [req-546ea361-829c-41e9-b2c5-e0fe83fa8ece req-2d0a724d-d16b-431c-9bcc-72b1bbb17bda service nova] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Updated VIF entry in instance network info cache for port e085294c-8c7d-4ba1-9fed-fe8e2f13e022. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:47:40 user nova-compute[72239]: DEBUG nova.network.neutron [req-546ea361-829c-41e9-b2c5-e0fe83fa8ece req-2d0a724d-d16b-431c-9bcc-72b1bbb17bda service nova] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Updating instance_info_cache with network_info: [{"id": "e085294c-8c7d-4ba1-9fed-fe8e2f13e022", "address": "fa:16:3e:05:1b:99", "network": {"id": "f05d7a54-33c7-463e-a73e-8d726fe2a9b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-181910970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aad7d4ecc24425a8571cc2ac8041628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape085294c-8c", "ovs_interfaceid": "e085294c-8c7d-4ba1-9fed-fe8e2f13e022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:47:40 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-546ea361-829c-41e9-b2c5-e0fe83fa8ece req-2d0a724d-d16b-431c-9bcc-72b1bbb17bda service nova] Releasing lock "refresh_cache-0d9bc124-66f7-4ccf-91f6-dcc4c2d78997" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:47:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-68376f18-9a08-4a80-83dd-99f0280cb8c5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Acquiring lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-68376f18-9a08-4a80-83dd-99f0280cb8c5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-68376f18-9a08-4a80-83dd-99f0280cb8c5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Acquiring lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-68376f18-9a08-4a80-83dd-99f0280cb8c5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-68376f18-9a08-4a80-83dd-99f0280cb8c5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:41 user nova-compute[72239]: INFO nova.compute.manager [None req-68376f18-9a08-4a80-83dd-99f0280cb8c5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Terminating instance
Jul 31 14:47:41 user nova-compute[72239]: DEBUG nova.compute.manager [None req-68376f18-9a08-4a80-83dd-99f0280cb8c5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 14:47:41 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:41 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:41 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:41 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:41 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:41 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:41 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:41 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:41 user nova-compute[72239]: DEBUG nova.compute.manager [req-b4bcbb1b-6984-433c-b308-125521b1ba23 req-007874d4-4933-4403-89b9-36ab6af9deaf service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Received event network-vif-unplugged-bc41ac8f-b231-4381-9278-64ce17f8833d {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b4bcbb1b-6984-433c-b308-125521b1ba23 req-007874d4-4933-4403-89b9-36ab6af9deaf service nova] Acquiring lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b4bcbb1b-6984-433c-b308-125521b1ba23 req-007874d4-4933-4403-89b9-36ab6af9deaf service nova] Lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b4bcbb1b-6984-433c-b308-125521b1ba23 req-007874d4-4933-4403-89b9-36ab6af9deaf service nova] Lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:41 user nova-compute[72239]: DEBUG nova.compute.manager [req-b4bcbb1b-6984-433c-b308-125521b1ba23 req-007874d4-4933-4403-89b9-36ab6af9deaf service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] No waiting events found dispatching network-vif-unplugged-bc41ac8f-b231-4381-9278-64ce17f8833d {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:47:41 user nova-compute[72239]: DEBUG nova.compute.manager [req-b4bcbb1b-6984-433c-b308-125521b1ba23 req-007874d4-4933-4403-89b9-36ab6af9deaf service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Received event network-vif-unplugged-bc41ac8f-b231-4381-9278-64ce17f8833d for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 14:47:41 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:41 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:42 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Instance destroyed successfully.
Jul 31 14:47:42 user nova-compute[72239]: DEBUG nova.objects.instance [None req-68376f18-9a08-4a80-83dd-99f0280cb8c5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lazy-loading 'resources' on Instance uuid 9bd6169a-9a44-4d9c-a406-c10a2542a7b4 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:47:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-68376f18-9a08-4a80-83dd-99f0280cb8c5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-31T14:44:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1518629609',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1518629609',id=9,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMkO64Mxo9V45ZvyZddW60Bj3R/wxTnuP74Wl0QbQrxRPpHV5wIIOFOuVL0TXCzmSq9fH99PAiORRcNxyzp52Ts3i5cecEtzUOk3DHNvVsfSIw0FbT8y4KNU2UgxwmOgpg==',key_name='tempest-keypair-1851777278',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:44:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ef0e60cdf6a46cfb149c45d8f5443c6',ramdisk_id='',reservation_id='r-uyqcqdz1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-99713276',owner_user_name='tempest-TaggedAttachmentsTest-99713276-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:44:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffb1bd7bcf554374b9b3c5bb1fc2b00a',uuid=9bd6169a-9a44-4d9c-a406-c10a2542a7b4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bc41ac8f-b231-4381-9278-64ce17f8833d", "address": "fa:16:3e:25:8c:a7", "network": {"id": "c36e8dbf-183c-4511-bb8d-12d2f61ff51c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1591719384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0e60cdf6a46cfb149c45d8f5443c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc41ac8f-b2", "ovs_interfaceid": "bc41ac8f-b231-4381-9278-64ce17f8833d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:47:42 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-68376f18-9a08-4a80-83dd-99f0280cb8c5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Converting VIF {"id": "bc41ac8f-b231-4381-9278-64ce17f8833d", "address": "fa:16:3e:25:8c:a7", "network": {"id": "c36e8dbf-183c-4511-bb8d-12d2f61ff51c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1591719384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ef0e60cdf6a46cfb149c45d8f5443c6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbc41ac8f-b2", "ovs_interfaceid": "bc41ac8f-b231-4381-9278-64ce17f8833d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:47:42 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-68376f18-9a08-4a80-83dd-99f0280cb8c5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:8c:a7,bridge_name='br-int',has_traffic_filtering=True,id=bc41ac8f-b231-4381-9278-64ce17f8833d,network=Network(c36e8dbf-183c-4511-bb8d-12d2f61ff51c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc41ac8f-b2') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:47:42 user nova-compute[72239]: DEBUG os_vif [None req-68376f18-9a08-4a80-83dd-99f0280cb8c5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:8c:a7,bridge_name='br-int',has_traffic_filtering=True,id=bc41ac8f-b231-4381-9278-64ce17f8833d,network=Network(c36e8dbf-183c-4511-bb8d-12d2f61ff51c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc41ac8f-b2') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:47:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbc41ac8f-b2, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:47:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:47:42 user nova-compute[72239]: INFO os_vif [None req-68376f18-9a08-4a80-83dd-99f0280cb8c5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:8c:a7,bridge_name='br-int',has_traffic_filtering=True,id=bc41ac8f-b231-4381-9278-64ce17f8833d,network=Network(c36e8dbf-183c-4511-bb8d-12d2f61ff51c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbc41ac8f-b2')
Jul 31 14:47:42 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-68376f18-9a08-4a80-83dd-99f0280cb8c5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Deleting instance files /opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4_del
Jul 31 14:47:42 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-68376f18-9a08-4a80-83dd-99f0280cb8c5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Deletion of /opt/stack/data/nova/instances/9bd6169a-9a44-4d9c-a406-c10a2542a7b4_del complete
Jul 31 14:47:42 user nova-compute[72239]: INFO nova.compute.manager [None req-68376f18-9a08-4a80-83dd-99f0280cb8c5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Took 1.33 seconds to destroy the instance on the hypervisor.
Jul 31 14:47:42 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-68376f18-9a08-4a80-83dd-99f0280cb8c5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 14:47:42 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 14:47:42 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 14:47:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:43 user nova-compute[72239]: DEBUG nova.compute.manager [req-cd62ca5d-88a6-4986-842c-0399383e0228 req-17457c62-78d4-4b4a-9867-e5169a1a88ee service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Received event network-vif-plugged-bc41ac8f-b231-4381-9278-64ce17f8833d {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-cd62ca5d-88a6-4986-842c-0399383e0228 req-17457c62-78d4-4b4a-9867-e5169a1a88ee service nova] Acquiring lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-cd62ca5d-88a6-4986-842c-0399383e0228 req-17457c62-78d4-4b4a-9867-e5169a1a88ee service nova] Lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-cd62ca5d-88a6-4986-842c-0399383e0228 req-17457c62-78d4-4b4a-9867-e5169a1a88ee service nova] Lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:43 user nova-compute[72239]: DEBUG nova.compute.manager [req-cd62ca5d-88a6-4986-842c-0399383e0228 req-17457c62-78d4-4b4a-9867-e5169a1a88ee service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] No waiting events found dispatching network-vif-plugged-bc41ac8f-b231-4381-9278-64ce17f8833d {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:47:43 user nova-compute[72239]: WARNING nova.compute.manager [req-cd62ca5d-88a6-4986-842c-0399383e0228 req-17457c62-78d4-4b4a-9867-e5169a1a88ee service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Received unexpected event network-vif-plugged-bc41ac8f-b231-4381-9278-64ce17f8833d for instance with vm_state active and task_state deleting.
Jul 31 14:47:43 user nova-compute[72239]: DEBUG nova.compute.manager [req-cd62ca5d-88a6-4986-842c-0399383e0228 req-17457c62-78d4-4b4a-9867-e5169a1a88ee service nova] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Received event network-vif-plugged-e085294c-8c7d-4ba1-9fed-fe8e2f13e022 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-cd62ca5d-88a6-4986-842c-0399383e0228 req-17457c62-78d4-4b4a-9867-e5169a1a88ee service nova] Acquiring lock "0d9bc124-66f7-4ccf-91f6-dcc4c2d78997-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-cd62ca5d-88a6-4986-842c-0399383e0228 req-17457c62-78d4-4b4a-9867-e5169a1a88ee service nova] Lock "0d9bc124-66f7-4ccf-91f6-dcc4c2d78997-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-cd62ca5d-88a6-4986-842c-0399383e0228 req-17457c62-78d4-4b4a-9867-e5169a1a88ee service nova] Lock "0d9bc124-66f7-4ccf-91f6-dcc4c2d78997-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:43 user nova-compute[72239]: DEBUG nova.compute.manager [req-cd62ca5d-88a6-4986-842c-0399383e0228 req-17457c62-78d4-4b4a-9867-e5169a1a88ee service nova] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] No waiting events found dispatching network-vif-plugged-e085294c-8c7d-4ba1-9fed-fe8e2f13e022 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:47:43 user nova-compute[72239]: WARNING nova.compute.manager [req-cd62ca5d-88a6-4986-842c-0399383e0228 req-17457c62-78d4-4b4a-9867-e5169a1a88ee service nova] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Received unexpected event network-vif-plugged-e085294c-8c7d-4ba1-9fed-fe8e2f13e022 for instance with vm_state building and task_state spawning.
Jul 31 14:47:43 user nova-compute[72239]: DEBUG nova.compute.manager [req-cd62ca5d-88a6-4986-842c-0399383e0228 req-17457c62-78d4-4b4a-9867-e5169a1a88ee service nova] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Received event network-vif-plugged-e085294c-8c7d-4ba1-9fed-fe8e2f13e022 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-cd62ca5d-88a6-4986-842c-0399383e0228 req-17457c62-78d4-4b4a-9867-e5169a1a88ee service nova] Acquiring lock "0d9bc124-66f7-4ccf-91f6-dcc4c2d78997-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-cd62ca5d-88a6-4986-842c-0399383e0228 req-17457c62-78d4-4b4a-9867-e5169a1a88ee service nova] Lock "0d9bc124-66f7-4ccf-91f6-dcc4c2d78997-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-cd62ca5d-88a6-4986-842c-0399383e0228 req-17457c62-78d4-4b4a-9867-e5169a1a88ee service nova] Lock "0d9bc124-66f7-4ccf-91f6-dcc4c2d78997-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:43 user nova-compute[72239]: DEBUG nova.compute.manager [req-cd62ca5d-88a6-4986-842c-0399383e0228 req-17457c62-78d4-4b4a-9867-e5169a1a88ee service nova] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] No waiting events found dispatching network-vif-plugged-e085294c-8c7d-4ba1-9fed-fe8e2f13e022 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:47:43 user nova-compute[72239]: WARNING nova.compute.manager [req-cd62ca5d-88a6-4986-842c-0399383e0228 req-17457c62-78d4-4b4a-9867-e5169a1a88ee service nova] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Received unexpected event network-vif-plugged-e085294c-8c7d-4ba1-9fed-fe8e2f13e022 for instance with vm_state building and task_state spawning.
Jul 31 14:47:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:44 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814864.0475879, 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:47:44 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] VM Resumed (Lifecycle Event)
Jul 31 14:47:44 user nova-compute[72239]: DEBUG nova.compute.manager [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:47:44 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 14:47:44 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Instance spawned successfully.
Jul 31 14:47:44 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 14:47:44 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:47:44 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:47:44 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:47:44 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:47:44 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:47:44 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:47:44 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:47:44 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:47:44 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:47:44 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814864.0496683, 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:47:44 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] VM Started (Lifecycle Event)
Jul 31 14:47:44 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:47:44 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:47:44 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:47:44 user nova-compute[72239]: INFO nova.compute.manager [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Took 6.02 seconds to spawn the instance on the hypervisor.
Jul 31 14:47:44 user nova-compute[72239]: DEBUG nova.compute.manager [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:47:44 user nova-compute[72239]: INFO nova.compute.manager [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Took 6.78 seconds to build instance.
Jul 31 14:47:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5be5a743-4003-4fe3-bd6a-83d2820d8c01 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "0d9bc124-66f7-4ccf-91f6-dcc4c2d78997" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.874s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:44 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:47:44 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Took 1.94 seconds to deallocate network for instance.
Jul 31 14:47:44 user nova-compute[72239]: DEBUG nova.compute.manager [req-605b297b-b427-49bf-b12c-2448bbc26767 req-09495180-a35e-47af-aaa2-f61c513bf945 service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Received event network-vif-deleted-bc41ac8f-b231-4381-9278-64ce17f8833d {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:47:44 user nova-compute[72239]: INFO nova.compute.manager [req-605b297b-b427-49bf-b12c-2448bbc26767 req-09495180-a35e-47af-aaa2-f61c513bf945 service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Neutron deleted interface bc41ac8f-b231-4381-9278-64ce17f8833d; detaching it from the instance and deleting it from the info cache
Jul 31 14:47:44 user nova-compute[72239]: DEBUG nova.network.neutron [req-605b297b-b427-49bf-b12c-2448bbc26767 req-09495180-a35e-47af-aaa2-f61c513bf945 service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:47:44 user nova-compute[72239]: DEBUG nova.compute.manager [req-605b297b-b427-49bf-b12c-2448bbc26767 req-09495180-a35e-47af-aaa2-f61c513bf945 service nova] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Detach interface failed, port_id=bc41ac8f-b231-4381-9278-64ce17f8833d, reason: Instance 9bd6169a-9a44-4d9c-a406-c10a2542a7b4 could not be found. {{(pid=72239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 14:47:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-68376f18-9a08-4a80-83dd-99f0280cb8c5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-68376f18-9a08-4a80-83dd-99f0280cb8c5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:44 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-68376f18-9a08-4a80-83dd-99f0280cb8c5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:47:44 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-68376f18-9a08-4a80-83dd-99f0280cb8c5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:47:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-68376f18-9a08-4a80-83dd-99f0280cb8c5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.429s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:44 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-68376f18-9a08-4a80-83dd-99f0280cb8c5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Deleted allocations for instance 9bd6169a-9a44-4d9c-a406-c10a2542a7b4
Jul 31 14:47:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-68376f18-9a08-4a80-83dd-99f0280cb8c5 tempest-TaggedAttachmentsTest-99713276 tempest-TaggedAttachmentsTest-99713276-project-member] Lock "9bd6169a-9a44-4d9c-a406-c10a2542a7b4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.881s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6e6ae9e5-d200-4ea9-978b-08e8c4fe51a1 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Acquiring lock "82116af8-3702-401b-8d00-9291d4caeb03" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:47:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6e6ae9e5-d200-4ea9-978b-08e8c4fe51a1 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "82116af8-3702-401b-8d00-9291d4caeb03" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:47:45 user nova-compute[72239]: INFO nova.compute.manager [None req-6e6ae9e5-d200-4ea9-978b-08e8c4fe51a1 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Detaching volume 87c13680-fa38-403d-a378-7fc84fc65207
Jul 31 14:47:45 user nova-compute[72239]: INFO nova.virt.block_device [None req-6e6ae9e5-d200-4ea9-978b-08e8c4fe51a1 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Attempting to driver detach volume 87c13680-fa38-403d-a378-7fc84fc65207 from mountpoint /dev/vdb
Jul 31 14:47:45 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6e6ae9e5-d200-4ea9-978b-08e8c4fe51a1 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Attempting to detach device vdb from instance 82116af8-3702-401b-8d00-9291d4caeb03 from the persistent domain config. {{(pid=72239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 14:47:45 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-6e6ae9e5-d200-4ea9-978b-08e8c4fe51a1 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 14:47:45 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:47:45 user nova-compute[72239]:   <source dev="/dev/sdj"/>
Jul 31 14:47:45 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:47:45 user nova-compute[72239]:   <serial>87c13680-fa38-403d-a378-7fc84fc65207</serial>
Jul 31 14:47:45 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 14:47:45 user nova-compute[72239]: </disk>
Jul 31 14:47:45 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 14:47:45 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-6e6ae9e5-d200-4ea9-978b-08e8c4fe51a1 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Successfully detached device vdb from instance 82116af8-3702-401b-8d00-9291d4caeb03 from the persistent domain config.
Jul 31 14:47:45 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6e6ae9e5-d200-4ea9-978b-08e8c4fe51a1 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 82116af8-3702-401b-8d00-9291d4caeb03 from the live domain config. {{(pid=72239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 14:47:45 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-6e6ae9e5-d200-4ea9-978b-08e8c4fe51a1 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 14:47:45 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:47:45 user nova-compute[72239]:   <source dev="/dev/sdj"/>
Jul 31 14:47:45 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:47:45 user nova-compute[72239]:   <serial>87c13680-fa38-403d-a378-7fc84fc65207</serial>
Jul 31 14:47:45 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 14:47:45 user nova-compute[72239]: </disk>
Jul 31 14:47:45 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Received event <DeviceRemovedEvent: 1690814866.3197343, 82116af8-3702-401b-8d00-9291d4caeb03 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72239) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6e6ae9e5-d200-4ea9-978b-08e8c4fe51a1 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 82116af8-3702-401b-8d00-9291d4caeb03 {{(pid=72239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 14:47:46 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-6e6ae9e5-d200-4ea9-978b-08e8c4fe51a1 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Successfully detached device vdb from instance 82116af8-3702-401b-8d00-9291d4caeb03 from the live domain config.
Jul 31 14:47:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e6ae9e5-d200-4ea9-978b-08e8c4fe51a1 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6ae9e5-d200-4ea9-978b-08e8c4fe51a1 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hFDuSOsf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:47:46 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-6e6ae9e5-d200-4ea9-978b-08e8c4fe51a1 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:47:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-6e6ae9e5-d200-4ea9-978b-08e8c4fe51a1 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-6e6ae9e5-d200-4ea9-978b-08e8c4fe51a1 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6ae9e5-d200-4ea9-978b-08e8c4fe51a1 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7763f5f8-0e97-4f6e-8668-8e9998bd3566]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4d7e2a3-24de-4c4a-9348-f265c2bae2a6]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6ae9e5-d200-4ea9-978b-08e8c4fe51a1 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:47:46 user nova-compute[72239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 (non-flash)
Jul 31 14:47:46 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6ae9e5-d200-4ea9-978b-08e8c4fe51a1 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:47:46 user nova-compute[72239]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 (non-flash)
Jul 31 14:47:46 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6ae9e5-d200-4ea9-978b-08e8c4fe51a1 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41202d04c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207'): ({'sdj'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-6e6ae9e5-d200-4ea9-978b-08e8c4fe51a1 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Removing single pathed devices sdj {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a46523-1888-4afe-8a8f-d9d989e9fc6d]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7997d1b-567c-43ce-b98a-7175e6815dfb]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-6e6ae9e5-d200-4ea9-978b-08e8c4fe51a1 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Flushing IO for device /dev/sdj {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[778a7896-ac0b-4c59-976e-2161a29abd4d]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-6e6ae9e5-d200-4ea9-978b-08e8c4fe51a1 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.083s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5449def-f612-4fe1-bf56-6ef1f96a4ced]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-6e6ae9e5-d200-4ea9-978b-08e8c4fe51a1 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-6e6ae9e5-d200-4ea9-978b-08e8c4fe51a1 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] SCSI volumes sdj have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6ae9e5-d200-4ea9-978b-08e8c4fe51a1 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.116s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[788559c2-8c0f-443e-a52a-53524c89ec4c]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6ae9e5-d200-4ea9-978b-08e8c4fe51a1 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a08315c-2906-48b6-b8d2-0526c0b83e7b]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6ae9e5-d200-4ea9-978b-08e8c4fe51a1 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207, portal: 172.16.0.220,3260]
Jul 31 14:47:46 user nova-compute[72239]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207, portal: 172.16.0.220,3260] successful.
Jul 31 14:47:46 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87c13680-fa38-403d-a378-7fc84fc65207 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[be27e1e6-989d-4290-82f6-11fcbe4df965]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6ae9e5-d200-4ea9-978b-08e8c4fe51a1 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-6e6ae9e5-d200-4ea9-978b-08e8c4fe51a1 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.472s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e6ae9e5-d200-4ea9-978b-08e8c4fe51a1 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] <== disconnect_volume: return (473ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:47:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e6ae9e5-d200-4ea9-978b-08e8c4fe51a1 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 14:47:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:47 user nova-compute[72239]: DEBUG nova.objects.instance [None req-6e6ae9e5-d200-4ea9-978b-08e8c4fe51a1 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lazy-loading 'flavor' on Instance uuid 82116af8-3702-401b-8d00-9291d4caeb03 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:47:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6e6ae9e5-d200-4ea9-978b-08e8c4fe51a1 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "82116af8-3702-401b-8d00-9291d4caeb03" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.876s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:47:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:47:57 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690814862.2433715, 9bd6169a-9a44-4d9c-a406-c10a2542a7b4 => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:47:57 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] VM Stopped (Lifecycle Event)
Jul 31 14:47:57 user nova-compute[72239]: DEBUG nova.compute.manager [None req-0e76c985-f395-4129-9a7e-0d9e008e1fd5 None None] [instance: 9bd6169a-9a44-4d9c-a406-c10a2542a7b4] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:47:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:47:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:00 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:48:00 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:48:00 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:48:00 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 14:48:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-079a5ed7-ee25-495b-a2a4-924d830a670a" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:48:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-079a5ed7-ee25-495b-a2a4-924d830a670a" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:48:00 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 14:48:01 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Updating instance_info_cache with network_info: [{"id": "e22b0941-5069-46e7-9722-621a758253f1", "address": "fa:16:3e:5e:88:13", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape22b0941-50", "ovs_interfaceid": "e22b0941-5069-46e7-9722-621a758253f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:48:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-079a5ed7-ee25-495b-a2a4-924d830a670a" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:48:01 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 14:48:01 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:48:01 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:48:01 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:48:01 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:48:01 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:48:01 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:48:01 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 14:48:01 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:48:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:01 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 14:48:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f011c736-1a43-4b0e-ac7c-d512bcaa9bdc/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f011c736-1a43-4b0e-ac7c-d512bcaa9bdc/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f011c736-1a43-4b0e-ac7c-d512bcaa9bdc/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f011c736-1a43-4b0e-ac7c-d512bcaa9bdc/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Acquiring lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:02 user nova-compute[72239]: DEBUG nova.objects.instance [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lazy-loading 'flavor' on Instance uuid d3e3612b-c6b9-4308-a45a-1ff3805e18bb {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:48:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.095s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Acquiring lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:02 user nova-compute[72239]: INFO nova.compute.manager [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Attaching volume 0442beb2-94e8-445b-b688-af66bd23814f to /dev/vdb
Jul 31 14:48:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:02 user nova-compute[72239]: DEBUG os_brick.utils [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:48:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:02 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c14c03c-b197-4eea-94f3-f30b669ed0b2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:02 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b8d37c1-6e58-4e38-a319-97f406e76304]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:02 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7801fc2c-5728-4aee-88c2-aa19703d3964]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:02 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c904a920-8527-40ba-a89c-965e3fab212e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:48:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 14:48:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:48:03 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 14:48:03 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82af57b-0426-4672-8403-0cc9b5d1e106]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 14:48:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 14:48:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 14:48:03 user nova-compute[72239]: DEBUG os_brick.utils [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:48:03 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Updating existing volume attachment record: 70568683-1626-41c8-8efe-46d7dda17992 {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 14:48:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:03 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:48:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d9bc124-66f7-4ccf-91f6-dcc4c2d78997/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d9bc124-66f7-4ccf-91f6-dcc4c2d78997/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d9bc124-66f7-4ccf-91f6-dcc4c2d78997/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d9bc124-66f7-4ccf-91f6-dcc4c2d78997/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62122879-2a72-4ddf-a028-317eda0da465/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:03 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62122879-2a72-4ddf-a028-317eda0da465/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62122879-2a72-4ddf-a028-317eda0da465/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62122879-2a72-4ddf-a028-317eda0da465/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Acquiring lock "97917500-bc78-433b-8d3d-181ed13667dc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lock "97917500-bc78-433b-8d3d-181ed13667dc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:04 user nova-compute[72239]: DEBUG nova.objects.instance [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lazy-loading 'flavor' on Instance uuid 97917500-bc78-433b-8d3d-181ed13667dc {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:48:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lock "97917500-bc78-433b-8d3d-181ed13667dc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.087s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:05 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:48:05 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:48:05 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=7469MB free_disk=25.49371337890625GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 14:48:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Acquiring lock "97917500-bc78-433b-8d3d-181ed13667dc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lock "97917500-bc78-433b-8d3d-181ed13667dc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:05 user nova-compute[72239]: INFO nova.compute.manager [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Attaching volume 8aa94ef5-0195-46eb-875d-acb827d145a9 to /dev/vdb
Jul 31 14:48:05 user nova-compute[72239]: DEBUG os_brick.utils [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:48:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:05 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[168f065c-5dd5-4508-8ac8-2a1f54dde4fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:05 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[375a8371-b8b5-452e-8ae8-ef58e4e3f78e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:05 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 20abf743-de5b-4122-aad0-e2124c7804b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:48:05 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 7d81b881-b44e-4fb3-8245-9dea634bdec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:48:05 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 079a5ed7-ee25-495b-a2a4-924d830a670a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:48:05 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance d3e3612b-c6b9-4308-a45a-1ff3805e18bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:48:05 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 97917500-bc78-433b-8d3d-181ed13667dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:48:05 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 62122879-2a72-4ddf-a028-317eda0da465 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:48:05 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance f011c736-1a43-4b0e-ac7c-d512bcaa9bdc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:48:05 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 82116af8-3702-401b-8d00-9291d4caeb03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:48:05 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 2f11022e-a007-4d4c-adc1-b54ea59b9e6a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:48:05 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:48:05 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 14:48:05 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 14:48:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:05 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1e833d-ad6a-4cab-a417-894623dfc289]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:05 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a1c41e-187c-405e-9541-c9d9092b1e2f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:48:05 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 14:48:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:48:05 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 14:48:05 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[25910d55-a9af-4768-82ad-272553b0fbd4]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:05 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 14:48:05 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 14:48:05 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 14:48:05 user nova-compute[72239]: DEBUG os_brick.utils [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:48:05 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Updating existing volume attachment record: 8eb3fb1f-26c8-415b-936e-4a91440e1325 {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 14:48:05 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:48:05 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:48:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 14:48:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.621s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 14:48:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PjhAmCqu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:48:12 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:48:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:48:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:48:12 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:48:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:48:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:48:12 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 14:48:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4737f726-6b64-430f-90eb-86a878bb148f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 14:48:12 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:48:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bd8aba-4a32-474f-8d5c-131559554eab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f] added
Jul 31 14:48:12 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:48:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1193e8e0-3eaf-4627-a25a-dbaf2e8ab3ce]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:48:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd74b9d-1520-4136-abf5-de7363da6b80]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:48:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PjhAmCqu {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PjhAmCqu" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44560a5-1074-4ee1-82d2-84f5376657f1]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PjhAmCqu'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:48:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.113s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43a310b-2905-4205-a6a2-d50b480c6d5f]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:48:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01add6c-fd76-469f-a14e-4ceb67b82e92]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:48:13 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:48:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:48:13 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:48:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[03004596-bbab-4f2c-a8e1-9e63e9c0d998]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f, portal: 172.16.0.220,3260]
Jul 31 14:48:13 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f, portal: 172.16.0.220,3260] successful.
Jul 31 14:48:13 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:48:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b2fc02-a99c-4598-a5c1-208f07140c80]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:48:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cab7191-dad0-402a-b3fb-cb128ed02994]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:48:13 user nova-compute[72239]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:48:13 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:48:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:48:13 user nova-compute[72239]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:48:13 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:48:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.401s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:48:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 14:48:13 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 14:48:13 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 14:48:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae6dab58-ba79-4342-83fe-a2760cfadde4]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:13 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:48:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PjhAmCqu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 14:48:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.436s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:48:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] <== connect_volume: return (1439ms) {'type': 'block', 'scsi_wwn': '23762643838376331', 'path': '/dev/sdb'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:48:14 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762643838376331', 'path': '/dev/sdb'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 14:48:14 user nova-compute[72239]: DEBUG nova.objects.instance [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lazy-loading 'flavor' on Instance uuid d3e3612b-c6b9-4308-a45a-1ff3805e18bb {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:48:14 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 14:48:14 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:48:14 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 14:48:14 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:48:14 user nova-compute[72239]:   <serial>0442beb2-94e8-445b-b688-af66bd23814f</serial>
Jul 31 14:48:14 user nova-compute[72239]: </disk>
Jul 31 14:48:14 user nova-compute[72239]:  {{(pid=72239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 14:48:14 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:48:14 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:48:14 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] No VIF found with MAC fa:16:3e:f4:8d:da, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:48:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bdbc13ab-da28-4c17-b9a5-a7766b243793 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.070s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vluiLoTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:48:16 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:48:16 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:48:16 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:48:16 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.144s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:48:16 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 14:48:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db28b6d-c881-4976-a142-275539788047]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 14:48:16 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22f809a-f8ec-403e-886b-9d977557aef6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9] added
Jul 31 14:48:16 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac79d444-8a82-4ac2-8f70-c136c3e616eb]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3407c8-e75d-4a5c-9ecf-ce3bfdb74f46]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vluiLoTm {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vluiLoTm" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bbf23c-4f10-4434-a0cc-6f529f31b33a]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vluiLoTm'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0b8d89-02eb-4cfd-bd40-70b80f96a730]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d644492c-7acb-4912-9bee-062b7fcf8099]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:48:16 user nova-compute[72239]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:48:16 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:48:16 user nova-compute[72239]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:48:16 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[64518b51-8ae4-409d-953c-49597b6ffac6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9, portal: 172.16.0.220,3260]
Jul 31 14:48:16 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9, portal: 172.16.0.220,3260] successful.
Jul 31 14:48:16 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7989306-1492-4eab-ab55-216bd695f17d]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[face2d06-9633-4784-ba35-716aafb114d2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:48:16 user nova-compute[72239]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:48:16 user nova-compute[72239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)
Jul 31 14:48:16 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:48:16 user nova-compute[72239]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:48:16 user nova-compute[72239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)
Jul 31 14:48:16 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] HCTL ('34', '-', '-', 0) found on session 18 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 14:48:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:17 user nova-compute[72239]: DEBUG nova.compute.manager [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Stashing vm_state: active {{(pid=72239) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Jul 31 14:48:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:17 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b6a5fa-107b-4561-a294-94629d69b56b]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:17 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Searching for a device in session 18 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:48:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vluiLoTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 14:48:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:17 user nova-compute[72239]: DEBUG nova.objects.instance [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lazy-loading 'pci_requests' on Instance uuid d3e3612b-c6b9-4308-a45a-1ff3805e18bb {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:48:17 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 14:48:17 user nova-compute[72239]: INFO nova.compute.claims [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Claim successful on node user
Jul 31 14:48:17 user nova-compute[72239]: DEBUG nova.objects.instance [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lazy-loading 'resources' on Instance uuid d3e3612b-c6b9-4308-a45a-1ff3805e18bb {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:48:17 user nova-compute[72239]: DEBUG nova.objects.instance [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lazy-loading 'pci_devices' on Instance uuid d3e3612b-c6b9-4308-a45a-1ff3805e18bb {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:48:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:17 user nova-compute[72239]: INFO nova.compute.resource_tracker [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Updating resource usage from migration dd60a421-3ed6-462e-9ed9-0ca2f7ff54a0
Jul 31 14:48:17 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:48:17 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:48:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.538s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:17 user nova-compute[72239]: INFO nova.compute.manager [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Migrating
Jul 31 14:48:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:48:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Acquired lock "compute-rpcapi-router" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:48:17 user nova-compute[72239]: INFO nova.compute.rpcapi [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Jul 31 14:48:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Releasing lock "compute-rpcapi-router" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:48:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Acquiring lock "refresh_cache-d3e3612b-c6b9-4308-a45a-1ff3805e18bb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:48:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Acquired lock "refresh_cache-d3e3612b-c6b9-4308-a45a-1ff3805e18bb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:48:17 user nova-compute[72239]: DEBUG nova.network.neutron [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:48:18 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.489s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:48:18 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] <== connect_volume: return (1491ms) {'type': 'block', 'scsi_wwn': '23566666433393138', 'path': '/dev/sdc'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:48:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566666433393138', 'path': '/dev/sdc'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 14:48:18 user nova-compute[72239]: DEBUG nova.objects.instance [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lazy-loading 'flavor' on Instance uuid 97917500-bc78-433b-8d3d-181ed13667dc {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:48:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 14:48:18 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:48:18 user nova-compute[72239]:   <source dev="/dev/sdc"/>
Jul 31 14:48:18 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:48:18 user nova-compute[72239]:   <serial>8aa94ef5-0195-46eb-875d-acb827d145a9</serial>
Jul 31 14:48:18 user nova-compute[72239]: </disk>
Jul 31 14:48:18 user nova-compute[72239]:  {{(pid=72239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 14:48:18 user nova-compute[72239]: DEBUG nova.network.neutron [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Updating instance_info_cache with network_info: [{"id": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "address": "fa:16:3e:f4:8d:da", "network": {"id": "ad1d78ca-d597-4586-8b1b-4dc00fac3c3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-398965992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "506aad3c95a94800a4cc333a3478da17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ef6541-6b", "ovs_interfaceid": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:48:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Releasing lock "refresh_cache-d3e3612b-c6b9-4308-a45a-1ff3805e18bb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:48:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:48:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:48:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] No VIF found with MAC fa:16:3e:a4:5f:0e, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:48:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Starting migrate_disk_and_power_off {{(pid=72239) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Jul 31 14:48:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1c9fafe6-0547-4b27-90fc-0f74c6cbd77e tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lock "97917500-bc78-433b-8d3d-181ed13667dc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.249s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-c4bcc1cb-4384-4763-9a17-9c796d67c4d7 req-5d008554-3c70-47f2-9017-08021c613571 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Received event network-vif-unplugged-d6ef6541-6b7e-4dc5-8149-a10940dfe87b {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-c4bcc1cb-4384-4763-9a17-9c796d67c4d7 req-5d008554-3c70-47f2-9017-08021c613571 service nova] Acquiring lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-c4bcc1cb-4384-4763-9a17-9c796d67c4d7 req-5d008554-3c70-47f2-9017-08021c613571 service nova] Lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-c4bcc1cb-4384-4763-9a17-9c796d67c4d7 req-5d008554-3c70-47f2-9017-08021c613571 service nova] Lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-c4bcc1cb-4384-4763-9a17-9c796d67c4d7 req-5d008554-3c70-47f2-9017-08021c613571 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] No waiting events found dispatching network-vif-unplugged-d6ef6541-6b7e-4dc5-8149-a10940dfe87b {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:48:19 user nova-compute[72239]: WARNING nova.compute.manager [req-c4bcc1cb-4384-4763-9a17-9c796d67c4d7 req-5d008554-3c70-47f2-9017-08021c613571 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Received unexpected event network-vif-unplugged-d6ef6541-6b7e-4dc5-8149-a10940dfe87b for instance with vm_state active and task_state resize_migrating.
Jul 31 14:48:19 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Instance destroyed successfully.
Jul 31 14:48:19 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:44:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-704430368',display_name='tempest-ServerActionsTestOtherB-server-704430368',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-704430368',id=5,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMAieHq8I0ZAPg3BJdF9GCCYAxcsl1TuUTZpA9U0PVBIFwXLp4luFdF9A4kOklr7N7b3+Doyb1i/MuF4moMlBsM1nlQtqnIuFR3yVshdpPI3XQmqmueJHWFXMGjAp573g==',key_name='tempest-keypair-1046174319',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:44:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='506aad3c95a94800a4cc333a3478da17',ramdisk_id='',reservation_id='r-rcs9kimd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-858495710',owner_user_name='tempest-ServerActionsTestOtherB-858495710-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:48:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c92e1d7e3b944359fcbf9475dcacef0',uuid=d3e3612b-c6b9-4308-a45a-1ff3805e18bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "address": "fa:16:3e:f4:8d:da", "network": {"id": "ad1d78ca-d597-4586-8b1b-4dc00fac3c3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-398965992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-398965992-network", "vif_mac": "fa:16:3e:f4:8d:da"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "506aad3c95a94800a4cc333a3478da17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ef6541-6b", "ovs_interfaceid": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Converting VIF {"id": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "address": "fa:16:3e:f4:8d:da", "network": {"id": "ad1d78ca-d597-4586-8b1b-4dc00fac3c3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-398965992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-398965992-network", "vif_mac": "fa:16:3e:f4:8d:da"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "506aad3c95a94800a4cc333a3478da17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ef6541-6b", "ovs_interfaceid": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:8d:da,bridge_name='br-int',has_traffic_filtering=True,id=d6ef6541-6b7e-4dc5-8149-a10940dfe87b,network=Network(ad1d78ca-d597-4586-8b1b-4dc00fac3c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ef6541-6b') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG os_vif [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:8d:da,bridge_name='br-int',has_traffic_filtering=True,id=d6ef6541-6b7e-4dc5-8149-a10940dfe87b,network=Network(ad1d78ca-d597-4586-8b1b-4dc00fac3c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ef6541-6b') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6ef6541-6b, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:48:19 user nova-compute[72239]: INFO os_vif [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:8d:da,bridge_name='br-int',has_traffic_filtering=True,id=d6ef6541-6b7e-4dc5-8149-a10940dfe87b,network=Network(ad1d78ca-d597-4586-8b1b-4dc00fac3c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ef6541-6b')
Jul 31 14:48:19 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PjhAmCqu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:48:19 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:48:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ddf943-ec8d-4f4e-93a3-b80c582fa4a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1715b1ce-1278-4602-ab65-1da4802e1768]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:48:19 user nova-compute[72239]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:48:19 user nova-compute[72239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)
Jul 31 14:48:19 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:48:19 user nova-compute[72239]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:48:19 user nova-compute[72239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)
Jul 31 14:48:19 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4120245f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f'): ({'sdb'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Removing single pathed devices sdb {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0561f6-2b7e-40c5-9760-d79bb437b424]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a6ca33-3c4e-40c1-b751-c900312950f9]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Flushing IO for device /dev/sdb {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c0e4c3-e923-4097-800c-850e2485dbaf]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[23578335-b319-40ef-a81d-dce89b12359d]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[602c7961-e5e5-4d79-b28c-2e5a004f3522]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[78605640-c6d3-41e2-bd26-45cef6345449]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f, portal: 172.16.0.220,3260]
Jul 31 14:48:19 user nova-compute[72239]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f, portal: 172.16.0.220,3260] successful.
Jul 31 14:48:19 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecc5a53-c387-4486-9ef8-a48603fcfdb1]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] <== disconnect_volume: return (284ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:19 user nova-compute[72239]: INFO nova.compute.manager [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Rescuing
Jul 31 14:48:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Acquiring lock "refresh_cache-97917500-bc78-433b-8d3d-181ed13667dc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Acquired lock "refresh_cache-97917500-bc78-433b-8d3d-181ed13667dc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG nova.network.neutron [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:20 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:48:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb_resize/disk /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:20 user nova-compute[72239]: DEBUG nova.network.neutron [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Updating instance_info_cache with network_info: [{"id": "60c1bdaa-524e-41da-96d7-56c77f959c71", "address": "fa:16:3e:a4:5f:0e", "network": {"id": "edecce7c-9fe9-4028-997d-b1ceef4e22bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1931054498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e59830ca9e40718341c3f2b0375af0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c1bdaa-52", "ovs_interfaceid": "60c1bdaa-524e-41da-96d7-56c77f959c71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:48:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Releasing lock "refresh_cache-97917500-bc78-433b-8d3d-181ed13667dc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:48:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] CMD "cp -r /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb_resize/disk /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk" returned: 0 in 0.496s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb_resize/disk.info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk.info {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] CMD "cp -r /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb_resize/disk.info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk.info" returned: 0 in 0.037s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:21 user nova-compute[72239]: DEBUG nova.compute.manager [req-73f0dbfb-9891-4b53-a97c-d8425c419d96 req-d693189c-bdf3-4021-acc9-d396c7f669b5 service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Received event network-vif-unplugged-60c1bdaa-524e-41da-96d7-56c77f959c71 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:48:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-73f0dbfb-9891-4b53-a97c-d8425c419d96 req-d693189c-bdf3-4021-acc9-d396c7f669b5 service nova] Acquiring lock "97917500-bc78-433b-8d3d-181ed13667dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-73f0dbfb-9891-4b53-a97c-d8425c419d96 req-d693189c-bdf3-4021-acc9-d396c7f669b5 service nova] Lock "97917500-bc78-433b-8d3d-181ed13667dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-73f0dbfb-9891-4b53-a97c-d8425c419d96 req-d693189c-bdf3-4021-acc9-d396c7f669b5 service nova] Lock "97917500-bc78-433b-8d3d-181ed13667dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:21 user nova-compute[72239]: DEBUG nova.compute.manager [req-73f0dbfb-9891-4b53-a97c-d8425c419d96 req-d693189c-bdf3-4021-acc9-d396c7f669b5 service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] No waiting events found dispatching network-vif-unplugged-60c1bdaa-524e-41da-96d7-56c77f959c71 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:48:21 user nova-compute[72239]: WARNING nova.compute.manager [req-73f0dbfb-9891-4b53-a97c-d8425c419d96 req-d693189c-bdf3-4021-acc9-d396c7f669b5 service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Received unexpected event network-vif-unplugged-60c1bdaa-524e-41da-96d7-56c77f959c71 for instance with vm_state active and task_state rescuing.
Jul 31 14:48:21 user nova-compute[72239]: DEBUG nova.compute.manager [req-274f7369-0c32-40ec-8ea5-4e396f03a771 req-51dd718e-ad5e-44b7-9bda-9cc63924e98b service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Received event network-vif-plugged-d6ef6541-6b7e-4dc5-8149-a10940dfe87b {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:48:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-274f7369-0c32-40ec-8ea5-4e396f03a771 req-51dd718e-ad5e-44b7-9bda-9cc63924e98b service nova] Acquiring lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-274f7369-0c32-40ec-8ea5-4e396f03a771 req-51dd718e-ad5e-44b7-9bda-9cc63924e98b service nova] Lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-274f7369-0c32-40ec-8ea5-4e396f03a771 req-51dd718e-ad5e-44b7-9bda-9cc63924e98b service nova] Lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:21 user nova-compute[72239]: DEBUG nova.compute.manager [req-274f7369-0c32-40ec-8ea5-4e396f03a771 req-51dd718e-ad5e-44b7-9bda-9cc63924e98b service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] No waiting events found dispatching network-vif-plugged-d6ef6541-6b7e-4dc5-8149-a10940dfe87b {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:48:21 user nova-compute[72239]: WARNING nova.compute.manager [req-274f7369-0c32-40ec-8ea5-4e396f03a771 req-51dd718e-ad5e-44b7-9bda-9cc63924e98b service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Received unexpected event network-vif-plugged-d6ef6541-6b7e-4dc5-8149-a10940dfe87b for instance with vm_state active and task_state resize_migrating.
Jul 31 14:48:21 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Instance destroyed successfully.
Jul 31 14:48:21 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Attempting a stable device rescue
Jul 31 14:48:21 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=72239) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 31 14:48:21 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Instance directory exists: not creating {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 31 14:48:21 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Creating image(s)
Jul 31 14:48:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Acquiring lock "/opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lock "/opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lock "/opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:21 user nova-compute[72239]: DEBUG nova.objects.instance [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lazy-loading 'trusted_certs' on Instance uuid 97917500-bc78-433b-8d3d-181ed13667dc {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:48:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Acquiring lock "842371a914522ee9a661144c2954b133f77f0d90" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lock "842371a914522ee9a661144c2954b133f77f0d90" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/842371a914522ee9a661144c2954b133f77f0d90.part --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/842371a914522ee9a661144c2954b133f77f0d90.part --force-share --output=json" returned: 0 in 0.153s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:22 user nova-compute[72239]: DEBUG nova.virt.images [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] e2072093-3546-4fb8-8aa0-6c0305d2734f was qcow2, converting to raw {{(pid=72239) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 31 14:48:22 user nova-compute[72239]: DEBUG nova.privsep.utils [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72239) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 14:48:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/842371a914522ee9a661144c2954b133f77f0d90.part /opt/stack/data/nova/instances/_base/842371a914522ee9a661144c2954b133f77f0d90.converted {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/842371a914522ee9a661144c2954b133f77f0d90.part /opt/stack/data/nova/instances/_base/842371a914522ee9a661144c2954b133f77f0d90.converted" returned: 0 in 0.215s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/842371a914522ee9a661144c2954b133f77f0d90.converted --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/842371a914522ee9a661144c2954b133f77f0d90.converted --force-share --output=json" returned: 0 in 0.178s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lock "842371a914522ee9a661144c2954b133f77f0d90" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.323s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Acquiring lock "842371a914522ee9a661144c2954b133f77f0d90" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lock "842371a914522ee9a661144c2954b133f77f0d90" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/842371a914522ee9a661144c2954b133f77f0d90 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/842371a914522ee9a661144c2954b133f77f0d90 --force-share --output=json" returned: 0 in 0.153s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/842371a914522ee9a661144c2954b133f77f0d90,backing_fmt=raw /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk.rescue {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG nova.compute.manager [req-e0fb3984-a71d-4c4c-9399-4cd68b3791ff req-726cf8be-50ee-4dc8-a4c5-8f3871d66467 service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Received event network-vif-plugged-60c1bdaa-524e-41da-96d7-56c77f959c71 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e0fb3984-a71d-4c4c-9399-4cd68b3791ff req-726cf8be-50ee-4dc8-a4c5-8f3871d66467 service nova] Acquiring lock "97917500-bc78-433b-8d3d-181ed13667dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e0fb3984-a71d-4c4c-9399-4cd68b3791ff req-726cf8be-50ee-4dc8-a4c5-8f3871d66467 service nova] Lock "97917500-bc78-433b-8d3d-181ed13667dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e0fb3984-a71d-4c4c-9399-4cd68b3791ff req-726cf8be-50ee-4dc8-a4c5-8f3871d66467 service nova] Lock "97917500-bc78-433b-8d3d-181ed13667dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG nova.compute.manager [req-e0fb3984-a71d-4c4c-9399-4cd68b3791ff req-726cf8be-50ee-4dc8-a4c5-8f3871d66467 service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] No waiting events found dispatching network-vif-plugged-60c1bdaa-524e-41da-96d7-56c77f959c71 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:48:23 user nova-compute[72239]: WARNING nova.compute.manager [req-e0fb3984-a71d-4c4c-9399-4cd68b3791ff req-726cf8be-50ee-4dc8-a4c5-8f3871d66467 service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Received unexpected event network-vif-plugged-60c1bdaa-524e-41da-96d7-56c77f959c71 for instance with vm_state active and task_state rescuing.
Jul 31 14:48:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/842371a914522ee9a661144c2954b133f77f0d90,backing_fmt=raw /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk.rescue" returned: 0 in 0.061s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lock "842371a914522ee9a661144c2954b133f77f0d90" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG nova.objects.instance [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lazy-loading 'migration_context' on Instance uuid 97917500-bc78-433b-8d3d-181ed13667dc {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Start _get_guest_xml network_info=[{"id": "60c1bdaa-524e-41da-96d7-56c77f959c71", "address": "fa:16:3e:a4:5f:0e", "network": {"id": "edecce7c-9fe9-4028-997d-b1ceef4e22bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1931054498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1931054498-network", "vif_mac": "fa:16:3e:a4:5f:0e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e59830ca9e40718341c3f2b0375af0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c1bdaa-52", "ovs_interfaceid": "60c1bdaa-524e-41da-96d7-56c77f959c71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e2072093-3546-4fb8-8aa0-6c0305d2734f', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '8eb3fb1f-26c8-415b-936e-4a91440e1325', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vluiLoTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '97917500-bc78-433b-8d3d-181ed13667dc', 'attached_at': '', 'detached_at': '', 'volume_id': '8aa94ef5-0195-46eb-875d-acb827d145a9', 'serial': '8aa94ef5-0195-46eb-875d-acb827d145a9'}, 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG nova.objects.instance [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lazy-loading 'resources' on Instance uuid 97917500-bc78-433b-8d3d-181ed13667dc {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG nova.objects.instance [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lazy-loading 'numa_topology' on Instance uuid 97917500-bc78-433b-8d3d-181ed13667dc {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:48:23 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:48:23 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:48:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG nova.objects.instance [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lazy-loading 'vcpu_model' on Instance uuid 97917500-bc78-433b-8d3d-181ed13667dc {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vluiLoTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:48:23 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:48:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:48:23 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:48:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:48:23 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 14:48:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a97ef338-b416-4c5a-96b4-c147f43864ae]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = vluiLoTm\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 31 14:48:23 user nova-compute[72239]: node.name = iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9
Jul 31 14:48:23 user nova-compute[72239]: node.tpgt = -1
Jul 31 14:48:23 user nova-compute[72239]: node.startup = automatic
Jul 31 14:48:23 user nova-compute[72239]: node.leading_login = No
Jul 31 14:48:23 user nova-compute[72239]: iface.iscsi_ifacename = default
Jul 31 14:48:23 user nova-compute[72239]: iface.net_ifacename = <empty>
Jul 31 14:48:23 user nova-compute[72239]: iface.ipaddress = <empty>
Jul 31 14:48:23 user nova-compute[72239]: iface.prefix_len = 0
Jul 31 14:48:23 user nova-compute[72239]: iface.hwaddress = <empty>
Jul 31 14:48:23 user nova-compute[72239]: iface.transport_name = tcp
Jul 31 14:48:23 user nova-compute[72239]: iface.initiatorname = <empty>
Jul 31 14:48:23 user nova-compute[72239]: iface.state = <empty>
Jul 31 14:48:23 user nova-compute[72239]: iface.vlan_id = 0
Jul 31 14:48:23 user nova-compute[72239]: iface.vlan_priority = 0
Jul 31 14:48:23 user nova-compute[72239]: iface.vlan_state = <empty>
Jul 31 14:48:23 user nova-compute[72239]: iface.iface_num = 0
Jul 31 14:48:23 user nova-compute[72239]: iface.mtu = 0
Jul 31 14:48:23 user nova-compute[72239]: iface.port = 0
Jul 31 14:48:23 user nova-compute[72239]: iface.bootproto = <empty>
Jul 31 14:48:23 user nova-compute[72239]: iface.subnet_mask = <empty>
Jul 31 14:48:23 user nova-compute[72239]: iface.gateway = <empty>
Jul 31 14:48:23 user nova-compute[72239]: iface.dhcp_alt_client_id_state = <empty>
Jul 31 14:48:23 user nova-compute[72239]: iface.dhcp_alt_client_id = <empty>
Jul 31 14:48:23 user nova-compute[72239]: iface.dhcp_dns = <empty>
Jul 31 14:48:23 user nova-compute[72239]: iface.dhcp_learn_iqn = <empty>
Jul 31 14:48:23 user nova-compute[72239]: iface.dhcp_req_vendor_id_state = <empty>
Jul 31 14:48:23 user nova-compute[72239]: iface.dhcp_vendor_id_state = <empty>
Jul 31 14:48:23 user nova-compute[72239]: iface.dhcp_vendor_id = <empty>
Jul 31 14:48:23 user nova-compute[72239]: iface.dhcp_slp_da = <empty>
Jul 31 14:48:23 user nova-compute[72239]: iface.fragmentation = <empty>
Jul 31 14:48:23 user nova-compute[72239]: iface.gratuitous_arp = <empty>
Jul 31 14:48:23 user nova-compute[72239]: iface.incoming_forwarding = <empty>
Jul 31 14:48:23 user nova-compute[72239]: iface.tos_state = <empty>
Jul 31 14:48:23 user nova-compute[72239]: iface.tos = 0
Jul 31 14:48:23 user nova-compute[72239]: iface.ttl = 0
Jul 31 14:48:23 user nova-compute[72239]: iface.delayed_ack = <empty>
Jul 31 14:48:23 user nova-compute[72239]: iface.tcp_nagle = <empty>
Jul 31 14:48:23 user nova-compute[72239]: iface.tcp_wsf_state = <empty>
Jul 31 14:48:23 user nova-compute[72239]: iface.tcp_wsf = 0
Jul 31 14:48:23 user nova-compute[72239]: iface.tcp_timer_scale = 0
Jul 31 14:48:23 user nova-compute[72239]: iface.tcp_timestamp = <empty>
Jul 31 14:48:23 user nova-compute[72239]: iface.redirect = <empty>
Jul 31 14:48:23 user nova-compute[72239]: iface.def_task_mgmt_timeout = 0
Jul 31 14:48:23 user nova-compute[72239]: iface.header_digest = <empty>
Jul 31 14:48:23 user nova-compute[72239]: iface.data_digest = <empty>
Jul 31 14:48:23 user nova-compute[72239]: iface.immediate_data = <empty>
Jul 31 14:48:23 user nova-compute[72239]: iface.initial_r2t = <empty>
Jul 31 14:48:23 user nova-compute[72239]: iface.data_seq_inorder = <empty>
Jul 31 14:48:23 user nova-compute[72239]: iface.data_pdu_inorder = <empty>
Jul 31 14:48:23 user nova-compute[72239]: iface.erl = 0
Jul 31 14:48:23 user nova-compute[72239]: iface.max_receive_data_len = 0
Jul 31 14:48:23 user nova-compute[72239]: iface.first_burst_len = 0
Jul 31 14:48:23 user nova-compute[72239]: iface.max_outstanding_r2t = 0
Jul 31 14:48:23 user nova-compute[72239]: iface.max_burst_len = 0
Jul 31 14:48:23 user nova-compute[72239]: iface.chap_auth = <empty>
Jul 31 14:48:23 user nova-compute[72239]: iface.bidi_chap = <empty>
Jul 31 14:48:23 user nova-compute[72239]: iface.strict_login_compliance = <empty>
Jul 31 14:48:23 user nova-compute[72239]: iface.discovery_auth = <empty>
Jul 31 14:48:23 user nova-compute[72239]: iface.discovery_logout = <empty>
Jul 31 14:48:23 user nova-compute[72239]: node.discovery_address = <empty>
Jul 31 14:48:23 user nova-compute[72239]: node.discovery_port = 0
Jul 31 14:48:23 user nova-compute[72239]: node.discovery_type = static
Jul 31 14:48:23 user nova-compute[72239]: node.session.initial_cmdsn = 0
Jul 31 14:48:23 user nova-compute[72239]: node.session.initial_login_retry_max = 8
Jul 31 14:48:23 user nova-compute[72239]: node.session.xmit_thread_priority = -20
Jul 31 14:48:23 user nova-compute[72239]: node.session.cmds_max = 128
Jul 31 14:48:23 user nova-compute[72239]: node.session.queue_depth = 32
Jul 31 14:48:23 user nova-compute[72239]: node.session.nr_sessions = 1
Jul 31 14:48:23 user nova-compute[72239]: node.session.auth.authmethod = CHAP
Jul 31 14:48:23 user nova-compute[72239]: node.session.auth.username = vluiLoTm
Jul 31 14:48:23 user nova-compute[72239]: node.session.auth.password = ***
Jul 31 14:48:23 user nova-compute[72239]: node.session.auth.username_in = <empty>
Jul 31 14:48:23 user nova-compute[72239]: node.session.auth.password_in = <empty>
Jul 31 14:48:23 user nova-compute[72239]: node.session.auth.chap_algs = MD5
Jul 31 14:48:23 user nova-compute[72239]: node.session.timeo.replacement_timeout = 120
Jul 31 14:48:23 user nova-compute[72239]: node.session.err_timeo.abort_timeout = 15
Jul 31 14:48:23 user nova-compute[72239]: node.session.err_timeo.lu_reset_timeout = 30
Jul 31 14:48:23 user nova-compute[72239]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 31 14:48:23 user nova-compute[72239]: node.session.err_timeo.host_reset_timeout = 60
Jul 31 14:48:23 user nova-compute[72239]: node.session.iscsi.FastAbort = Yes
Jul 31 14:48:23 user nova-compute[72239]: node.session.iscsi.InitialR2T = No
Jul 31 14:48:23 user nova-compute[72239]: node.session.iscsi.ImmediateData = Yes
Jul 31 14:48:23 user nova-compute[72239]: node.session.iscsi.FirstBurstLength = 262144
Jul 31 14:48:23 user nova-compute[72239]: node.session.iscsi.MaxBurstLength = 16776192
Jul 31 14:48:23 user nova-compute[72239]: node.session.iscsi.DefaultTime2Retain = 0
Jul 31 14:48:23 user nova-compute[72239]: node.session.iscsi.DefaultTime2Wait = 2
Jul 31 14:48:23 user nova-compute[72239]: node.session.iscsi.MaxConnections = 1
Jul 31 14:48:23 user nova-compute[72239]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 31 14:48:23 user nova-compute[72239]: node.session.iscsi.ERL = 0
Jul 31 14:48:23 user nova-compute[72239]: node.session.scan = manual
Jul 31 14:48:23 user nova-compute[72239]: node.session.reopen_max = 0
Jul 31 14:48:23 user nova-compute[72239]: node.conn[0].address = 172.16.0.220
Jul 31 14:48:23 user nova-compute[72239]: node.conn[0].port = 3260
Jul 31 14:48:23 user nova-compute[72239]: node.conn[0].startup = manual
Jul 31 14:48:23 user nova-compute[72239]: node.conn[0].tcp.window_size = 524288
Jul 31 14:48:23 user nova-compute[72239]: node.conn[0].tcp.type_of_service = 0
Jul 31 14:48:23 user nova-compute[72239]: node.conn[0].timeo.logout_timeout = 15
Jul 31 14:48:23 user nova-compute[72239]: node.conn[0].timeo.login_timeout = 15
Jul 31 14:48:23 user nova-compute[72239]: node.conn[0].timeo.auth_timeout = 45
Jul 31 14:48:23 user nova-compute[72239]: node.conn[0].timeo.noop_out_interval = 5
Jul 31 14:48:23 user nova-compute[72239]: node.conn[0].timeo.noop_out_timeout = 5
Jul 31 14:48:23 user nova-compute[72239]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 31 14:48:23 user nova-compute[72239]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 31 14:48:23 user nova-compute[72239]: node.conn[0].iscsi.HeaderDigest = None
Jul 31 14:48:23 user nova-compute[72239]: node.conn[0].iscsi.DataDigest = None
Jul 31 14:48:23 user nova-compute[72239]: node.conn[0].iscsi.IFMarker = No
Jul 31 14:48:23 user nova-compute[72239]: node.conn[0].iscsi.OFMarker = No
Jul 31 14:48:23 user nova-compute[72239]: # END RECORD
Jul 31 14:48:23 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f107e097-f1e4-4723-902e-5f1e5da7485a]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2adb1de7-bd11-444a-9957-05516b467bbb]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vluiLoTm {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vluiLoTm" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bb4a69-9a75-465b-a3de-e342499963f1]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vluiLoTm'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88d3962-bc93-4b60-bc0e-9c136e92e8ba]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[60978760-6fa8-4f1a-94ba-cf062a0d5811]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:48:23 user nova-compute[72239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)
Jul 31 14:48:23 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:48:23 user nova-compute[72239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)
Jul 31 14:48:23 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.169s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] HCTL ('34', '0', '0', 0) found on session 18 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3683dd5f-0d00-4645-a924-211e883961ca]: (4, ('0 0 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Searching for a device in session 18 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vluiLoTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.195s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] <== connect_volume: return (197ms) {'type': 'block', 'scsi_wwn': '23566666433393138', 'path': '/dev/sdc'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23566666433393138', 'path': '/dev/sdc'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:44:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1906962809',display_name='tempest-ServerStableDeviceRescueTest-server-1906962809',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1906962809',id=6,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlFBmAzelYchMoAGUb60rbfIln3qCeD2o8psoYFowByLC00hIP+y8UpBp70Jkvkzzjmyn4APvd5SxUameMY9qeQ+2b0RFNmW42aqb81yJhfLBj22P9rK42XpxH37WRJIw==',key_name='tempest-keypair-2011346805',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:44:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48e59830ca9e40718341c3f2b0375af0',ramdisk_id='',reservation_id='r-3xscnqmk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1096111935',owner_user_name='tempest-ServerStableDeviceRescueTest-1096111935-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:46:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1df7639d9db4005841b1b3812440f83',uuid=97917500-bc78-433b-8d3d-181ed13667dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60c1bdaa-524e-41da-96d7-56c77f959c71", "address": "fa:16:3e:a4:5f:0e", "network": {"id": "edecce7c-9fe9-4028-997d-b1ceef4e22bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1931054498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1931054498-network", "vif_mac": "fa:16:3e:a4:5f:0e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e59830ca9e40718341c3f2b0375af0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c1bdaa-52", "ovs_interfaceid": "60c1bdaa-524e-41da-96d7-56c77f959c71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Converting VIF {"id": "60c1bdaa-524e-41da-96d7-56c77f959c71", "address": "fa:16:3e:a4:5f:0e", "network": {"id": "edecce7c-9fe9-4028-997d-b1ceef4e22bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1931054498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1931054498-network", "vif_mac": "fa:16:3e:a4:5f:0e"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e59830ca9e40718341c3f2b0375af0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c1bdaa-52", "ovs_interfaceid": "60c1bdaa-524e-41da-96d7-56c77f959c71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:5f:0e,bridge_name='br-int',has_traffic_filtering=True,id=60c1bdaa-524e-41da-96d7-56c77f959c71,network=Network(edecce7c-9fe9-4028-997d-b1ceef4e22bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c1bdaa-52') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG nova.objects.instance [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lazy-loading 'pci_devices' on Instance uuid 97917500-bc78-433b-8d3d-181ed13667dc {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:48:23 user nova-compute[72239]:   <uuid>97917500-bc78-433b-8d3d-181ed13667dc</uuid>
Jul 31 14:48:23 user nova-compute[72239]:   <name>instance-00000006</name>
Jul 31 14:48:23 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:48:23 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:48:23 user nova-compute[72239]:   <metadata>
Jul 31 14:48:23 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:48:23 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:48:23 user nova-compute[72239]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1906962809</nova:name>
Jul 31 14:48:23 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:48:23</nova:creationTime>
Jul 31 14:48:23 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:48:23 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:48:23 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:48:23 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:48:23 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:48:23 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:48:23 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:48:23 user nova-compute[72239]:       <nova:owner>
Jul 31 14:48:23 user nova-compute[72239]:         <nova:user uuid="e1df7639d9db4005841b1b3812440f83">tempest-ServerStableDeviceRescueTest-1096111935-project-member</nova:user>
Jul 31 14:48:23 user nova-compute[72239]:         <nova:project uuid="48e59830ca9e40718341c3f2b0375af0">tempest-ServerStableDeviceRescueTest-1096111935</nova:project>
Jul 31 14:48:23 user nova-compute[72239]:       </nova:owner>
Jul 31 14:48:23 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:48:23 user nova-compute[72239]:       <nova:ports>
Jul 31 14:48:23 user nova-compute[72239]:         <nova:port uuid="60c1bdaa-524e-41da-96d7-56c77f959c71">
Jul 31 14:48:23 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 31 14:48:23 user nova-compute[72239]:         </nova:port>
Jul 31 14:48:23 user nova-compute[72239]:       </nova:ports>
Jul 31 14:48:23 user nova-compute[72239]:     </nova:instance>
Jul 31 14:48:23 user nova-compute[72239]:   </metadata>
Jul 31 14:48:23 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:48:23 user nova-compute[72239]:     <system>
Jul 31 14:48:23 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:48:23 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:48:23 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:48:23 user nova-compute[72239]:       <entry name="serial">97917500-bc78-433b-8d3d-181ed13667dc</entry>
Jul 31 14:48:23 user nova-compute[72239]:       <entry name="uuid">97917500-bc78-433b-8d3d-181ed13667dc</entry>
Jul 31 14:48:23 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:48:23 user nova-compute[72239]:     </system>
Jul 31 14:48:23 user nova-compute[72239]:   </sysinfo>
Jul 31 14:48:23 user nova-compute[72239]:   <os>
Jul 31 14:48:23 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:48:23 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:48:23 user nova-compute[72239]:   </os>
Jul 31 14:48:23 user nova-compute[72239]:   <features>
Jul 31 14:48:23 user nova-compute[72239]:     <acpi/>
Jul 31 14:48:23 user nova-compute[72239]:     <apic/>
Jul 31 14:48:23 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:48:23 user nova-compute[72239]:   </features>
Jul 31 14:48:23 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:48:23 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:48:23 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:48:23 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:48:23 user nova-compute[72239]:   </clock>
Jul 31 14:48:23 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:48:23 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:48:23 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:48:23 user nova-compute[72239]:   </cpu>
Jul 31 14:48:23 user nova-compute[72239]:   <devices>
Jul 31 14:48:23 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:48:23 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:48:23 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk"/>
Jul 31 14:48:23 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:48:23 user nova-compute[72239]:     </disk>
Jul 31 14:48:23 user nova-compute[72239]:     <disk type="block" device="disk">
Jul 31 14:48:23 user nova-compute[72239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:48:23 user nova-compute[72239]:       <source dev="/dev/sdc"/>
Jul 31 14:48:23 user nova-compute[72239]:       <target dev="vdb" bus="virtio"/>
Jul 31 14:48:23 user nova-compute[72239]:       <serial>8aa94ef5-0195-46eb-875d-acb827d145a9</serial>
Jul 31 14:48:23 user nova-compute[72239]:     </disk>
Jul 31 14:48:23 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:48:23 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:48:23 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk.rescue"/>
Jul 31 14:48:23 user nova-compute[72239]:       <target dev="vdc" bus="virtio"/>
Jul 31 14:48:23 user nova-compute[72239]:       <boot order="1"/>
Jul 31 14:48:23 user nova-compute[72239]:     </disk>
Jul 31 14:48:23 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:48:23 user nova-compute[72239]:       <mac address="fa:16:3e:a4:5f:0e"/>
Jul 31 14:48:23 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:48:23 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:48:23 user nova-compute[72239]:       <target dev="tap60c1bdaa-52"/>
Jul 31 14:48:23 user nova-compute[72239]:     </interface>
Jul 31 14:48:23 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:48:23 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/console.log" append="off"/>
Jul 31 14:48:23 user nova-compute[72239]:     </serial>
Jul 31 14:48:23 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:48:23 user nova-compute[72239]:     <video>
Jul 31 14:48:23 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:48:23 user nova-compute[72239]:     </video>
Jul 31 14:48:23 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:48:23 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:48:23 user nova-compute[72239]:     </rng>
Jul 31 14:48:23 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:48:23 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:48:23 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:48:23 user nova-compute[72239]:     </memballoon>
Jul 31 14:48:23 user nova-compute[72239]:   </devices>
Jul 31 14:48:23 user nova-compute[72239]: </domain>
Jul 31 14:48:23 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:48:23 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Instance destroyed successfully.
Jul 31 14:48:23 user nova-compute[72239]: DEBUG nova.network.neutron [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Port d6ef6541-6b7e-4dc5-8149-a10940dfe87b binding to destination host user is already ACTIVE {{(pid=72239) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] No VIF found with MAC fa:16:3e:a4:5f:0e, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Acquiring lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Acquiring lock "refresh_cache-d3e3612b-c6b9-4308-a45a-1ff3805e18bb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:48:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Acquired lock "refresh_cache-d3e3612b-c6b9-4308-a45a-1ff3805e18bb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:48:24 user nova-compute[72239]: DEBUG nova.network.neutron [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:48:24 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:24 user nova-compute[72239]: DEBUG nova.network.neutron [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Updating instance_info_cache with network_info: [{"id": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "address": "fa:16:3e:f4:8d:da", "network": {"id": "ad1d78ca-d597-4586-8b1b-4dc00fac3c3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-398965992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "506aad3c95a94800a4cc333a3478da17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ef6541-6b", "ovs_interfaceid": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:48:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Releasing lock "refresh_cache-d3e3612b-c6b9-4308-a45a-1ff3805e18bb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:48:24 user nova-compute[72239]: DEBUG os_brick.utils [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:48:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:24 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bca67437-b4cb-466b-bd92-51627863aa0f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:24 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7224a0-b6f4-4753-937a-ff256392ed83]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:24 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f63b5f92-e7b7-4364-b234-fbca91d1c9b4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:24 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a2959d-959d-41d9-8a35-1ceb28213956]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:48:24 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 14:48:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:48:24 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 14:48:24 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4792b63-e669-463d-9880-c04a96034f54]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:24 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 14:48:24 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 14:48:24 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 14:48:24 user nova-compute[72239]: DEBUG os_brick.utils [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:48:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:25 user nova-compute[72239]: DEBUG nova.compute.manager [req-f05c714a-c993-4196-b418-58e88762f7a0 req-07ec4700-4bc7-416a-83d2-87f141a1bdfa service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Received event network-vif-plugged-60c1bdaa-524e-41da-96d7-56c77f959c71 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:48:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-f05c714a-c993-4196-b418-58e88762f7a0 req-07ec4700-4bc7-416a-83d2-87f141a1bdfa service nova] Acquiring lock "97917500-bc78-433b-8d3d-181ed13667dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-f05c714a-c993-4196-b418-58e88762f7a0 req-07ec4700-4bc7-416a-83d2-87f141a1bdfa service nova] Lock "97917500-bc78-433b-8d3d-181ed13667dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-f05c714a-c993-4196-b418-58e88762f7a0 req-07ec4700-4bc7-416a-83d2-87f141a1bdfa service nova] Lock "97917500-bc78-433b-8d3d-181ed13667dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:25 user nova-compute[72239]: DEBUG nova.compute.manager [req-f05c714a-c993-4196-b418-58e88762f7a0 req-07ec4700-4bc7-416a-83d2-87f141a1bdfa service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] No waiting events found dispatching network-vif-plugged-60c1bdaa-524e-41da-96d7-56c77f959c71 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:48:25 user nova-compute[72239]: WARNING nova.compute.manager [req-f05c714a-c993-4196-b418-58e88762f7a0 req-07ec4700-4bc7-416a-83d2-87f141a1bdfa service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Received unexpected event network-vif-plugged-60c1bdaa-524e-41da-96d7-56c77f959c71 for instance with vm_state active and task_state rescuing.
Jul 31 14:48:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d273ffa7-6a19-4179-bdf1-8d0bf26a0e93 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Acquiring lock "f011c736-1a43-4b0e-ac7c-d512bcaa9bdc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d273ffa7-6a19-4179-bdf1-8d0bf26a0e93 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Lock "f011c736-1a43-4b0e-ac7c-d512bcaa9bdc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d273ffa7-6a19-4179-bdf1-8d0bf26a0e93 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Acquiring lock "f011c736-1a43-4b0e-ac7c-d512bcaa9bdc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d273ffa7-6a19-4179-bdf1-8d0bf26a0e93 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Lock "f011c736-1a43-4b0e-ac7c-d512bcaa9bdc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d273ffa7-6a19-4179-bdf1-8d0bf26a0e93 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Lock "f011c736-1a43-4b0e-ac7c-d512bcaa9bdc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:25 user nova-compute[72239]: INFO nova.compute.manager [None req-d273ffa7-6a19-4179-bdf1-8d0bf26a0e93 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Terminating instance
Jul 31 14:48:25 user nova-compute[72239]: DEBUG nova.compute.manager [None req-d273ffa7-6a19-4179-bdf1-8d0bf26a0e93 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 14:48:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:26 user nova-compute[72239]: DEBUG nova.compute.manager [req-95ae003d-5bef-446e-aa7d-cb606676595f req-27426835-ae07-467b-bd13-9a2f94dd66ea service nova] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Received event network-vif-unplugged-8953e4f0-db77-497e-884b-2521c5b7d385 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:48:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-95ae003d-5bef-446e-aa7d-cb606676595f req-27426835-ae07-467b-bd13-9a2f94dd66ea service nova] Acquiring lock "f011c736-1a43-4b0e-ac7c-d512bcaa9bdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-95ae003d-5bef-446e-aa7d-cb606676595f req-27426835-ae07-467b-bd13-9a2f94dd66ea service nova] Lock "f011c736-1a43-4b0e-ac7c-d512bcaa9bdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-95ae003d-5bef-446e-aa7d-cb606676595f req-27426835-ae07-467b-bd13-9a2f94dd66ea service nova] Lock "f011c736-1a43-4b0e-ac7c-d512bcaa9bdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:26 user nova-compute[72239]: DEBUG nova.compute.manager [req-95ae003d-5bef-446e-aa7d-cb606676595f req-27426835-ae07-467b-bd13-9a2f94dd66ea service nova] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] No waiting events found dispatching network-vif-unplugged-8953e4f0-db77-497e-884b-2521c5b7d385 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:48:26 user nova-compute[72239]: DEBUG nova.compute.manager [req-95ae003d-5bef-446e-aa7d-cb606676595f req-27426835-ae07-467b-bd13-9a2f94dd66ea service nova] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Received event network-vif-unplugged-8953e4f0-db77-497e-884b-2521c5b7d385 for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 14:48:26 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Instance destroyed successfully.
Jul 31 14:48:26 user nova-compute[72239]: DEBUG nova.objects.instance [None req-d273ffa7-6a19-4179-bdf1-8d0bf26a0e93 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Lazy-loading 'resources' on Instance uuid f011c736-1a43-4b0e-ac7c-d512bcaa9bdc {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:48:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-d273ffa7-6a19-4179-bdf1-8d0bf26a0e93 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:44:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-216023446',display_name='tempest-TestVolumeSwap-server-216023446',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-216023446',id=10,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNaOhmM1Va6nh7Nv4Vm3OZbOciQpdA+BT91UbsFfXxRqNmQEZAMYPsHEDPa0NGylj6Hsnwtd4O81RXTXSoxTFCTi3ceGdlehvSLPdcgy4blLp+L2hjG0Mboa553J7dRtGA==',key_name='tempest-keypair-1203809248',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:45:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6ec2ff6a04934b24973a97b4cde3af01',ramdisk_id='',reservation_id='r-tkeyjhaq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-997241221',owner_user_name='tempest-TestVolumeSwap-997241221-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:45:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='28d77037a8964b7f8f443ca00c82cd76',uuid=f011c736-1a43-4b0e-ac7c-d512bcaa9bdc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8953e4f0-db77-497e-884b-2521c5b7d385", "address": "fa:16:3e:57:47:b5", "network": {"id": "3adf6b2e-86b8-4345-af2a-0d45f9d2c77b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-869289263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec2ff6a04934b24973a97b4cde3af01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8953e4f0-db", "ovs_interfaceid": "8953e4f0-db77-497e-884b-2521c5b7d385", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:48:26 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-d273ffa7-6a19-4179-bdf1-8d0bf26a0e93 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Converting VIF {"id": "8953e4f0-db77-497e-884b-2521c5b7d385", "address": "fa:16:3e:57:47:b5", "network": {"id": "3adf6b2e-86b8-4345-af2a-0d45f9d2c77b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-869289263-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6ec2ff6a04934b24973a97b4cde3af01", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8953e4f0-db", "ovs_interfaceid": "8953e4f0-db77-497e-884b-2521c5b7d385", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:48:26 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-d273ffa7-6a19-4179-bdf1-8d0bf26a0e93 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:47:b5,bridge_name='br-int',has_traffic_filtering=True,id=8953e4f0-db77-497e-884b-2521c5b7d385,network=Network(3adf6b2e-86b8-4345-af2a-0d45f9d2c77b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8953e4f0-db') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:48:26 user nova-compute[72239]: DEBUG os_vif [None req-d273ffa7-6a19-4179-bdf1-8d0bf26a0e93 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:47:b5,bridge_name='br-int',has_traffic_filtering=True,id=8953e4f0-db77-497e-884b-2521c5b7d385,network=Network(3adf6b2e-86b8-4345-af2a-0d45f9d2c77b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8953e4f0-db') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:48:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8953e4f0-db, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:48:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:48:26 user nova-compute[72239]: INFO os_vif [None req-d273ffa7-6a19-4179-bdf1-8d0bf26a0e93 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:47:b5,bridge_name='br-int',has_traffic_filtering=True,id=8953e4f0-db77-497e-884b-2521c5b7d385,network=Network(3adf6b2e-86b8-4345-af2a-0d45f9d2c77b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8953e4f0-db')
Jul 31 14:48:26 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-d273ffa7-6a19-4179-bdf1-8d0bf26a0e93 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Deleting instance files /opt/stack/data/nova/instances/f011c736-1a43-4b0e-ac7c-d512bcaa9bdc_del
Jul 31 14:48:26 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-d273ffa7-6a19-4179-bdf1-8d0bf26a0e93 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Deletion of /opt/stack/data/nova/instances/f011c736-1a43-4b0e-ac7c-d512bcaa9bdc_del complete
Jul 31 14:48:26 user nova-compute[72239]: INFO nova.compute.manager [None req-d273ffa7-6a19-4179-bdf1-8d0bf26a0e93 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Took 0.94 seconds to destroy the instance on the hypervisor.
Jul 31 14:48:26 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-d273ffa7-6a19-4179-bdf1-8d0bf26a0e93 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 14:48:26 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 14:48:26 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 14:48:27 user nova-compute[72239]: DEBUG nova.compute.manager [req-70240903-b60b-4d73-a470-730b70a7a36c req-8f3c5d34-ce16-4620-89a9-fd7bd91d348d service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Received event network-vif-plugged-60c1bdaa-524e-41da-96d7-56c77f959c71 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:48:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-70240903-b60b-4d73-a470-730b70a7a36c req-8f3c5d34-ce16-4620-89a9-fd7bd91d348d service nova] Acquiring lock "97917500-bc78-433b-8d3d-181ed13667dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-70240903-b60b-4d73-a470-730b70a7a36c req-8f3c5d34-ce16-4620-89a9-fd7bd91d348d service nova] Lock "97917500-bc78-433b-8d3d-181ed13667dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-70240903-b60b-4d73-a470-730b70a7a36c req-8f3c5d34-ce16-4620-89a9-fd7bd91d348d service nova] Lock "97917500-bc78-433b-8d3d-181ed13667dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:27 user nova-compute[72239]: DEBUG nova.compute.manager [req-70240903-b60b-4d73-a470-730b70a7a36c req-8f3c5d34-ce16-4620-89a9-fd7bd91d348d service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] No waiting events found dispatching network-vif-plugged-60c1bdaa-524e-41da-96d7-56c77f959c71 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:48:27 user nova-compute[72239]: WARNING nova.compute.manager [req-70240903-b60b-4d73-a470-730b70a7a36c req-8f3c5d34-ce16-4620-89a9-fd7bd91d348d service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Received unexpected event network-vif-plugged-60c1bdaa-524e-41da-96d7-56c77f959c71 for instance with vm_state active and task_state rescuing.
Jul 31 14:48:27 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:48:27 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Took 0.91 seconds to deallocate network for instance.
Jul 31 14:48:27 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Removed pending event for 97917500-bc78-433b-8d3d-181ed13667dc due to event {{(pid=72239) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 14:48:27 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814907.74986, 97917500-bc78-433b-8d3d-181ed13667dc => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:48:27 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] VM Resumed (Lifecycle Event)
Jul 31 14:48:27 user nova-compute[72239]: DEBUG nova.compute.manager [None req-ac652f86-41cc-49ec-8064-b69fa5014090 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:48:27 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:48:27 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:48:27 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 31 14:48:27 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814907.751241, 97917500-bc78-433b-8d3d-181ed13667dc => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:48:27 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] VM Started (Lifecycle Event)
Jul 31 14:48:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d273ffa7-6a19-4179-bdf1-8d0bf26a0e93 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d273ffa7-6a19-4179-bdf1-8d0bf26a0e93 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:27 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:48:27 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:48:28 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-d273ffa7-6a19-4179-bdf1-8d0bf26a0e93 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:48:28 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-d273ffa7-6a19-4179-bdf1-8d0bf26a0e93 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:48:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d273ffa7-6a19-4179-bdf1-8d0bf26a0e93 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.460s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:28 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-d273ffa7-6a19-4179-bdf1-8d0bf26a0e93 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Deleted allocations for instance f011c736-1a43-4b0e-ac7c-d512bcaa9bdc
Jul 31 14:48:28 user nova-compute[72239]: DEBUG nova.compute.manager [req-dc08ba51-3e40-4b08-bb09-4b07e1dfceba req-b8e976bd-6a45-4e65-bca8-849549b75908 service nova] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Received event network-vif-plugged-8953e4f0-db77-497e-884b-2521c5b7d385 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:48:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-dc08ba51-3e40-4b08-bb09-4b07e1dfceba req-b8e976bd-6a45-4e65-bca8-849549b75908 service nova] Acquiring lock "f011c736-1a43-4b0e-ac7c-d512bcaa9bdc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-dc08ba51-3e40-4b08-bb09-4b07e1dfceba req-b8e976bd-6a45-4e65-bca8-849549b75908 service nova] Lock "f011c736-1a43-4b0e-ac7c-d512bcaa9bdc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-dc08ba51-3e40-4b08-bb09-4b07e1dfceba req-b8e976bd-6a45-4e65-bca8-849549b75908 service nova] Lock "f011c736-1a43-4b0e-ac7c-d512bcaa9bdc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:28 user nova-compute[72239]: DEBUG nova.compute.manager [req-dc08ba51-3e40-4b08-bb09-4b07e1dfceba req-b8e976bd-6a45-4e65-bca8-849549b75908 service nova] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] No waiting events found dispatching network-vif-plugged-8953e4f0-db77-497e-884b-2521c5b7d385 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:48:28 user nova-compute[72239]: WARNING nova.compute.manager [req-dc08ba51-3e40-4b08-bb09-4b07e1dfceba req-b8e976bd-6a45-4e65-bca8-849549b75908 service nova] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Received unexpected event network-vif-plugged-8953e4f0-db77-497e-884b-2521c5b7d385 for instance with vm_state deleted and task_state None.
Jul 31 14:48:28 user nova-compute[72239]: DEBUG nova.compute.manager [req-dc08ba51-3e40-4b08-bb09-4b07e1dfceba req-b8e976bd-6a45-4e65-bca8-849549b75908 service nova] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Received event network-vif-deleted-8953e4f0-db77-497e-884b-2521c5b7d385 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:48:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d273ffa7-6a19-4179-bdf1-8d0bf26a0e93 tempest-TestVolumeSwap-997241221 tempest-TestVolumeSwap-997241221-project-member] Lock "f011c736-1a43-4b0e-ac7c-d512bcaa9bdc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.559s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:31 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:34 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690814899.4243715, d3e3612b-c6b9-4308-a45a-1ff3805e18bb => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:48:34 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] VM Stopped (Lifecycle Event)
Jul 31 14:48:34 user nova-compute[72239]: DEBUG nova.compute.manager [None req-99b21749-6149-4222-9fa8-0d023efb785d None None] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:48:34 user nova-compute[72239]: DEBUG nova.compute.manager [None req-99b21749-6149-4222-9fa8-0d023efb785d None None] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:48:34 user nova-compute[72239]: INFO nova.compute.manager [None req-99b21749-6149-4222-9fa8-0d023efb785d None None] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 31 14:48:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:36 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:41 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690814906.69235, f011c736-1a43-4b0e-ac7c-d512bcaa9bdc => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:48:41 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] VM Stopped (Lifecycle Event)
Jul 31 14:48:41 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:41 user nova-compute[72239]: DEBUG nova.compute.manager [None req-732cf989-494c-4b36-8424-149fcc166262 None None] [instance: f011c736-1a43-4b0e-ac7c-d512bcaa9bdc] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Starting finish_migration {{(pid=72239) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Instance directory exists: not creating {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 31 14:48:42 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Creating image(s)
Jul 31 14:48:42 user nova-compute[72239]: DEBUG nova.objects.instance [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lazy-loading 'trusted_certs' on Instance uuid d3e3612b-c6b9-4308-a45a-1ff3805e18bb {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.162s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk. size=21474836480 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk 21474836480 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk 21474836480" returned: 0 in 0.062s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Did not create local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Ensure instance console log exists: /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Start _get_guest_xml network_info=[{"id": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "address": "fa:16:3e:f4:8d:da", "network": {"id": "ad1d78ca-d597-4586-8b1b-4dc00fac3c3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-398965992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-398965992-network", "vif_mac": "fa:16:3e:f4:8d:da"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "506aad3c95a94800a4cc333a3478da17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ef6541-6b", "ovs_interfaceid": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': 'dce23264-b08c-46de-8b01-994f41beea5b', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PjhAmCqu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'd3e3612b-c6b9-4308-a45a-1ff3805e18bb', 'attached_at': '2023-07-31T14:48:42.000000', 'detached_at': '', 'volume_id': '0442beb2-94e8-445b-b688-af66bd23814f', 'serial': '0442beb2-94e8-445b-b688-af66bd23814f'}, 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:48:42 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:48:42 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:48:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG nova.objects.instance [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lazy-loading 'vcpu_model' on Instance uuid d3e3612b-c6b9-4308-a45a-1ff3805e18bb {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PjhAmCqu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:48:42 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:48:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:48:42 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:48:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:48:42 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 14:48:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b02d19f-394a-46e0-9669-e9f57f541b3f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 14:48:42 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[07c3ad1b-d4e7-48f2-b9c0-d46bbcf2a3d8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f] added
Jul 31 14:48:42 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a068003-cb2a-41fc-96db-bdb0a8c6b91c]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad129509-fd23-4d76-ace0-2b3735c23ea0]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PjhAmCqu {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PjhAmCqu" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4623b4-8be5-4873-934d-efb0e6dcb867]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PjhAmCqu'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[424201ca-5d4d-41ba-9a23-0126df364074]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37412c0-9b3a-4590-bffc-0ebc31563cf7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:48:42 user nova-compute[72239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)
Jul 31 14:48:42 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:48:42 user nova-compute[72239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)
Jul 31 14:48:42 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc464628-d93f-4bf6-bfc1-e5fb5d18d724]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f, portal: 172.16.0.220,3260]
Jul 31 14:48:42 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f, portal: 172.16.0.220,3260] successful.
Jul 31 14:48:42 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f89b56-1955-47e4-86a4-d032e7b4c6ed]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0183679a-d649-4d05-9d8e-a5244b472032]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:48:42 user nova-compute[72239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)
Jul 31 14:48:42 user nova-compute[72239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:48:42 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:48:42 user nova-compute[72239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)
Jul 31 14:48:42 user nova-compute[72239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:48:42 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:48:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.312s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:48:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 14:48:43 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 14:48:43 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 14:48:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:43 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a479b969-bea3-4dc1-9fb2-82b045d12904]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:43 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:48:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PjhAmCqu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 14:48:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:44 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:48:44 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23762643838376331', 'path': '/dev/sdb'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:48:44 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762643838376331', 'path': '/dev/sdb'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 14:48:44 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:44:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-704430368',display_name='tempest-ServerActionsTestOtherB-server-704430368',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-704430368',id=5,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMAieHq8I0ZAPg3BJdF9GCCYAxcsl1TuUTZpA9U0PVBIFwXLp4luFdF9A4kOklr7N7b3+Doyb1i/MuF4moMlBsM1nlQtqnIuFR3yVshdpPI3XQmqmueJHWFXMGjAp573g==',key_name='tempest-keypair-1046174319',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:44:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='506aad3c95a94800a4cc333a3478da17',ramdisk_id='',reservation_id='r-rcs9kimd',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-858495710',owner_user_name='tempest-ServerActionsTestOtherB-858495710-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:48:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c92e1d7e3b944359fcbf9475dcacef0',uuid=d3e3612b-c6b9-4308-a45a-1ff3805e18bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "address": "fa:16:3e:f4:8d:da", "network": {"id": "ad1d78ca-d597-4586-8b1b-4dc00fac3c3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-398965992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-398965992-network", "vif_mac": "fa:16:3e:f4:8d:da"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "506aad3c95a94800a4cc333a3478da17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ef6541-6b", "ovs_interfaceid": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:48:44 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Converting VIF {"id": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "address": "fa:16:3e:f4:8d:da", "network": {"id": "ad1d78ca-d597-4586-8b1b-4dc00fac3c3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-398965992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-398965992-network", "vif_mac": "fa:16:3e:f4:8d:da"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "506aad3c95a94800a4cc333a3478da17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ef6541-6b", "ovs_interfaceid": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:48:44 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:8d:da,bridge_name='br-int',has_traffic_filtering=True,id=d6ef6541-6b7e-4dc5-8149-a10940dfe87b,network=Network(ad1d78ca-d597-4586-8b1b-4dc00fac3c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ef6541-6b') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:48:44 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:48:44 user nova-compute[72239]:   <uuid>d3e3612b-c6b9-4308-a45a-1ff3805e18bb</uuid>
Jul 31 14:48:44 user nova-compute[72239]:   <name>instance-00000005</name>
Jul 31 14:48:44 user nova-compute[72239]:   <memory>2097152</memory>
Jul 31 14:48:44 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:48:44 user nova-compute[72239]:   <metadata>
Jul 31 14:48:44 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:48:44 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:48:44 user nova-compute[72239]:       <nova:name>tempest-ServerActionsTestOtherB-server-704430368</nova:name>
Jul 31 14:48:44 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:48:42</nova:creationTime>
Jul 31 14:48:44 user nova-compute[72239]:       <nova:flavor name="m1.small">
Jul 31 14:48:44 user nova-compute[72239]:         <nova:memory>2048</nova:memory>
Jul 31 14:48:44 user nova-compute[72239]:         <nova:disk>20</nova:disk>
Jul 31 14:48:44 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:48:44 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:48:44 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:48:44 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:48:44 user nova-compute[72239]:       <nova:owner>
Jul 31 14:48:44 user nova-compute[72239]:         <nova:user uuid="7c92e1d7e3b944359fcbf9475dcacef0">tempest-ServerActionsTestOtherB-858495710-project-member</nova:user>
Jul 31 14:48:44 user nova-compute[72239]:         <nova:project uuid="506aad3c95a94800a4cc333a3478da17">tempest-ServerActionsTestOtherB-858495710</nova:project>
Jul 31 14:48:44 user nova-compute[72239]:       </nova:owner>
Jul 31 14:48:44 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:48:44 user nova-compute[72239]:       <nova:ports>
Jul 31 14:48:44 user nova-compute[72239]:         <nova:port uuid="d6ef6541-6b7e-4dc5-8149-a10940dfe87b">
Jul 31 14:48:44 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 31 14:48:44 user nova-compute[72239]:         </nova:port>
Jul 31 14:48:44 user nova-compute[72239]:       </nova:ports>
Jul 31 14:48:44 user nova-compute[72239]:     </nova:instance>
Jul 31 14:48:44 user nova-compute[72239]:   </metadata>
Jul 31 14:48:44 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:48:44 user nova-compute[72239]:     <system>
Jul 31 14:48:44 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:48:44 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:48:44 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:48:44 user nova-compute[72239]:       <entry name="serial">d3e3612b-c6b9-4308-a45a-1ff3805e18bb</entry>
Jul 31 14:48:44 user nova-compute[72239]:       <entry name="uuid">d3e3612b-c6b9-4308-a45a-1ff3805e18bb</entry>
Jul 31 14:48:44 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:48:44 user nova-compute[72239]:     </system>
Jul 31 14:48:44 user nova-compute[72239]:   </sysinfo>
Jul 31 14:48:44 user nova-compute[72239]:   <os>
Jul 31 14:48:44 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:48:44 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:48:44 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:48:44 user nova-compute[72239]:   </os>
Jul 31 14:48:44 user nova-compute[72239]:   <features>
Jul 31 14:48:44 user nova-compute[72239]:     <acpi/>
Jul 31 14:48:44 user nova-compute[72239]:     <apic/>
Jul 31 14:48:44 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:48:44 user nova-compute[72239]:   </features>
Jul 31 14:48:44 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:48:44 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:48:44 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:48:44 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:48:44 user nova-compute[72239]:   </clock>
Jul 31 14:48:44 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:48:44 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:48:44 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:48:44 user nova-compute[72239]:   </cpu>
Jul 31 14:48:44 user nova-compute[72239]:   <devices>
Jul 31 14:48:44 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:48:44 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:48:44 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk"/>
Jul 31 14:48:44 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:48:44 user nova-compute[72239]:     </disk>
Jul 31 14:48:44 user nova-compute[72239]:     <disk type="block" device="disk">
Jul 31 14:48:44 user nova-compute[72239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:48:44 user nova-compute[72239]:       <source dev="/dev/sdb"/>
Jul 31 14:48:44 user nova-compute[72239]:       <target dev="vdb" bus="virtio"/>
Jul 31 14:48:44 user nova-compute[72239]:       <serial>0442beb2-94e8-445b-b688-af66bd23814f</serial>
Jul 31 14:48:44 user nova-compute[72239]:     </disk>
Jul 31 14:48:44 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:48:44 user nova-compute[72239]:       <mac address="fa:16:3e:f4:8d:da"/>
Jul 31 14:48:44 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:48:44 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:48:44 user nova-compute[72239]:       <target dev="tapd6ef6541-6b"/>
Jul 31 14:48:44 user nova-compute[72239]:     </interface>
Jul 31 14:48:44 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:48:44 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/console.log" append="off"/>
Jul 31 14:48:44 user nova-compute[72239]:     </serial>
Jul 31 14:48:44 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:48:44 user nova-compute[72239]:     <video>
Jul 31 14:48:44 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:48:44 user nova-compute[72239]:     </video>
Jul 31 14:48:44 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:48:44 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:48:44 user nova-compute[72239]:     </rng>
Jul 31 14:48:44 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:48:44 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:48:44 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:48:44 user nova-compute[72239]:     </memballoon>
Jul 31 14:48:44 user nova-compute[72239]:   </devices>
Jul 31 14:48:44 user nova-compute[72239]: </domain>
Jul 31 14:48:44 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:48:44 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:44:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-704430368',display_name='tempest-ServerActionsTestOtherB-server-704430368',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-704430368',id=5,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMAieHq8I0ZAPg3BJdF9GCCYAxcsl1TuUTZpA9U0PVBIFwXLp4luFdF9A4kOklr7N7b3+Doyb1i/MuF4moMlBsM1nlQtqnIuFR3yVshdpPI3XQmqmueJHWFXMGjAp573g==',key_name='tempest-keypair-1046174319',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:44:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='506aad3c95a94800a4cc333a3478da17',ramdisk_id='',reservation_id='r-rcs9kimd',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-858495710',owner_user_name='tempest-ServerActionsTestOtherB-858495710-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:48:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c92e1d7e3b944359fcbf9475dcacef0',uuid=d3e3612b-c6b9-4308-a45a-1ff3805e18bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "address": "fa:16:3e:f4:8d:da", "network": {"id": "ad1d78ca-d597-4586-8b1b-4dc00fac3c3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-398965992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-398965992-network", "vif_mac": "fa:16:3e:f4:8d:da"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "506aad3c95a94800a4cc333a3478da17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ef6541-6b", "ovs_interfaceid": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:48:44 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Converting VIF {"id": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "address": "fa:16:3e:f4:8d:da", "network": {"id": "ad1d78ca-d597-4586-8b1b-4dc00fac3c3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-398965992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-398965992-network", "vif_mac": "fa:16:3e:f4:8d:da"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "506aad3c95a94800a4cc333a3478da17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ef6541-6b", "ovs_interfaceid": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:48:44 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:8d:da,bridge_name='br-int',has_traffic_filtering=True,id=d6ef6541-6b7e-4dc5-8149-a10940dfe87b,network=Network(ad1d78ca-d597-4586-8b1b-4dc00fac3c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ef6541-6b') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:48:44 user nova-compute[72239]: DEBUG os_vif [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:8d:da,bridge_name='br-int',has_traffic_filtering=True,id=d6ef6541-6b7e-4dc5-8149-a10940dfe87b,network=Network(ad1d78ca-d597-4586-8b1b-4dc00fac3c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ef6541-6b') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:48:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:48:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:48:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6ef6541-6b, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:48:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd6ef6541-6b, col_values=(('external_ids', {'iface-id': 'd6ef6541-6b7e-4dc5-8149-a10940dfe87b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:8d:da', 'vm-uuid': 'd3e3612b-c6b9-4308-a45a-1ff3805e18bb'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:48:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:48:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:44 user nova-compute[72239]: INFO os_vif [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:8d:da,bridge_name='br-int',has_traffic_filtering=True,id=d6ef6541-6b7e-4dc5-8149-a10940dfe87b,network=Network(ad1d78ca-d597-4586-8b1b-4dc00fac3c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ef6541-6b')
Jul 31 14:48:44 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:48:44 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:48:44 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] No VIF found with MAC fa:16:3e:f4:8d:da, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:48:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:45 user nova-compute[72239]: INFO nova.compute.manager [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Rescuing
Jul 31 14:48:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "refresh_cache-2f11022e-a007-4d4c-adc1-b54ea59b9e6a" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:48:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquired lock "refresh_cache-2f11022e-a007-4d4c-adc1-b54ea59b9e6a" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:48:45 user nova-compute[72239]: DEBUG nova.network.neutron [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:48:46 user nova-compute[72239]: DEBUG nova.compute.manager [req-f1a4d509-ecb0-4482-8440-1b320454d37f req-a40048cd-511c-4b79-8f6d-141d3d585d72 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Received event network-vif-plugged-d6ef6541-6b7e-4dc5-8149-a10940dfe87b {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:48:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-f1a4d509-ecb0-4482-8440-1b320454d37f req-a40048cd-511c-4b79-8f6d-141d3d585d72 service nova] Acquiring lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-f1a4d509-ecb0-4482-8440-1b320454d37f req-a40048cd-511c-4b79-8f6d-141d3d585d72 service nova] Lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-f1a4d509-ecb0-4482-8440-1b320454d37f req-a40048cd-511c-4b79-8f6d-141d3d585d72 service nova] Lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:46 user nova-compute[72239]: DEBUG nova.compute.manager [req-f1a4d509-ecb0-4482-8440-1b320454d37f req-a40048cd-511c-4b79-8f6d-141d3d585d72 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] No waiting events found dispatching network-vif-plugged-d6ef6541-6b7e-4dc5-8149-a10940dfe87b {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:48:46 user nova-compute[72239]: WARNING nova.compute.manager [req-f1a4d509-ecb0-4482-8440-1b320454d37f req-a40048cd-511c-4b79-8f6d-141d3d585d72 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Received unexpected event network-vif-plugged-d6ef6541-6b7e-4dc5-8149-a10940dfe87b for instance with vm_state active and task_state resize_finish.
Jul 31 14:48:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:46 user nova-compute[72239]: DEBUG nova.network.neutron [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Updating instance_info_cache with network_info: [{"id": "91cadad3-732b-4fed-af92-b54692837973", "address": "fa:16:3e:44:72:66", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91cadad3-73", "ovs_interfaceid": "91cadad3-732b-4fed-af92-b54692837973", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:48:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Releasing lock "refresh_cache-2f11022e-a007-4d4c-adc1-b54ea59b9e6a" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:48:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:47 user nova-compute[72239]: DEBUG nova.compute.manager [req-e77e2d71-bb4b-4cc1-8ff1-ba33671e4afc req-db8a6f9e-6247-483a-83d9-5e3ed95e25fa service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Received event network-vif-unplugged-91cadad3-732b-4fed-af92-b54692837973 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:48:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e77e2d71-bb4b-4cc1-8ff1-ba33671e4afc req-db8a6f9e-6247-483a-83d9-5e3ed95e25fa service nova] Acquiring lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e77e2d71-bb4b-4cc1-8ff1-ba33671e4afc req-db8a6f9e-6247-483a-83d9-5e3ed95e25fa service nova] Lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e77e2d71-bb4b-4cc1-8ff1-ba33671e4afc req-db8a6f9e-6247-483a-83d9-5e3ed95e25fa service nova] Lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:47 user nova-compute[72239]: DEBUG nova.compute.manager [req-e77e2d71-bb4b-4cc1-8ff1-ba33671e4afc req-db8a6f9e-6247-483a-83d9-5e3ed95e25fa service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] No waiting events found dispatching network-vif-unplugged-91cadad3-732b-4fed-af92-b54692837973 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:48:47 user nova-compute[72239]: WARNING nova.compute.manager [req-e77e2d71-bb4b-4cc1-8ff1-ba33671e4afc req-db8a6f9e-6247-483a-83d9-5e3ed95e25fa service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Received unexpected event network-vif-unplugged-91cadad3-732b-4fed-af92-b54692837973 for instance with vm_state active and task_state rescuing.
Jul 31 14:48:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:47 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Instance destroyed successfully.
Jul 31 14:48:47 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Attempting a stable device rescue
Jul 31 14:48:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72239) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 31 14:48:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Instance directory exists: not creating {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 31 14:48:47 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Creating image(s)
Jul 31 14:48:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "/opt/stack/data/nova/instances/2f11022e-a007-4d4c-adc1-b54ea59b9e6a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "/opt/stack/data/nova/instances/2f11022e-a007-4d4c-adc1-b54ea59b9e6a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "/opt/stack/data/nova/instances/2f11022e-a007-4d4c-adc1-b54ea59b9e6a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:47 user nova-compute[72239]: DEBUG nova.objects.instance [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2f11022e-a007-4d4c-adc1-b54ea59b9e6a {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:48:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "201ece8ced2ef3abbd210bc15f164f5740216de2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "201ece8ced2ef3abbd210bc15f164f5740216de2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/201ece8ced2ef3abbd210bc15f164f5740216de2.part --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:49 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814928.2331061, d3e3612b-c6b9-4308-a45a-1ff3805e18bb => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:48:49 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] VM Resumed (Lifecycle Event)
Jul 31 14:48:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:49 user nova-compute[72239]: DEBUG nova.compute.manager [req-e28b765e-c8bd-4928-ad66-12ad67953877 req-7e842d91-29ad-4372-b612-84736e625346 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Received event network-vif-plugged-d6ef6541-6b7e-4dc5-8149-a10940dfe87b {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:48:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e28b765e-c8bd-4928-ad66-12ad67953877 req-7e842d91-29ad-4372-b612-84736e625346 service nova] Acquiring lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e28b765e-c8bd-4928-ad66-12ad67953877 req-7e842d91-29ad-4372-b612-84736e625346 service nova] Lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e28b765e-c8bd-4928-ad66-12ad67953877 req-7e842d91-29ad-4372-b612-84736e625346 service nova] Lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:49 user nova-compute[72239]: DEBUG nova.compute.manager [req-e28b765e-c8bd-4928-ad66-12ad67953877 req-7e842d91-29ad-4372-b612-84736e625346 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] No waiting events found dispatching network-vif-plugged-d6ef6541-6b7e-4dc5-8149-a10940dfe87b {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:48:49 user nova-compute[72239]: WARNING nova.compute.manager [req-e28b765e-c8bd-4928-ad66-12ad67953877 req-7e842d91-29ad-4372-b612-84736e625346 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Received unexpected event network-vif-plugged-d6ef6541-6b7e-4dc5-8149-a10940dfe87b for instance with vm_state active and task_state resize_finish.
Jul 31 14:48:49 user nova-compute[72239]: DEBUG nova.compute.manager [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:48:49 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:48:49 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Instance running successfully.
Jul 31 14:48:49 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:48:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Failed to set time: agent not configured {{(pid=72239) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Jul 31 14:48:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b45f0a89-4237-47b9-8ab3-41e2102111d2 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] finish_migration finished successfully. {{(pid=72239) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Jul 31 14:48:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:49 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 31 14:48:49 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814928.2359424, d3e3612b-c6b9-4308-a45a-1ff3805e18bb => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:48:49 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] VM Started (Lifecycle Event)
Jul 31 14:48:49 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:48:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/201ece8ced2ef3abbd210bc15f164f5740216de2.part --force-share --output=json" returned: 0 in 0.455s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:49 user nova-compute[72239]: DEBUG nova.virt.images [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] cc615e16-61ec-4df7-a6ab-2bcb63c10419 was qcow2, converting to raw {{(pid=72239) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 31 14:48:49 user nova-compute[72239]: DEBUG nova.privsep.utils [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72239) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 14:48:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/201ece8ced2ef3abbd210bc15f164f5740216de2.part /opt/stack/data/nova/instances/_base/201ece8ced2ef3abbd210bc15f164f5740216de2.converted {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:49 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:48:49 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 31 14:48:49 user nova-compute[72239]: DEBUG nova.compute.manager [req-04b4a9f5-6f89-4eb1-a6c7-9341b65c2917 req-2a39276f-0b03-4e04-8824-f1c21163616c service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Received event network-vif-plugged-91cadad3-732b-4fed-af92-b54692837973 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:48:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-04b4a9f5-6f89-4eb1-a6c7-9341b65c2917 req-2a39276f-0b03-4e04-8824-f1c21163616c service nova] Acquiring lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-04b4a9f5-6f89-4eb1-a6c7-9341b65c2917 req-2a39276f-0b03-4e04-8824-f1c21163616c service nova] Lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-04b4a9f5-6f89-4eb1-a6c7-9341b65c2917 req-2a39276f-0b03-4e04-8824-f1c21163616c service nova] Lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:49 user nova-compute[72239]: DEBUG nova.compute.manager [req-04b4a9f5-6f89-4eb1-a6c7-9341b65c2917 req-2a39276f-0b03-4e04-8824-f1c21163616c service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] No waiting events found dispatching network-vif-plugged-91cadad3-732b-4fed-af92-b54692837973 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:48:49 user nova-compute[72239]: WARNING nova.compute.manager [req-04b4a9f5-6f89-4eb1-a6c7-9341b65c2917 req-2a39276f-0b03-4e04-8824-f1c21163616c service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Received unexpected event network-vif-plugged-91cadad3-732b-4fed-af92-b54692837973 for instance with vm_state active and task_state rescuing.
Jul 31 14:48:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/201ece8ced2ef3abbd210bc15f164f5740216de2.part /opt/stack/data/nova/instances/_base/201ece8ced2ef3abbd210bc15f164f5740216de2.converted" returned: 0 in 0.549s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/201ece8ced2ef3abbd210bc15f164f5740216de2.converted --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/201ece8ced2ef3abbd210bc15f164f5740216de2.converted --force-share --output=json" returned: 0 in 0.176s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "201ece8ced2ef3abbd210bc15f164f5740216de2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.067s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "201ece8ced2ef3abbd210bc15f164f5740216de2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "201ece8ced2ef3abbd210bc15f164f5740216de2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/201ece8ced2ef3abbd210bc15f164f5740216de2 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/201ece8ced2ef3abbd210bc15f164f5740216de2 --force-share --output=json" returned: 0 in 0.178s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/201ece8ced2ef3abbd210bc15f164f5740216de2,backing_fmt=raw /opt/stack/data/nova/instances/2f11022e-a007-4d4c-adc1-b54ea59b9e6a/disk.rescue {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/201ece8ced2ef3abbd210bc15f164f5740216de2,backing_fmt=raw /opt/stack/data/nova/instances/2f11022e-a007-4d4c-adc1-b54ea59b9e6a/disk.rescue" returned: 0 in 0.055s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "201ece8ced2ef3abbd210bc15f164f5740216de2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG nova.objects.instance [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lazy-loading 'migration_context' on Instance uuid 2f11022e-a007-4d4c-adc1-b54ea59b9e6a {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Start _get_guest_xml network_info=[{"id": "91cadad3-732b-4fed-af92-b54692837973", "address": "fa:16:3e:44:72:66", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "vif_mac": "fa:16:3e:44:72:66"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91cadad3-73", "ovs_interfaceid": "91cadad3-732b-4fed-af92-b54692837973", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'cc615e16-61ec-4df7-a6ab-2bcb63c10419', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'c996e11f-d179-44dc-b5f7-8a006722ccf2', 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WBpGanPy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '2f11022e-a007-4d4c-adc1-b54ea59b9e6a', 'attached_at': '', 'detached_at': '', 'volume_id': '6b6e6fc1-6c81-4d1f-92e8-ae4f930973da', 'serial': '6b6e6fc1-6c81-4d1f-92e8-ae4f930973da'}, 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG nova.objects.instance [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lazy-loading 'resources' on Instance uuid 2f11022e-a007-4d4c-adc1-b54ea59b9e6a {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG nova.objects.instance [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lazy-loading 'numa_topology' on Instance uuid 2f11022e-a007-4d4c-adc1-b54ea59b9e6a {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:48:50 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:48:50 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:48:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG nova.objects.instance [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2f11022e-a007-4d4c-adc1-b54ea59b9e6a {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WBpGanPy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:48:50 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:48:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:48:50 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:48:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:48:50 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 14:48:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da -p 172.16.0.220:3260" returned: 0 in 0.030s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0addda-1f98-4848-ab7a-bdd624db4c0b]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = WBpGanPy\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 31 14:48:50 user nova-compute[72239]: node.name = iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da
Jul 31 14:48:50 user nova-compute[72239]: node.tpgt = -1
Jul 31 14:48:50 user nova-compute[72239]: node.startup = automatic
Jul 31 14:48:50 user nova-compute[72239]: node.leading_login = No
Jul 31 14:48:50 user nova-compute[72239]: iface.iscsi_ifacename = default
Jul 31 14:48:50 user nova-compute[72239]: iface.net_ifacename = <empty>
Jul 31 14:48:50 user nova-compute[72239]: iface.ipaddress = <empty>
Jul 31 14:48:50 user nova-compute[72239]: iface.prefix_len = 0
Jul 31 14:48:50 user nova-compute[72239]: iface.hwaddress = <empty>
Jul 31 14:48:50 user nova-compute[72239]: iface.transport_name = tcp
Jul 31 14:48:50 user nova-compute[72239]: iface.initiatorname = <empty>
Jul 31 14:48:50 user nova-compute[72239]: iface.state = <empty>
Jul 31 14:48:50 user nova-compute[72239]: iface.vlan_id = 0
Jul 31 14:48:50 user nova-compute[72239]: iface.vlan_priority = 0
Jul 31 14:48:50 user nova-compute[72239]: iface.vlan_state = <empty>
Jul 31 14:48:50 user nova-compute[72239]: iface.iface_num = 0
Jul 31 14:48:50 user nova-compute[72239]: iface.mtu = 0
Jul 31 14:48:50 user nova-compute[72239]: iface.port = 0
Jul 31 14:48:50 user nova-compute[72239]: iface.bootproto = <empty>
Jul 31 14:48:50 user nova-compute[72239]: iface.subnet_mask = <empty>
Jul 31 14:48:50 user nova-compute[72239]: iface.gateway = <empty>
Jul 31 14:48:50 user nova-compute[72239]: iface.dhcp_alt_client_id_state = <empty>
Jul 31 14:48:50 user nova-compute[72239]: iface.dhcp_alt_client_id = <empty>
Jul 31 14:48:50 user nova-compute[72239]: iface.dhcp_dns = <empty>
Jul 31 14:48:50 user nova-compute[72239]: iface.dhcp_learn_iqn = <empty>
Jul 31 14:48:50 user nova-compute[72239]: iface.dhcp_req_vendor_id_state = <empty>
Jul 31 14:48:50 user nova-compute[72239]: iface.dhcp_vendor_id_state = <empty>
Jul 31 14:48:50 user nova-compute[72239]: iface.dhcp_vendor_id = <empty>
Jul 31 14:48:50 user nova-compute[72239]: iface.dhcp_slp_da = <empty>
Jul 31 14:48:50 user nova-compute[72239]: iface.fragmentation = <empty>
Jul 31 14:48:50 user nova-compute[72239]: iface.gratuitous_arp = <empty>
Jul 31 14:48:50 user nova-compute[72239]: iface.incoming_forwarding = <empty>
Jul 31 14:48:50 user nova-compute[72239]: iface.tos_state = <empty>
Jul 31 14:48:50 user nova-compute[72239]: iface.tos = 0
Jul 31 14:48:50 user nova-compute[72239]: iface.ttl = 0
Jul 31 14:48:50 user nova-compute[72239]: iface.delayed_ack = <empty>
Jul 31 14:48:50 user nova-compute[72239]: iface.tcp_nagle = <empty>
Jul 31 14:48:50 user nova-compute[72239]: iface.tcp_wsf_state = <empty>
Jul 31 14:48:50 user nova-compute[72239]: iface.tcp_wsf = 0
Jul 31 14:48:50 user nova-compute[72239]: iface.tcp_timer_scale = 0
Jul 31 14:48:50 user nova-compute[72239]: iface.tcp_timestamp = <empty>
Jul 31 14:48:50 user nova-compute[72239]: iface.redirect = <empty>
Jul 31 14:48:50 user nova-compute[72239]: iface.def_task_mgmt_timeout = 0
Jul 31 14:48:50 user nova-compute[72239]: iface.header_digest = <empty>
Jul 31 14:48:50 user nova-compute[72239]: iface.data_digest = <empty>
Jul 31 14:48:50 user nova-compute[72239]: iface.immediate_data = <empty>
Jul 31 14:48:50 user nova-compute[72239]: iface.initial_r2t = <empty>
Jul 31 14:48:50 user nova-compute[72239]: iface.data_seq_inorder = <empty>
Jul 31 14:48:50 user nova-compute[72239]: iface.data_pdu_inorder = <empty>
Jul 31 14:48:50 user nova-compute[72239]: iface.erl = 0
Jul 31 14:48:50 user nova-compute[72239]: iface.max_receive_data_len = 0
Jul 31 14:48:50 user nova-compute[72239]: iface.first_burst_len = 0
Jul 31 14:48:50 user nova-compute[72239]: iface.max_outstanding_r2t = 0
Jul 31 14:48:50 user nova-compute[72239]: iface.max_burst_len = 0
Jul 31 14:48:50 user nova-compute[72239]: iface.chap_auth = <empty>
Jul 31 14:48:50 user nova-compute[72239]: iface.bidi_chap = <empty>
Jul 31 14:48:50 user nova-compute[72239]: iface.strict_login_compliance = <empty>
Jul 31 14:48:50 user nova-compute[72239]: iface.discovery_auth = <empty>
Jul 31 14:48:50 user nova-compute[72239]: iface.discovery_logout = <empty>
Jul 31 14:48:50 user nova-compute[72239]: node.discovery_address = <empty>
Jul 31 14:48:50 user nova-compute[72239]: node.discovery_port = 0
Jul 31 14:48:50 user nova-compute[72239]: node.discovery_type = static
Jul 31 14:48:50 user nova-compute[72239]: node.session.initial_cmdsn = 0
Jul 31 14:48:50 user nova-compute[72239]: node.session.initial_login_retry_max = 8
Jul 31 14:48:50 user nova-compute[72239]: node.session.xmit_thread_priority = -20
Jul 31 14:48:50 user nova-compute[72239]: node.session.cmds_max = 128
Jul 31 14:48:50 user nova-compute[72239]: node.session.queue_depth = 32
Jul 31 14:48:50 user nova-compute[72239]: node.session.nr_sessions = 1
Jul 31 14:48:50 user nova-compute[72239]: node.session.auth.authmethod = CHAP
Jul 31 14:48:50 user nova-compute[72239]: node.session.auth.username = WBpGanPy
Jul 31 14:48:50 user nova-compute[72239]: node.session.auth.password = ***
Jul 31 14:48:50 user nova-compute[72239]: node.session.auth.username_in = <empty>
Jul 31 14:48:50 user nova-compute[72239]: node.session.auth.password_in = <empty>
Jul 31 14:48:50 user nova-compute[72239]: node.session.auth.chap_algs = MD5
Jul 31 14:48:50 user nova-compute[72239]: node.session.timeo.replacement_timeout = 120
Jul 31 14:48:50 user nova-compute[72239]: node.session.err_timeo.abort_timeout = 15
Jul 31 14:48:50 user nova-compute[72239]: node.session.err_timeo.lu_reset_timeout = 30
Jul 31 14:48:50 user nova-compute[72239]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 31 14:48:50 user nova-compute[72239]: node.session.err_timeo.host_reset_timeout = 60
Jul 31 14:48:50 user nova-compute[72239]: node.session.iscsi.FastAbort = Yes
Jul 31 14:48:50 user nova-compute[72239]: node.session.iscsi.InitialR2T = No
Jul 31 14:48:50 user nova-compute[72239]: node.session.iscsi.ImmediateData = Yes
Jul 31 14:48:50 user nova-compute[72239]: node.session.iscsi.FirstBurstLength = 262144
Jul 31 14:48:50 user nova-compute[72239]: node.session.iscsi.MaxBurstLength = 16776192
Jul 31 14:48:50 user nova-compute[72239]: node.session.iscsi.DefaultTime2Retain = 0
Jul 31 14:48:50 user nova-compute[72239]: node.session.iscsi.DefaultTime2Wait = 2
Jul 31 14:48:50 user nova-compute[72239]: node.session.iscsi.MaxConnections = 1
Jul 31 14:48:50 user nova-compute[72239]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 31 14:48:50 user nova-compute[72239]: node.session.iscsi.ERL = 0
Jul 31 14:48:50 user nova-compute[72239]: node.session.scan = manual
Jul 31 14:48:50 user nova-compute[72239]: node.session.reopen_max = 0
Jul 31 14:48:50 user nova-compute[72239]: node.conn[0].address = 172.16.0.220
Jul 31 14:48:50 user nova-compute[72239]: node.conn[0].port = 3260
Jul 31 14:48:50 user nova-compute[72239]: node.conn[0].startup = manual
Jul 31 14:48:50 user nova-compute[72239]: node.conn[0].tcp.window_size = 524288
Jul 31 14:48:50 user nova-compute[72239]: node.conn[0].tcp.type_of_service = 0
Jul 31 14:48:50 user nova-compute[72239]: node.conn[0].timeo.logout_timeout = 15
Jul 31 14:48:50 user nova-compute[72239]: node.conn[0].timeo.login_timeout = 15
Jul 31 14:48:50 user nova-compute[72239]: node.conn[0].timeo.auth_timeout = 45
Jul 31 14:48:50 user nova-compute[72239]: node.conn[0].timeo.noop_out_interval = 5
Jul 31 14:48:50 user nova-compute[72239]: node.conn[0].timeo.noop_out_timeout = 5
Jul 31 14:48:50 user nova-compute[72239]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 31 14:48:50 user nova-compute[72239]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 31 14:48:50 user nova-compute[72239]: node.conn[0].iscsi.HeaderDigest = None
Jul 31 14:48:50 user nova-compute[72239]: node.conn[0].iscsi.DataDigest = None
Jul 31 14:48:50 user nova-compute[72239]: node.conn[0].iscsi.IFMarker = No
Jul 31 14:48:50 user nova-compute[72239]: node.conn[0].iscsi.OFMarker = No
Jul 31 14:48:50 user nova-compute[72239]: # END RECORD
Jul 31 14:48:50 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f8b443-a350-4147-a658-43982af9d1c6]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.036s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0ec7c1-0b64-4613-8d02-d7752d59fa1c]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WBpGanPy {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WBpGanPy" returned: 0 in 0.026s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b30de1-bcd3-4f5e-9851-09287fb35d55]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WBpGanPy'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a026bfc8-d49a-4c4e-87d3-f83cb2dfc73a]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36c17eb-0527-4350-8c45-cbd63e68fa43]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:48:50 user nova-compute[72239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)
Jul 31 14:48:50 user nova-compute[72239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:48:50 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:48:50 user nova-compute[72239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)
Jul 31 14:48:50 user nova-compute[72239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:48:50 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.214s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] HCTL ('39', '0', '0', 0) found on session 14 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Scanning host 39 c: 0, t: 0, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c7d93b-385f-4ee2-9fc6-cd443e86eaae]: (4, ('0 0 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Searching for a device in session 14 and hctl ('39', '0', '0', 0) yield: sdh {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WBpGanPy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.251s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] <== connect_volume: return (253ms) {'type': 'block', 'scsi_wwn': '23539613534653037', 'path': '/dev/sdh'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539613534653037', 'path': '/dev/sdh'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:46:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1216288639',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1216288639',id=14,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:47:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d8281237f9c417a9685e55826911e1b',ramdisk_id='',reservation_id='r-0tq8f5us',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-148379254',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:47:17Z,user_data=None,user_id='94ab9298205143d489f678b28be5b085',uuid=2f11022e-a007-4d4c-adc1-b54ea59b9e6a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91cadad3-732b-4fed-af92-b54692837973", "address": "fa:16:3e:44:72:66", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "vif_mac": "fa:16:3e:44:72:66"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91cadad3-73", "ovs_interfaceid": "91cadad3-732b-4fed-af92-b54692837973", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Converting VIF {"id": "91cadad3-732b-4fed-af92-b54692837973", "address": "fa:16:3e:44:72:66", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "vif_mac": "fa:16:3e:44:72:66"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91cadad3-73", "ovs_interfaceid": "91cadad3-732b-4fed-af92-b54692837973", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:72:66,bridge_name='br-int',has_traffic_filtering=True,id=91cadad3-732b-4fed-af92-b54692837973,network=Network(172fb80f-4bbe-4706-91cf-60540fbceb2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91cadad3-73') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG nova.objects.instance [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lazy-loading 'pci_devices' on Instance uuid 2f11022e-a007-4d4c-adc1-b54ea59b9e6a {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:48:50 user nova-compute[72239]:   <uuid>2f11022e-a007-4d4c-adc1-b54ea59b9e6a</uuid>
Jul 31 14:48:50 user nova-compute[72239]:   <name>instance-0000000e</name>
Jul 31 14:48:50 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:48:50 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:48:50 user nova-compute[72239]:   <metadata>
Jul 31 14:48:50 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:48:50 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:48:50 user nova-compute[72239]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1216288639</nova:name>
Jul 31 14:48:50 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:48:50</nova:creationTime>
Jul 31 14:48:50 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:48:50 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:48:50 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:48:50 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:48:50 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:48:50 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:48:50 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:48:50 user nova-compute[72239]:       <nova:owner>
Jul 31 14:48:50 user nova-compute[72239]:         <nova:user uuid="94ab9298205143d489f678b28be5b085">tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member</nova:user>
Jul 31 14:48:50 user nova-compute[72239]:         <nova:project uuid="1d8281237f9c417a9685e55826911e1b">tempest-ServerBootFromVolumeStableRescueTest-148379254</nova:project>
Jul 31 14:48:50 user nova-compute[72239]:       </nova:owner>
Jul 31 14:48:50 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:48:50 user nova-compute[72239]:       <nova:ports>
Jul 31 14:48:50 user nova-compute[72239]:         <nova:port uuid="91cadad3-732b-4fed-af92-b54692837973">
Jul 31 14:48:50 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 31 14:48:50 user nova-compute[72239]:         </nova:port>
Jul 31 14:48:50 user nova-compute[72239]:       </nova:ports>
Jul 31 14:48:50 user nova-compute[72239]:     </nova:instance>
Jul 31 14:48:50 user nova-compute[72239]:   </metadata>
Jul 31 14:48:50 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:48:50 user nova-compute[72239]:     <system>
Jul 31 14:48:50 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:48:50 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:48:50 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:48:50 user nova-compute[72239]:       <entry name="serial">2f11022e-a007-4d4c-adc1-b54ea59b9e6a</entry>
Jul 31 14:48:50 user nova-compute[72239]:       <entry name="uuid">2f11022e-a007-4d4c-adc1-b54ea59b9e6a</entry>
Jul 31 14:48:50 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:48:50 user nova-compute[72239]:     </system>
Jul 31 14:48:50 user nova-compute[72239]:   </sysinfo>
Jul 31 14:48:50 user nova-compute[72239]:   <os>
Jul 31 14:48:50 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:48:50 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:48:50 user nova-compute[72239]:   </os>
Jul 31 14:48:50 user nova-compute[72239]:   <features>
Jul 31 14:48:50 user nova-compute[72239]:     <acpi/>
Jul 31 14:48:50 user nova-compute[72239]:     <apic/>
Jul 31 14:48:50 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:48:50 user nova-compute[72239]:   </features>
Jul 31 14:48:50 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:48:50 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:48:50 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:48:50 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:48:50 user nova-compute[72239]:   </clock>
Jul 31 14:48:50 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:48:50 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:48:50 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:48:50 user nova-compute[72239]:   </cpu>
Jul 31 14:48:50 user nova-compute[72239]:   <devices>
Jul 31 14:48:50 user nova-compute[72239]:     <disk type="block" device="disk">
Jul 31 14:48:50 user nova-compute[72239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:48:50 user nova-compute[72239]:       <source dev="/dev/sdh"/>
Jul 31 14:48:50 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:48:50 user nova-compute[72239]:       <serial>6b6e6fc1-6c81-4d1f-92e8-ae4f930973da</serial>
Jul 31 14:48:50 user nova-compute[72239]:     </disk>
Jul 31 14:48:50 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:48:50 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:48:50 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/2f11022e-a007-4d4c-adc1-b54ea59b9e6a/disk.rescue"/>
Jul 31 14:48:50 user nova-compute[72239]:       <target dev="vdb" bus="virtio"/>
Jul 31 14:48:50 user nova-compute[72239]:       <boot order="1"/>
Jul 31 14:48:50 user nova-compute[72239]:     </disk>
Jul 31 14:48:50 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:48:50 user nova-compute[72239]:       <mac address="fa:16:3e:44:72:66"/>
Jul 31 14:48:50 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:48:50 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:48:50 user nova-compute[72239]:       <target dev="tap91cadad3-73"/>
Jul 31 14:48:50 user nova-compute[72239]:     </interface>
Jul 31 14:48:50 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:48:50 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/2f11022e-a007-4d4c-adc1-b54ea59b9e6a/console.log" append="off"/>
Jul 31 14:48:50 user nova-compute[72239]:     </serial>
Jul 31 14:48:50 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:48:50 user nova-compute[72239]:     <video>
Jul 31 14:48:50 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:48:50 user nova-compute[72239]:     </video>
Jul 31 14:48:50 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:48:50 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:48:50 user nova-compute[72239]:     </rng>
Jul 31 14:48:50 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:48:50 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:48:50 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:48:50 user nova-compute[72239]:     </memballoon>
Jul 31 14:48:50 user nova-compute[72239]:   </devices>
Jul 31 14:48:50 user nova-compute[72239]: </domain>
Jul 31 14:48:50 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:48:50 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Instance destroyed successfully.
Jul 31 14:48:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:48:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] No VIF found with MAC fa:16:3e:44:72:66, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:48:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:52 user nova-compute[72239]: INFO nova.compute.manager [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Rescuing
Jul 31 14:48:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "refresh_cache-7d81b881-b44e-4fb3-8245-9dea634bdec9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:48:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquired lock "refresh_cache-7d81b881-b44e-4fb3-8245-9dea634bdec9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:48:52 user nova-compute[72239]: DEBUG nova.network.neutron [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:48:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:53 user nova-compute[72239]: DEBUG nova.compute.manager [req-75f09bf3-f6db-44da-adcb-7067cf0becc5 req-9821db7c-9450-4c77-9522-feddec2ac09b service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Received event network-vif-plugged-91cadad3-732b-4fed-af92-b54692837973 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:48:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-75f09bf3-f6db-44da-adcb-7067cf0becc5 req-9821db7c-9450-4c77-9522-feddec2ac09b service nova] Acquiring lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-75f09bf3-f6db-44da-adcb-7067cf0becc5 req-9821db7c-9450-4c77-9522-feddec2ac09b service nova] Lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-75f09bf3-f6db-44da-adcb-7067cf0becc5 req-9821db7c-9450-4c77-9522-feddec2ac09b service nova] Lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:53 user nova-compute[72239]: DEBUG nova.compute.manager [req-75f09bf3-f6db-44da-adcb-7067cf0becc5 req-9821db7c-9450-4c77-9522-feddec2ac09b service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] No waiting events found dispatching network-vif-plugged-91cadad3-732b-4fed-af92-b54692837973 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:48:53 user nova-compute[72239]: WARNING nova.compute.manager [req-75f09bf3-f6db-44da-adcb-7067cf0becc5 req-9821db7c-9450-4c77-9522-feddec2ac09b service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Received unexpected event network-vif-plugged-91cadad3-732b-4fed-af92-b54692837973 for instance with vm_state active and task_state rescuing.
Jul 31 14:48:53 user nova-compute[72239]: DEBUG nova.network.neutron [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Updating instance_info_cache with network_info: [{"id": "60f70f18-4024-4388-ae64-3c2cca0cafbc", "address": "fa:16:3e:a5:de:4b", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f70f18-40", "ovs_interfaceid": "60f70f18-4024-4388-ae64-3c2cca0cafbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:48:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Releasing lock "refresh_cache-7d81b881-b44e-4fb3-8245-9dea634bdec9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:48:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:55 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Instance destroyed successfully.
Jul 31 14:48:55 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Attempting rescue
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72239) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Instance directory exists: not creating {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 31 14:48:55 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Creating image(s)
Jul 31 14:48:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "/opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "/opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "/opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.objects.instance [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7d81b881-b44e-4fb3-8245-9dea634bdec9 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "ca449065000c92aac3b7b9fa685f9a7710929444" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.206s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk.rescue {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk.rescue" returned: 0 in 0.070s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.objects.instance [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lazy-loading 'migration_context' on Instance uuid 7d81b881-b44e-4fb3-8245-9dea634bdec9 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Start _get_guest_xml network_info=[{"id": "60f70f18-4024-4388-ae64-3c2cca0cafbc", "address": "fa:16:3e:a5:de:4b", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "vif_mac": "fa:16:3e:a5:de:4b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f70f18-40", "ovs_interfaceid": "60f70f18-4024-4388-ae64-3c2cca0cafbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.objects.instance [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lazy-loading 'resources' on Instance uuid 7d81b881-b44e-4fb3-8245-9dea634bdec9 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.objects.instance [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lazy-loading 'numa_topology' on Instance uuid 7d81b881-b44e-4fb3-8245-9dea634bdec9 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:48:55 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:48:55 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.objects.instance [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7d81b881-b44e-4fb3-8245-9dea634bdec9 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:44:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-263563606',display_name='tempest-ServerRescueNegativeTestJSON-server-263563606',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-263563606',id=3,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:44:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='959107d575f04ba2b0ac800ed2ef61fa',ramdisk_id='',reservation_id='r-3kc25083',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1296361049',owner_user_name='tempest-ServerRescueNegativeTestJSON-1296361049-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:44:19Z,user_data=None,user_id='f10fd7b9c1d34ca5b37150f34ea09ffa',uuid=7d81b881-b44e-4fb3-8245-9dea634bdec9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60f70f18-4024-4388-ae64-3c2cca0cafbc", "address": "fa:16:3e:a5:de:4b", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "vif_mac": "fa:16:3e:a5:de:4b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f70f18-40", "ovs_interfaceid": "60f70f18-4024-4388-ae64-3c2cca0cafbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Converting VIF {"id": "60f70f18-4024-4388-ae64-3c2cca0cafbc", "address": "fa:16:3e:a5:de:4b", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "vif_mac": "fa:16:3e:a5:de:4b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f70f18-40", "ovs_interfaceid": "60f70f18-4024-4388-ae64-3c2cca0cafbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:de:4b,bridge_name='br-int',has_traffic_filtering=True,id=60f70f18-4024-4388-ae64-3c2cca0cafbc,network=Network(02dfd673-dd23-4768-9c30-291cdbecbb64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f70f18-40') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.objects.instance [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d81b881-b44e-4fb3-8245-9dea634bdec9 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:48:55 user nova-compute[72239]:   <uuid>7d81b881-b44e-4fb3-8245-9dea634bdec9</uuid>
Jul 31 14:48:55 user nova-compute[72239]:   <name>instance-00000003</name>
Jul 31 14:48:55 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:48:55 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:48:55 user nova-compute[72239]:   <metadata>
Jul 31 14:48:55 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:48:55 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:48:55 user nova-compute[72239]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-263563606</nova:name>
Jul 31 14:48:55 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:48:55</nova:creationTime>
Jul 31 14:48:55 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:48:55 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:48:55 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:48:55 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:48:55 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:48:55 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:48:55 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:48:55 user nova-compute[72239]:       <nova:owner>
Jul 31 14:48:55 user nova-compute[72239]:         <nova:user uuid="f10fd7b9c1d34ca5b37150f34ea09ffa">tempest-ServerRescueNegativeTestJSON-1296361049-project-member</nova:user>
Jul 31 14:48:55 user nova-compute[72239]:         <nova:project uuid="959107d575f04ba2b0ac800ed2ef61fa">tempest-ServerRescueNegativeTestJSON-1296361049</nova:project>
Jul 31 14:48:55 user nova-compute[72239]:       </nova:owner>
Jul 31 14:48:55 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:48:55 user nova-compute[72239]:       <nova:ports>
Jul 31 14:48:55 user nova-compute[72239]:         <nova:port uuid="60f70f18-4024-4388-ae64-3c2cca0cafbc">
Jul 31 14:48:55 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 31 14:48:55 user nova-compute[72239]:         </nova:port>
Jul 31 14:48:55 user nova-compute[72239]:       </nova:ports>
Jul 31 14:48:55 user nova-compute[72239]:     </nova:instance>
Jul 31 14:48:55 user nova-compute[72239]:   </metadata>
Jul 31 14:48:55 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:48:55 user nova-compute[72239]:     <system>
Jul 31 14:48:55 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:48:55 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:48:55 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:48:55 user nova-compute[72239]:       <entry name="serial">7d81b881-b44e-4fb3-8245-9dea634bdec9</entry>
Jul 31 14:48:55 user nova-compute[72239]:       <entry name="uuid">7d81b881-b44e-4fb3-8245-9dea634bdec9</entry>
Jul 31 14:48:55 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:48:55 user nova-compute[72239]:     </system>
Jul 31 14:48:55 user nova-compute[72239]:   </sysinfo>
Jul 31 14:48:55 user nova-compute[72239]:   <os>
Jul 31 14:48:55 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:48:55 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:48:55 user nova-compute[72239]:   </os>
Jul 31 14:48:55 user nova-compute[72239]:   <features>
Jul 31 14:48:55 user nova-compute[72239]:     <acpi/>
Jul 31 14:48:55 user nova-compute[72239]:     <apic/>
Jul 31 14:48:55 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:48:55 user nova-compute[72239]:   </features>
Jul 31 14:48:55 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:48:55 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:48:55 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:48:55 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:48:55 user nova-compute[72239]:   </clock>
Jul 31 14:48:55 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:48:55 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:48:55 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:48:55 user nova-compute[72239]:   </cpu>
Jul 31 14:48:55 user nova-compute[72239]:   <devices>
Jul 31 14:48:55 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:48:55 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:48:55 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk.rescue"/>
Jul 31 14:48:55 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:48:55 user nova-compute[72239]:     </disk>
Jul 31 14:48:55 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:48:55 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:48:55 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk"/>
Jul 31 14:48:55 user nova-compute[72239]:       <target dev="vdb" bus="virtio"/>
Jul 31 14:48:55 user nova-compute[72239]:     </disk>
Jul 31 14:48:55 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:48:55 user nova-compute[72239]:       <mac address="fa:16:3e:a5:de:4b"/>
Jul 31 14:48:55 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:48:55 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:48:55 user nova-compute[72239]:       <target dev="tap60f70f18-40"/>
Jul 31 14:48:55 user nova-compute[72239]:     </interface>
Jul 31 14:48:55 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:48:55 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/console.log" append="off"/>
Jul 31 14:48:55 user nova-compute[72239]:     </serial>
Jul 31 14:48:55 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:48:55 user nova-compute[72239]:     <video>
Jul 31 14:48:55 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:48:55 user nova-compute[72239]:     </video>
Jul 31 14:48:55 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:48:55 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:48:55 user nova-compute[72239]:     </rng>
Jul 31 14:48:55 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:48:55 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:48:55 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:48:55 user nova-compute[72239]:     </memballoon>
Jul 31 14:48:55 user nova-compute[72239]:   </devices>
Jul 31 14:48:55 user nova-compute[72239]: </domain>
Jul 31 14:48:55 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Removed pending event for 2f11022e-a007-4d4c-adc1-b54ea59b9e6a due to event {{(pid=72239) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814935.7061734, 2f11022e-a007-4d4c-adc1-b54ea59b9e6a => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:48:55 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] VM Resumed (Lifecycle Event)
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.compute.manager [None req-e07ddef8-28df-482e-8b80-5c40cb1aa33a tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:48:55 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Instance destroyed successfully.
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:48:55 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814935.7068222, 2f11022e-a007-4d4c-adc1-b54ea59b9e6a => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:48:55 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] VM Started (Lifecycle Event)
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] No VIF found with MAC fa:16:3e:a5:de:4b, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.compute.manager [req-0ec04a99-502b-4674-be2c-7b43c297b42b req-54f1fcbb-71a7-4852-b3d8-1af64a7c9c9c service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Received event network-vif-plugged-91cadad3-732b-4fed-af92-b54692837973 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0ec04a99-502b-4674-be2c-7b43c297b42b req-54f1fcbb-71a7-4852-b3d8-1af64a7c9c9c service nova] Acquiring lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0ec04a99-502b-4674-be2c-7b43c297b42b req-54f1fcbb-71a7-4852-b3d8-1af64a7c9c9c service nova] Lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0ec04a99-502b-4674-be2c-7b43c297b42b req-54f1fcbb-71a7-4852-b3d8-1af64a7c9c9c service nova] Lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:55 user nova-compute[72239]: DEBUG nova.compute.manager [req-0ec04a99-502b-4674-be2c-7b43c297b42b req-54f1fcbb-71a7-4852-b3d8-1af64a7c9c9c service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] No waiting events found dispatching network-vif-plugged-91cadad3-732b-4fed-af92-b54692837973 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:48:55 user nova-compute[72239]: WARNING nova.compute.manager [req-0ec04a99-502b-4674-be2c-7b43c297b42b req-54f1fcbb-71a7-4852-b3d8-1af64a7c9c9c service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Received unexpected event network-vif-plugged-91cadad3-732b-4fed-af92-b54692837973 for instance with vm_state rescued and task_state None.
Jul 31 14:48:56 user nova-compute[72239]: DEBUG nova.compute.manager [req-0ec04a99-502b-4674-be2c-7b43c297b42b req-54f1fcbb-71a7-4852-b3d8-1af64a7c9c9c service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received event network-vif-unplugged-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:48:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0ec04a99-502b-4674-be2c-7b43c297b42b req-54f1fcbb-71a7-4852-b3d8-1af64a7c9c9c service nova] Acquiring lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0ec04a99-502b-4674-be2c-7b43c297b42b req-54f1fcbb-71a7-4852-b3d8-1af64a7c9c9c service nova] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0ec04a99-502b-4674-be2c-7b43c297b42b req-54f1fcbb-71a7-4852-b3d8-1af64a7c9c9c service nova] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:56 user nova-compute[72239]: DEBUG nova.compute.manager [req-0ec04a99-502b-4674-be2c-7b43c297b42b req-54f1fcbb-71a7-4852-b3d8-1af64a7c9c9c service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] No waiting events found dispatching network-vif-unplugged-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:48:56 user nova-compute[72239]: WARNING nova.compute.manager [req-0ec04a99-502b-4674-be2c-7b43c297b42b req-54f1fcbb-71a7-4852-b3d8-1af64a7c9c9c service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received unexpected event network-vif-unplugged-60f70f18-4024-4388-ae64-3c2cca0cafbc for instance with vm_state active and task_state rescuing.
Jul 31 14:48:56 user nova-compute[72239]: DEBUG nova.compute.manager [req-0ec04a99-502b-4674-be2c-7b43c297b42b req-54f1fcbb-71a7-4852-b3d8-1af64a7c9c9c service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received event network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:48:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0ec04a99-502b-4674-be2c-7b43c297b42b req-54f1fcbb-71a7-4852-b3d8-1af64a7c9c9c service nova] Acquiring lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0ec04a99-502b-4674-be2c-7b43c297b42b req-54f1fcbb-71a7-4852-b3d8-1af64a7c9c9c service nova] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0ec04a99-502b-4674-be2c-7b43c297b42b req-54f1fcbb-71a7-4852-b3d8-1af64a7c9c9c service nova] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:56 user nova-compute[72239]: DEBUG nova.compute.manager [req-0ec04a99-502b-4674-be2c-7b43c297b42b req-54f1fcbb-71a7-4852-b3d8-1af64a7c9c9c service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] No waiting events found dispatching network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:48:56 user nova-compute[72239]: WARNING nova.compute.manager [req-0ec04a99-502b-4674-be2c-7b43c297b42b req-54f1fcbb-71a7-4852-b3d8-1af64a7c9c9c service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received unexpected event network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc for instance with vm_state active and task_state rescuing.
Jul 31 14:48:56 user nova-compute[72239]: DEBUG nova.compute.manager [req-0ec04a99-502b-4674-be2c-7b43c297b42b req-54f1fcbb-71a7-4852-b3d8-1af64a7c9c9c service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received event network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:48:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0ec04a99-502b-4674-be2c-7b43c297b42b req-54f1fcbb-71a7-4852-b3d8-1af64a7c9c9c service nova] Acquiring lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0ec04a99-502b-4674-be2c-7b43c297b42b req-54f1fcbb-71a7-4852-b3d8-1af64a7c9c9c service nova] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0ec04a99-502b-4674-be2c-7b43c297b42b req-54f1fcbb-71a7-4852-b3d8-1af64a7c9c9c service nova] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:56 user nova-compute[72239]: DEBUG nova.compute.manager [req-0ec04a99-502b-4674-be2c-7b43c297b42b req-54f1fcbb-71a7-4852-b3d8-1af64a7c9c9c service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] No waiting events found dispatching network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:48:56 user nova-compute[72239]: WARNING nova.compute.manager [req-0ec04a99-502b-4674-be2c-7b43c297b42b req-54f1fcbb-71a7-4852-b3d8-1af64a7c9c9c service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received unexpected event network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc for instance with vm_state active and task_state rescuing.
Jul 31 14:48:56 user nova-compute[72239]: DEBUG nova.compute.manager [req-0ec04a99-502b-4674-be2c-7b43c297b42b req-54f1fcbb-71a7-4852-b3d8-1af64a7c9c9c service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received event network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:48:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0ec04a99-502b-4674-be2c-7b43c297b42b req-54f1fcbb-71a7-4852-b3d8-1af64a7c9c9c service nova] Acquiring lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0ec04a99-502b-4674-be2c-7b43c297b42b req-54f1fcbb-71a7-4852-b3d8-1af64a7c9c9c service nova] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0ec04a99-502b-4674-be2c-7b43c297b42b req-54f1fcbb-71a7-4852-b3d8-1af64a7c9c9c service nova] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:56 user nova-compute[72239]: DEBUG nova.compute.manager [req-0ec04a99-502b-4674-be2c-7b43c297b42b req-54f1fcbb-71a7-4852-b3d8-1af64a7c9c9c service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] No waiting events found dispatching network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:48:56 user nova-compute[72239]: WARNING nova.compute.manager [req-0ec04a99-502b-4674-be2c-7b43c297b42b req-54f1fcbb-71a7-4852-b3d8-1af64a7c9c9c service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received unexpected event network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc for instance with vm_state active and task_state rescuing.
Jul 31 14:48:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:58 user nova-compute[72239]: DEBUG nova.compute.manager [req-fc3ba366-8f43-429b-9667-bf9abd4d7423 req-ed8541de-be2e-492d-b651-789d6ddb7571 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received event network-vif-unplugged-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:48:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-fc3ba366-8f43-429b-9667-bf9abd4d7423 req-ed8541de-be2e-492d-b651-789d6ddb7571 service nova] Acquiring lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-fc3ba366-8f43-429b-9667-bf9abd4d7423 req-ed8541de-be2e-492d-b651-789d6ddb7571 service nova] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-fc3ba366-8f43-429b-9667-bf9abd4d7423 req-ed8541de-be2e-492d-b651-789d6ddb7571 service nova] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:58 user nova-compute[72239]: DEBUG nova.compute.manager [req-fc3ba366-8f43-429b-9667-bf9abd4d7423 req-ed8541de-be2e-492d-b651-789d6ddb7571 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] No waiting events found dispatching network-vif-unplugged-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:48:58 user nova-compute[72239]: WARNING nova.compute.manager [req-fc3ba366-8f43-429b-9667-bf9abd4d7423 req-ed8541de-be2e-492d-b651-789d6ddb7571 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received unexpected event network-vif-unplugged-60f70f18-4024-4388-ae64-3c2cca0cafbc for instance with vm_state active and task_state rescuing.
Jul 31 14:48:58 user nova-compute[72239]: DEBUG nova.compute.manager [req-fc3ba366-8f43-429b-9667-bf9abd4d7423 req-ed8541de-be2e-492d-b651-789d6ddb7571 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received event network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:48:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-fc3ba366-8f43-429b-9667-bf9abd4d7423 req-ed8541de-be2e-492d-b651-789d6ddb7571 service nova] Acquiring lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-fc3ba366-8f43-429b-9667-bf9abd4d7423 req-ed8541de-be2e-492d-b651-789d6ddb7571 service nova] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-fc3ba366-8f43-429b-9667-bf9abd4d7423 req-ed8541de-be2e-492d-b651-789d6ddb7571 service nova] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:58 user nova-compute[72239]: DEBUG nova.compute.manager [req-fc3ba366-8f43-429b-9667-bf9abd4d7423 req-ed8541de-be2e-492d-b651-789d6ddb7571 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] No waiting events found dispatching network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:48:58 user nova-compute[72239]: WARNING nova.compute.manager [req-fc3ba366-8f43-429b-9667-bf9abd4d7423 req-ed8541de-be2e-492d-b651-789d6ddb7571 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received unexpected event network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc for instance with vm_state active and task_state rescuing.
Jul 31 14:48:58 user nova-compute[72239]: DEBUG nova.compute.manager [req-fc3ba366-8f43-429b-9667-bf9abd4d7423 req-ed8541de-be2e-492d-b651-789d6ddb7571 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received event network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:48:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-fc3ba366-8f43-429b-9667-bf9abd4d7423 req-ed8541de-be2e-492d-b651-789d6ddb7571 service nova] Acquiring lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:48:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-fc3ba366-8f43-429b-9667-bf9abd4d7423 req-ed8541de-be2e-492d-b651-789d6ddb7571 service nova] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:48:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-fc3ba366-8f43-429b-9667-bf9abd4d7423 req-ed8541de-be2e-492d-b651-789d6ddb7571 service nova] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:48:58 user nova-compute[72239]: DEBUG nova.compute.manager [req-fc3ba366-8f43-429b-9667-bf9abd4d7423 req-ed8541de-be2e-492d-b651-789d6ddb7571 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] No waiting events found dispatching network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:48:58 user nova-compute[72239]: WARNING nova.compute.manager [req-fc3ba366-8f43-429b-9667-bf9abd4d7423 req-ed8541de-be2e-492d-b651-789d6ddb7571 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received unexpected event network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc for instance with vm_state active and task_state rescuing.
Jul 31 14:48:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:48:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:00 user nova-compute[72239]: DEBUG nova.compute.manager [req-9878b565-829d-492d-95f7-9167e4d24cc1 req-76ad584e-6aa4-41ec-a974-2bb624e31d71 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received event network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:49:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-9878b565-829d-492d-95f7-9167e4d24cc1 req-76ad584e-6aa4-41ec-a974-2bb624e31d71 service nova] Acquiring lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:49:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-9878b565-829d-492d-95f7-9167e4d24cc1 req-76ad584e-6aa4-41ec-a974-2bb624e31d71 service nova] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:49:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-9878b565-829d-492d-95f7-9167e4d24cc1 req-76ad584e-6aa4-41ec-a974-2bb624e31d71 service nova] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:49:00 user nova-compute[72239]: DEBUG nova.compute.manager [req-9878b565-829d-492d-95f7-9167e4d24cc1 req-76ad584e-6aa4-41ec-a974-2bb624e31d71 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] No waiting events found dispatching network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:49:00 user nova-compute[72239]: WARNING nova.compute.manager [req-9878b565-829d-492d-95f7-9167e4d24cc1 req-76ad584e-6aa4-41ec-a974-2bb624e31d71 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received unexpected event network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc for instance with vm_state active and task_state rescuing.
Jul 31 14:49:00 user nova-compute[72239]: DEBUG nova.compute.manager [None req-ed45c4f9-e42f-4a06-8eca-1050644e6f53 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:49:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Removed pending event for 7d81b881-b44e-4fb3-8245-9dea634bdec9 due to event {{(pid=72239) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 14:49:00 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814940.6203804, 7d81b881-b44e-4fb3-8245-9dea634bdec9 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:49:00 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] VM Resumed (Lifecycle Event)
Jul 31 14:49:00 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:49:00 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:49:00 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814940.620863, 7d81b881-b44e-4fb3-8245-9dea634bdec9 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:49:00 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] VM Started (Lifecycle Event)
Jul 31 14:49:00 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:49:00 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:49:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Acquiring lock "82116af8-3702-401b-8d00-9291d4caeb03" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:49:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "82116af8-3702-401b-8d00-9291d4caeb03" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:49:01 user nova-compute[72239]: DEBUG nova.objects.instance [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lazy-loading 'flavor' on Instance uuid 82116af8-3702-401b-8d00-9291d4caeb03 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:49:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:49:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:49:01 user nova-compute[72239]: DEBUG nova.compute.manager [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 14:49:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "82116af8-3702-401b-8d00-9291d4caeb03" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.137s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:49:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:49:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:49:01 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 14:49:01 user nova-compute[72239]: INFO nova.compute.claims [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Claim successful on node user
Jul 31 14:49:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Acquiring lock "82116af8-3702-401b-8d00-9291d4caeb03" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:49:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "82116af8-3702-401b-8d00-9291d4caeb03" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:49:01 user nova-compute[72239]: INFO nova.compute.manager [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Attaching volume 32b7cef1-8b74-487a-8939-0de22a5ca46b to /dev/vdb
Jul 31 14:49:02 user nova-compute[72239]: DEBUG os_brick.utils [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:49:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:02 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4ece07-9cfc-4398-9cfd-31f36325e98c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:49:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.028s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:02 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[152088d5-b26a-459e-9c4e-88bd653f6d0d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:49:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.033s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:02 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa54fe69-8235-426a-b47d-76aea7cd84cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:49:02 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d44ea38-eaa8-4a85-935c-9d3bd98dba41]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:49:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:49:02 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 14:49:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:49:02 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 14:49:02 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff93674e-f4de-44ea-bb05-ce990adcccc0]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:49:02 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 14:49:02 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 14:49:02 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 14:49:02 user nova-compute[72239]: DEBUG os_brick.utils [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] <== get_connector_properties: return (192ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:49:02 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Updating existing volume attachment record: b6d7f740-4349-4511-a3b4-d12f6a119517 {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 14:49:02 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:49:02 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:49:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.928s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:49:02 user nova-compute[72239]: DEBUG nova.compute.manager [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 14:49:02 user nova-compute[72239]: DEBUG nova.compute.manager [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 14:49:02 user nova-compute[72239]: DEBUG nova.network.neutron [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 14:49:02 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 14:49:02 user nova-compute[72239]: DEBUG nova.compute.manager [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 14:49:02 user nova-compute[72239]: DEBUG nova.policy [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd0e2796894b249cc868a888fac759983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217b0eef1c154602850f4cf2d81b7ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 14:49:02 user nova-compute[72239]: DEBUG nova.compute.manager [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 14:49:02 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 14:49:02 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Creating image(s)
Jul 31 14:49:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "/opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:49:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "/opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:49:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "/opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:49:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.227s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "ca449065000c92aac3b7b9fa685f9a7710929444" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:49:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.012s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:49:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.206s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk 1073741824" returned: 0 in 0.111s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:03 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.330s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:49:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.195s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:03 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 14:49:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:03 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Cannot resize image /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 14:49:03 user nova-compute[72239]: DEBUG nova.objects.instance [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lazy-loading 'migration_context' on Instance uuid c10918e9-9731-48ea-860e-8a02cb6a0ad9 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:49:03 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 14:49:03 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Ensure instance console log exists: /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 14:49:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:49:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:49:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:49:03 user nova-compute[72239]: DEBUG nova.network.neutron [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Successfully created port: 8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:49:03 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG nova.network.neutron [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Successfully updated port: 8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "refresh_cache-c10918e9-9731-48ea-860e-8a02cb6a0ad9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquired lock "refresh_cache-c10918e9-9731-48ea-860e-8a02cb6a0ad9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG nova.network.neutron [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG nova.compute.manager [req-b7977ad7-1cc1-4be9-a34d-b2a9164bc080 req-39739ee0-a47e-4e24-b827-b09666b924ef service nova] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Received event network-changed-8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG nova.compute.manager [req-b7977ad7-1cc1-4be9-a34d-b2a9164bc080 req-39739ee0-a47e-4e24-b827-b09666b924ef service nova] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Refreshing instance network info cache due to event network-changed-8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b7977ad7-1cc1-4be9-a34d-b2a9164bc080 req-39739ee0-a47e-4e24-b827-b09666b924ef service nova] Acquiring lock "refresh_cache-c10918e9-9731-48ea-860e-8a02cb6a0ad9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG nova.network.neutron [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG nova.network.neutron [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Updating instance_info_cache with network_info: [{"id": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "address": "fa:16:3e:56:1c:d6", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8307e7-0d", "ovs_interfaceid": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Releasing lock "refresh_cache-c10918e9-9731-48ea-860e-8a02cb6a0ad9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG nova.compute.manager [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Instance network_info: |[{"id": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "address": "fa:16:3e:56:1c:d6", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8307e7-0d", "ovs_interfaceid": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b7977ad7-1cc1-4be9-a34d-b2a9164bc080 req-39739ee0-a47e-4e24-b827-b09666b924ef service nova] Acquired lock "refresh_cache-c10918e9-9731-48ea-860e-8a02cb6a0ad9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG nova.network.neutron [req-b7977ad7-1cc1-4be9-a34d-b2a9164bc080 req-39739ee0-a47e-4e24-b827-b09666b924ef service nova] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Refreshing network info cache for port 8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Start _get_guest_xml network_info=[{"id": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "address": "fa:16:3e:56:1c:d6", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8307e7-0d", "ovs_interfaceid": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:49:05 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:49:05 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:49:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1591567707',display_name='tempest-ServerActionsTestOtherA-server-1591567707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1591567707',id=16,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcC0f3guhYTNzECKpfyNk4cXj6Y8F4GpucRwb/0EBaXIalClpDyM69s13M23SyVQiCvr0tglg8FRaf5C4ibRcE2Gd6CEj06wnsuSnTBc8jPOcwf8pDTnQMrdikVLzRidg==',key_name='tempest-keypair-538819016',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='217b0eef1c154602850f4cf2d81b7ead',ramdisk_id='',reservation_id='r-qi1uxdkp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-456571617',owner_user_name='tempest-ServerActionsTestOtherA-456571617-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:49:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0e2796894b249cc868a888fac759983',uuid=c10918e9-9731-48ea-860e-8a02cb6a0ad9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "address": "fa:16:3e:56:1c:d6", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8307e7-0d", "ovs_interfaceid": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Converting VIF {"id": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "address": "fa:16:3e:56:1c:d6", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8307e7-0d", "ovs_interfaceid": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:1c:d6,bridge_name='br-int',has_traffic_filtering=True,id=8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed,network=Network(6d954fa8-21ae-4438-b6c0-6ae7fb37718c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8307e7-0d') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG nova.objects.instance [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lazy-loading 'pci_devices' on Instance uuid c10918e9-9731-48ea-860e-8a02cb6a0ad9 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:49:05 user nova-compute[72239]:   <uuid>c10918e9-9731-48ea-860e-8a02cb6a0ad9</uuid>
Jul 31 14:49:05 user nova-compute[72239]:   <name>instance-00000010</name>
Jul 31 14:49:05 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:49:05 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:49:05 user nova-compute[72239]:   <metadata>
Jul 31 14:49:05 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:49:05 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:49:05 user nova-compute[72239]:       <nova:name>tempest-ServerActionsTestOtherA-server-1591567707</nova:name>
Jul 31 14:49:05 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:49:05</nova:creationTime>
Jul 31 14:49:05 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:49:05 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:49:05 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:49:05 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:49:05 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:49:05 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:49:05 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:49:05 user nova-compute[72239]:       <nova:owner>
Jul 31 14:49:05 user nova-compute[72239]:         <nova:user uuid="d0e2796894b249cc868a888fac759983">tempest-ServerActionsTestOtherA-456571617-project-member</nova:user>
Jul 31 14:49:05 user nova-compute[72239]:         <nova:project uuid="217b0eef1c154602850f4cf2d81b7ead">tempest-ServerActionsTestOtherA-456571617</nova:project>
Jul 31 14:49:05 user nova-compute[72239]:       </nova:owner>
Jul 31 14:49:05 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:49:05 user nova-compute[72239]:       <nova:ports>
Jul 31 14:49:05 user nova-compute[72239]:         <nova:port uuid="8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed">
Jul 31 14:49:05 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 31 14:49:05 user nova-compute[72239]:         </nova:port>
Jul 31 14:49:05 user nova-compute[72239]:       </nova:ports>
Jul 31 14:49:05 user nova-compute[72239]:     </nova:instance>
Jul 31 14:49:05 user nova-compute[72239]:   </metadata>
Jul 31 14:49:05 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:49:05 user nova-compute[72239]:     <system>
Jul 31 14:49:05 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:49:05 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:49:05 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:49:05 user nova-compute[72239]:       <entry name="serial">c10918e9-9731-48ea-860e-8a02cb6a0ad9</entry>
Jul 31 14:49:05 user nova-compute[72239]:       <entry name="uuid">c10918e9-9731-48ea-860e-8a02cb6a0ad9</entry>
Jul 31 14:49:05 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:49:05 user nova-compute[72239]:     </system>
Jul 31 14:49:05 user nova-compute[72239]:   </sysinfo>
Jul 31 14:49:05 user nova-compute[72239]:   <os>
Jul 31 14:49:05 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:49:05 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:49:05 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:49:05 user nova-compute[72239]:   </os>
Jul 31 14:49:05 user nova-compute[72239]:   <features>
Jul 31 14:49:05 user nova-compute[72239]:     <acpi/>
Jul 31 14:49:05 user nova-compute[72239]:     <apic/>
Jul 31 14:49:05 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:49:05 user nova-compute[72239]:   </features>
Jul 31 14:49:05 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:49:05 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:49:05 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:49:05 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:49:05 user nova-compute[72239]:   </clock>
Jul 31 14:49:05 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:49:05 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:49:05 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:49:05 user nova-compute[72239]:   </cpu>
Jul 31 14:49:05 user nova-compute[72239]:   <devices>
Jul 31 14:49:05 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:49:05 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:49:05 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk"/>
Jul 31 14:49:05 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:49:05 user nova-compute[72239]:     </disk>
Jul 31 14:49:05 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:49:05 user nova-compute[72239]:       <mac address="fa:16:3e:56:1c:d6"/>
Jul 31 14:49:05 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:49:05 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:49:05 user nova-compute[72239]:       <target dev="tap8b8307e7-0d"/>
Jul 31 14:49:05 user nova-compute[72239]:     </interface>
Jul 31 14:49:05 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:49:05 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/console.log" append="off"/>
Jul 31 14:49:05 user nova-compute[72239]:     </serial>
Jul 31 14:49:05 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:49:05 user nova-compute[72239]:     <video>
Jul 31 14:49:05 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:49:05 user nova-compute[72239]:     </video>
Jul 31 14:49:05 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:49:05 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:49:05 user nova-compute[72239]:     </rng>
Jul 31 14:49:05 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:49:05 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:49:05 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:49:05 user nova-compute[72239]:     </memballoon>
Jul 31 14:49:05 user nova-compute[72239]:   </devices>
Jul 31 14:49:05 user nova-compute[72239]: </domain>
Jul 31 14:49:05 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1591567707',display_name='tempest-ServerActionsTestOtherA-server-1591567707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1591567707',id=16,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcC0f3guhYTNzECKpfyNk4cXj6Y8F4GpucRwb/0EBaXIalClpDyM69s13M23SyVQiCvr0tglg8FRaf5C4ibRcE2Gd6CEj06wnsuSnTBc8jPOcwf8pDTnQMrdikVLzRidg==',key_name='tempest-keypair-538819016',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='217b0eef1c154602850f4cf2d81b7ead',ramdisk_id='',reservation_id='r-qi1uxdkp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-456571617',owner_user_name='tempest-ServerActionsTestOtherA-456571617-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:49:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0e2796894b249cc868a888fac759983',uuid=c10918e9-9731-48ea-860e-8a02cb6a0ad9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "address": "fa:16:3e:56:1c:d6", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8307e7-0d", "ovs_interfaceid": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Converting VIF {"id": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "address": "fa:16:3e:56:1c:d6", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8307e7-0d", "ovs_interfaceid": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:1c:d6,bridge_name='br-int',has_traffic_filtering=True,id=8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed,network=Network(6d954fa8-21ae-4438-b6c0-6ae7fb37718c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8307e7-0d') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG os_vif [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:1c:d6,bridge_name='br-int',has_traffic_filtering=True,id=8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed,network=Network(6d954fa8-21ae-4438-b6c0-6ae7fb37718c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8307e7-0d') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b8307e7-0d, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8b8307e7-0d, col_values=(('external_ids', {'iface-id': '8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:1c:d6', 'vm-uuid': 'c10918e9-9731-48ea-860e-8a02cb6a0ad9'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:05 user nova-compute[72239]: INFO os_vif [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:1c:d6,bridge_name='br-int',has_traffic_filtering=True,id=8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed,network=Network(6d954fa8-21ae-4438-b6c0-6ae7fb37718c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8307e7-0d')
Jul 31 14:49:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:49:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] No VIF found with MAC fa:16:3e:56:1c:d6, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:49:06 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:49:06 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:49:06 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 14:49:06 user nova-compute[72239]: DEBUG nova.network.neutron [req-b7977ad7-1cc1-4be9-a34d-b2a9164bc080 req-39739ee0-a47e-4e24-b827-b09666b924ef service nova] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Updated VIF entry in instance network info cache for port 8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:49:06 user nova-compute[72239]: DEBUG nova.network.neutron [req-b7977ad7-1cc1-4be9-a34d-b2a9164bc080 req-39739ee0-a47e-4e24-b827-b09666b924ef service nova] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Updating instance_info_cache with network_info: [{"id": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "address": "fa:16:3e:56:1c:d6", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8307e7-0d", "ovs_interfaceid": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:49:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b7977ad7-1cc1-4be9-a34d-b2a9164bc080 req-39739ee0-a47e-4e24-b827-b09666b924ef service nova] Releasing lock "refresh_cache-c10918e9-9731-48ea-860e-8a02cb6a0ad9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:49:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-d3e3612b-c6b9-4308-a45a-1ff3805e18bb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:49:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-d3e3612b-c6b9-4308-a45a-1ff3805e18bb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:49:06 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 14:49:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:08 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Updating instance_info_cache with network_info: [{"id": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "address": "fa:16:3e:f4:8d:da", "network": {"id": "ad1d78ca-d597-4586-8b1b-4dc00fac3c3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-398965992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "506aad3c95a94800a4cc333a3478da17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ef6541-6b", "ovs_interfaceid": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:49:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-d3e3612b-c6b9-4308-a45a-1ff3805e18bb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:49:08 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 14:49:08 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:49:08 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:49:08 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:49:08 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:49:08 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:49:08 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:49:08 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 14:49:08 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:49:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:49:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:49:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:49:08 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 14:49:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:08 user nova-compute[72239]: DEBUG nova.compute.manager [req-beea77f9-43f9-435c-a361-2b4f1ebabbe6 req-46e70ee8-c6b8-4d14-95f6-eb4306383796 service nova] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Received event network-vif-plugged-8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:49:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-beea77f9-43f9-435c-a361-2b4f1ebabbe6 req-46e70ee8-c6b8-4d14-95f6-eb4306383796 service nova] Acquiring lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:49:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-beea77f9-43f9-435c-a361-2b4f1ebabbe6 req-46e70ee8-c6b8-4d14-95f6-eb4306383796 service nova] Lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:49:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-beea77f9-43f9-435c-a361-2b4f1ebabbe6 req-46e70ee8-c6b8-4d14-95f6-eb4306383796 service nova] Lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:49:08 user nova-compute[72239]: DEBUG nova.compute.manager [req-beea77f9-43f9-435c-a361-2b4f1ebabbe6 req-46e70ee8-c6b8-4d14-95f6-eb4306383796 service nova] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] No waiting events found dispatching network-vif-plugged-8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:49:08 user nova-compute[72239]: WARNING nova.compute.manager [req-beea77f9-43f9-435c-a361-2b4f1ebabbe6 req-46e70ee8-c6b8-4d14-95f6-eb4306383796 service nova] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Received unexpected event network-vif-plugged-8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed for instance with vm_state building and task_state spawning.
Jul 31 14:49:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:49:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:10 user nova-compute[72239]: DEBUG nova.compute.manager [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:49:10 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 14:49:10 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814950.2674606, c10918e9-9731-48ea-860e-8a02cb6a0ad9 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:49:10 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] VM Resumed (Lifecycle Event)
Jul 31 14:49:10 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Instance spawned successfully.
Jul 31 14:49:10 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 14:49:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:10 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:49:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:10 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:49:10 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:49:10 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:49:10 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:49:10 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:49:10 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:49:10 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:49:10 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:49:10 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814950.2760677, c10918e9-9731-48ea-860e-8a02cb6a0ad9 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:49:10 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] VM Started (Lifecycle Event)
Jul 31 14:49:10 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:49:10 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:49:10 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:49:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json" returned: 0 in 0.318s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:10 user nova-compute[72239]: INFO nova.compute.manager [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Took 7.79 seconds to spawn the instance on the hypervisor.
Jul 31 14:49:10 user nova-compute[72239]: DEBUG nova.compute.manager [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:49:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:10 user nova-compute[72239]: INFO nova.compute.manager [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Took 9.32 seconds to build instance.
Jul 31 14:49:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7e1864f5-af73-4f4f-99ad-687eb388b720 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.496s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:49:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG nova.compute.manager [req-467f8daa-426c-4ab8-b48c-584efe0ddb55 req-55b4a513-f870-47fa-80f4-ecbe7255a662 service nova] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Received event network-vif-plugged-8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-467f8daa-426c-4ab8-b48c-584efe0ddb55 req-55b4a513-f870-47fa-80f4-ecbe7255a662 service nova] Acquiring lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-467f8daa-426c-4ab8-b48c-584efe0ddb55 req-55b4a513-f870-47fa-80f4-ecbe7255a662 service nova] Lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-467f8daa-426c-4ab8-b48c-584efe0ddb55 req-55b4a513-f870-47fa-80f4-ecbe7255a662 service nova] Lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG nova.compute.manager [req-467f8daa-426c-4ab8-b48c-584efe0ddb55 req-55b4a513-f870-47fa-80f4-ecbe7255a662 service nova] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] No waiting events found dispatching network-vif-plugged-8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:49:11 user nova-compute[72239]: WARNING nova.compute.manager [req-467f8daa-426c-4ab8-b48c-584efe0ddb55 req-55b4a513-f870-47fa-80f4-ecbe7255a662 service nova] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Received unexpected event network-vif-plugged-8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed for instance with vm_state active and task_state None.
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f11022e-a007-4d4c-adc1-b54ea59b9e6a/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f11022e-a007-4d4c-adc1-b54ea59b9e6a/disk.rescue --force-share --output=json" returned: 0 in 0.258s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f11022e-a007-4d4c-adc1-b54ea59b9e6a/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pWLKYmJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:49:11 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:49:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:49:11 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:49:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:49:11 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fdc3ac-4fa3-4b80-9d61-f4eec95e36e8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 14:49:11 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[17efdaa8-2945-4a35-b711-1ec3d4b8cae0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b] added
Jul 31 14:49:11 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f52e64-aaca-4767-b0bb-c48c8927bb41]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[596b99ab-74b7-4d0f-bb3e-d1bdf405f8b8]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pWLKYmJB {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f11022e-a007-4d4c-adc1-b54ea59b9e6a/disk.rescue --force-share --output=json" returned: 0 in 0.231s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d9bc124-66f7-4ccf-91f6-dcc4c2d78997/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pWLKYmJB" returned: 0 in 0.043s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e6938b-eb88-4bf4-9802-08d6f3d2d35d]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pWLKYmJB'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b979b2c0-555d-42a8-aeed-2dc0310f060d]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a5b790a-6fbd-4e45-8d5e-e9ac2ea713ad]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:49:11 user nova-compute[72239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)
Jul 31 14:49:11 user nova-compute[72239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:49:11 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:49:11 user nova-compute[72239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)
Jul 31 14:49:11 user nova-compute[72239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:49:11 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d96b41-f478-42f6-8268-1a564361fc17]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b, portal: 172.16.0.220,3260]
Jul 31 14:49:11 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b, portal: 172.16.0.220,3260] successful.
Jul 31 14:49:11 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d9bc124-66f7-4ccf-91f6-dcc4c2d78997/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d9bc124-66f7-4ccf-91f6-dcc4c2d78997/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ffb3cd-4bbf-4d77-bc50-d5f638160cd4]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f320e43-a6a6-4ee1-ba12-2fca3b100212]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:49:11 user nova-compute[72239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)
Jul 31 14:49:11 user nova-compute[72239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:49:11 user nova-compute[72239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b (non-flash)
Jul 31 14:49:11 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:49:11 user nova-compute[72239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)
Jul 31 14:49:11 user nova-compute[72239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:49:11 user nova-compute[72239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b (non-flash)
Jul 31 14:49:11 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.465s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.042s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1115015e-a18a-4803-931d-74f65cf1adc1]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:49:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pWLKYmJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 14:49:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0d9bc124-66f7-4ccf-91f6-dcc4c2d78997/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:49:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:49:12 user nova-compute[72239]: DEBUG nova.compute.manager [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 14:49:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62122879-2a72-4ddf-a028-317eda0da465/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:49:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:49:12 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 14:49:12 user nova-compute[72239]: INFO nova.compute.claims [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Claim successful on node user
Jul 31 14:49:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62122879-2a72-4ddf-a028-317eda0da465/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.533s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:49:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] <== connect_volume: return (1538ms) {'type': 'block', 'scsi_wwn': '23631323634396631', 'path': '/dev/sdd'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:49:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23631323634396631', 'path': '/dev/sdd'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 14:49:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62122879-2a72-4ddf-a028-317eda0da465/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:13 user nova-compute[72239]: DEBUG nova.objects.instance [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lazy-loading 'flavor' on Instance uuid 82116af8-3702-401b-8d00-9291d4caeb03 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:49:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 14:49:13 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:49:13 user nova-compute[72239]:   <source dev="/dev/sdd"/>
Jul 31 14:49:13 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:49:13 user nova-compute[72239]:   <serial>32b7cef1-8b74-487a-8939-0de22a5ca46b</serial>
Jul 31 14:49:13 user nova-compute[72239]: </disk>
Jul 31 14:49:13 user nova-compute[72239]:  {{(pid=72239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 14:49:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62122879-2a72-4ddf-a028-317eda0da465/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:49:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:49:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] No VIF found with MAC fa:16:3e:2e:96:96, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:49:13 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:49:13 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:49:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.821s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:49:13 user nova-compute[72239]: DEBUG nova.compute.manager [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 14:49:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e58836e2-0301-49b7-8619-5ad5627f56b4 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "82116af8-3702-401b-8d00-9291d4caeb03" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.077s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:49:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:49:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:13 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 14:49:13 user nova-compute[72239]: DEBUG nova.compute.manager [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 14:49:13 user nova-compute[72239]: DEBUG nova.network.neutron [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 14:49:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:14 user nova-compute[72239]: DEBUG nova.compute.manager [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 14:49:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:14 user nova-compute[72239]: DEBUG nova.policy [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2f8df817a91d41c8a421e2ba562c5015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18e5e2cd6854f0985aa161b1e8a6db7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 14:49:14 user nova-compute[72239]: DEBUG nova.compute.manager [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 14:49:14 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 14:49:14 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Creating image(s)
Jul 31 14:49:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "/opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:49:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "/opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:49:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "/opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:49:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.616s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "ca449065000c92aac3b7b9fa685f9a7710929444" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:49:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:49:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:14 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:49:14 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:49:14 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=7251MB free_disk=25.2733154296875GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 14:49:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:49:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:49:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.182s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:15 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Applying migration context for instance d3e3612b-c6b9-4308-a45a-1ff3805e18bb as it has an incoming, in-progress migration dd60a421-3ed6-462e-9ed9-0ca2f7ff54a0. Migration status is finished {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Jul 31 14:49:15 user nova-compute[72239]: INFO nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Updating resource usage from migration dd60a421-3ed6-462e-9ed9-0ca2f7ff54a0
Jul 31 14:49:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk 1073741824" returned: 0 in 0.064s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:49:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:15 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 20abf743-de5b-4122-aad0-e2124c7804b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:49:15 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 7d81b881-b44e-4fb3-8245-9dea634bdec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:49:15 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 079a5ed7-ee25-495b-a2a4-924d830a670a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:49:15 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 97917500-bc78-433b-8d3d-181ed13667dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:49:15 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 62122879-2a72-4ddf-a028-317eda0da465 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:49:15 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 82116af8-3702-401b-8d00-9291d4caeb03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:49:15 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 2f11022e-a007-4d4c-adc1-b54ea59b9e6a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:49:15 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:49:15 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Migration dd60a421-3ed6-462e-9ed9-0ca2f7ff54a0 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Jul 31 14:49:15 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance d3e3612b-c6b9-4308-a45a-1ff3805e18bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:49:15 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance c10918e9-9731-48ea-860e-8a02cb6a0ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:49:15 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance db15ad45-8f28-4e0c-8d7e-7db75f33fe92 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:49:15 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 14:49:15 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 14:49:15 user nova-compute[72239]: DEBUG nova.network.neutron [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Successfully created port: 4a60ced2-5c35-4f83-9734-e812bce6fad2 {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:49:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.230s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:15 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Checking if we can resize image /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 14:49:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:15 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Cannot resize image /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 14:49:15 user nova-compute[72239]: DEBUG nova.objects.instance [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lazy-loading 'migration_context' on Instance uuid db15ad45-8f28-4e0c-8d7e-7db75f33fe92 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:49:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 14:49:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Ensure instance console log exists: /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 14:49:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:49:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:49:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:49:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:15 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:49:15 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:49:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 14:49:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.346s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:49:16 user nova-compute[72239]: DEBUG nova.network.neutron [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Successfully updated port: 4a60ced2-5c35-4f83-9734-e812bce6fad2 {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:49:16 user nova-compute[72239]: DEBUG nova.compute.manager [req-0cb058cc-1213-448b-8506-51459c587a3f req-c9d88a40-a675-47d8-a2c0-cc48660ea464 service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Received event network-changed-4a60ced2-5c35-4f83-9734-e812bce6fad2 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:49:16 user nova-compute[72239]: DEBUG nova.compute.manager [req-0cb058cc-1213-448b-8506-51459c587a3f req-c9d88a40-a675-47d8-a2c0-cc48660ea464 service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Refreshing instance network info cache due to event network-changed-4a60ced2-5c35-4f83-9734-e812bce6fad2. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:49:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0cb058cc-1213-448b-8506-51459c587a3f req-c9d88a40-a675-47d8-a2c0-cc48660ea464 service nova] Acquiring lock "refresh_cache-db15ad45-8f28-4e0c-8d7e-7db75f33fe92" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:49:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0cb058cc-1213-448b-8506-51459c587a3f req-c9d88a40-a675-47d8-a2c0-cc48660ea464 service nova] Acquired lock "refresh_cache-db15ad45-8f28-4e0c-8d7e-7db75f33fe92" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:49:16 user nova-compute[72239]: DEBUG nova.network.neutron [req-0cb058cc-1213-448b-8506-51459c587a3f req-c9d88a40-a675-47d8-a2c0-cc48660ea464 service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Refreshing network info cache for port 4a60ced2-5c35-4f83-9734-e812bce6fad2 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:49:16 user nova-compute[72239]: DEBUG nova.network.neutron [req-0cb058cc-1213-448b-8506-51459c587a3f req-c9d88a40-a675-47d8-a2c0-cc48660ea464 service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:49:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "refresh_cache-db15ad45-8f28-4e0c-8d7e-7db75f33fe92" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7d0b7126-f5c6-4ecf-a067-6d7526dcc883 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Acquiring lock "82116af8-3702-401b-8d00-9291d4caeb03" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7d0b7126-f5c6-4ecf-a067-6d7526dcc883 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "82116af8-3702-401b-8d00-9291d4caeb03" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:49:17 user nova-compute[72239]: INFO nova.compute.manager [None req-7d0b7126-f5c6-4ecf-a067-6d7526dcc883 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Detaching volume 32b7cef1-8b74-487a-8939-0de22a5ca46b
Jul 31 14:49:17 user nova-compute[72239]: INFO nova.virt.block_device [None req-7d0b7126-f5c6-4ecf-a067-6d7526dcc883 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Attempting to driver detach volume 32b7cef1-8b74-487a-8939-0de22a5ca46b from mountpoint /dev/vdb
Jul 31 14:49:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7d0b7126-f5c6-4ecf-a067-6d7526dcc883 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Attempting to detach device vdb from instance 82116af8-3702-401b-8d00-9291d4caeb03 from the persistent domain config. {{(pid=72239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-7d0b7126-f5c6-4ecf-a067-6d7526dcc883 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 14:49:17 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:49:17 user nova-compute[72239]:   <source dev="/dev/sdd"/>
Jul 31 14:49:17 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:49:17 user nova-compute[72239]:   <serial>32b7cef1-8b74-487a-8939-0de22a5ca46b</serial>
Jul 31 14:49:17 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 14:49:17 user nova-compute[72239]: </disk>
Jul 31 14:49:17 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG nova.network.neutron [req-0cb058cc-1213-448b-8506-51459c587a3f req-c9d88a40-a675-47d8-a2c0-cc48660ea464 service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:49:17 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-7d0b7126-f5c6-4ecf-a067-6d7526dcc883 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Successfully detached device vdb from instance 82116af8-3702-401b-8d00-9291d4caeb03 from the persistent domain config.
Jul 31 14:49:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7d0b7126-f5c6-4ecf-a067-6d7526dcc883 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 82116af8-3702-401b-8d00-9291d4caeb03 from the live domain config. {{(pid=72239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-7d0b7126-f5c6-4ecf-a067-6d7526dcc883 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 14:49:17 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:49:17 user nova-compute[72239]:   <source dev="/dev/sdd"/>
Jul 31 14:49:17 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:49:17 user nova-compute[72239]:   <serial>32b7cef1-8b74-487a-8939-0de22a5ca46b</serial>
Jul 31 14:49:17 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 14:49:17 user nova-compute[72239]: </disk>
Jul 31 14:49:17 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0cb058cc-1213-448b-8506-51459c587a3f req-c9d88a40-a675-47d8-a2c0-cc48660ea464 service nova] Releasing lock "refresh_cache-db15ad45-8f28-4e0c-8d7e-7db75f33fe92" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquired lock "refresh_cache-db15ad45-8f28-4e0c-8d7e-7db75f33fe92" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG nova.network.neutron [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG nova.network.neutron [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG nova.network.neutron [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Updating instance_info_cache with network_info: [{"id": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "address": "fa:16:3e:55:1a:9a", "network": {"id": "50e01a2d-5e91-4aca-a74c-7687f91ed21e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-937098047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e5e2cd6854f0985aa161b1e8a6db7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a60ced2-5c", "ovs_interfaceid": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Received event <DeviceRemovedEvent: 1690814957.7525818, 82116af8-3702-401b-8d00-9291d4caeb03 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72239) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7d0b7126-f5c6-4ecf-a067-6d7526dcc883 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 82116af8-3702-401b-8d00-9291d4caeb03 {{(pid=72239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 14:49:17 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-7d0b7126-f5c6-4ecf-a067-6d7526dcc883 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Successfully detached device vdb from instance 82116af8-3702-401b-8d00-9291d4caeb03 from the live domain config.
Jul 31 14:49:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d0b7126-f5c6-4ecf-a067-6d7526dcc883 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0b7126-f5c6-4ecf-a067-6d7526dcc883 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pWLKYmJB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:49:17 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-7d0b7126-f5c6-4ecf-a067-6d7526dcc883 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:49:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-7d0b7126-f5c6-4ecf-a067-6d7526dcc883 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-7d0b7126-f5c6-4ecf-a067-6d7526dcc883 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0b7126-f5c6-4ecf-a067-6d7526dcc883 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Releasing lock "refresh_cache-db15ad45-8f28-4e0c-8d7e-7db75f33fe92" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG nova.compute.manager [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Instance network_info: |[{"id": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "address": "fa:16:3e:55:1a:9a", "network": {"id": "50e01a2d-5e91-4aca-a74c-7687f91ed21e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-937098047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e5e2cd6854f0985aa161b1e8a6db7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a60ced2-5c", "ovs_interfaceid": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Start _get_guest_xml network_info=[{"id": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "address": "fa:16:3e:55:1a:9a", "network": {"id": "50e01a2d-5e91-4aca-a74c-7687f91ed21e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-937098047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e5e2cd6854f0985aa161b1e8a6db7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a60ced2-5c", "ovs_interfaceid": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[287c3d7a-a6ab-4b6c-9bf7-74e4540203ca]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:49:17 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:49:17 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:49:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:49:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1651644081',display_name='tempest-AttachVolumeTestJSON-server-1651644081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1651644081',id=17,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLc/1qoHPqiofv/4pq100FlHUUylmOhucQEOjm11Kc1EqvJcfHvM7rWQswLn8aCkbuoEn1btWVn/JCFreVgCA/Qh5g2ERD7C+D0EfwpykQR0pThmq61xI0NeRT3g5N4h2A==',key_name='tempest-keypair-1206654507',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a18e5e2cd6854f0985aa161b1e8a6db7',ramdisk_id='',reservation_id='r-32farejl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-853601938',owner_user_name='tempest-AttachVolumeTestJSON-853601938-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:49:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f8df817a91d41c8a421e2ba562c5015',uuid=db15ad45-8f28-4e0c-8d7e-7db75f33fe92,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "address": "fa:16:3e:55:1a:9a", "network": {"id": "50e01a2d-5e91-4aca-a74c-7687f91ed21e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-937098047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e5e2cd6854f0985aa161b1e8a6db7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a60ced2-5c", "ovs_interfaceid": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Converting VIF {"id": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "address": "fa:16:3e:55:1a:9a", "network": {"id": "50e01a2d-5e91-4aca-a74c-7687f91ed21e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-937098047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e5e2cd6854f0985aa161b1e8a6db7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a60ced2-5c", "ovs_interfaceid": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:1a:9a,bridge_name='br-int',has_traffic_filtering=True,id=4a60ced2-5c35-4f83-9734-e812bce6fad2,network=Network(50e01a2d-5e91-4aca-a74c-7687f91ed21e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a60ced2-5c') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG nova.objects.instance [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lazy-loading 'pci_devices' on Instance uuid db15ad45-8f28-4e0c-8d7e-7db75f33fe92 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6a60c5-42f2-4bcb-a56c-d96e457a7fce]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0b7126-f5c6-4ecf-a067-6d7526dcc883 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:49:17 user nova-compute[72239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)
Jul 31 14:49:17 user nova-compute[72239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:49:17 user nova-compute[72239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b (non-flash)
Jul 31 14:49:17 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0b7126-f5c6-4ecf-a067-6d7526dcc883 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:49:17 user nova-compute[72239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)
Jul 31 14:49:17 user nova-compute[72239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:49:17 user nova-compute[72239]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b (non-flash)
Jul 31 14:49:17 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0b7126-f5c6-4ecf-a067-6d7526dcc883 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41202d1b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b'): ({'sdd'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-7d0b7126-f5c6-4ecf-a067-6d7526dcc883 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Removing single pathed devices sdd {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:49:17 user nova-compute[72239]:   <uuid>db15ad45-8f28-4e0c-8d7e-7db75f33fe92</uuid>
Jul 31 14:49:17 user nova-compute[72239]:   <name>instance-00000011</name>
Jul 31 14:49:17 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:49:17 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:49:17 user nova-compute[72239]:   <metadata>
Jul 31 14:49:17 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:49:17 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:49:17 user nova-compute[72239]:       <nova:name>tempest-AttachVolumeTestJSON-server-1651644081</nova:name>
Jul 31 14:49:17 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:49:17</nova:creationTime>
Jul 31 14:49:17 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:49:17 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:49:17 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:49:17 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:49:17 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:49:17 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:49:17 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:49:17 user nova-compute[72239]:       <nova:owner>
Jul 31 14:49:17 user nova-compute[72239]:         <nova:user uuid="2f8df817a91d41c8a421e2ba562c5015">tempest-AttachVolumeTestJSON-853601938-project-member</nova:user>
Jul 31 14:49:17 user nova-compute[72239]:         <nova:project uuid="a18e5e2cd6854f0985aa161b1e8a6db7">tempest-AttachVolumeTestJSON-853601938</nova:project>
Jul 31 14:49:17 user nova-compute[72239]:       </nova:owner>
Jul 31 14:49:17 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:49:17 user nova-compute[72239]:       <nova:ports>
Jul 31 14:49:17 user nova-compute[72239]:         <nova:port uuid="4a60ced2-5c35-4f83-9734-e812bce6fad2">
Jul 31 14:49:17 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 31 14:49:17 user nova-compute[72239]:         </nova:port>
Jul 31 14:49:17 user nova-compute[72239]:       </nova:ports>
Jul 31 14:49:17 user nova-compute[72239]:     </nova:instance>
Jul 31 14:49:17 user nova-compute[72239]:   </metadata>
Jul 31 14:49:17 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:49:17 user nova-compute[72239]:     <system>
Jul 31 14:49:17 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:49:17 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:49:17 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:49:17 user nova-compute[72239]:       <entry name="serial">db15ad45-8f28-4e0c-8d7e-7db75f33fe92</entry>
Jul 31 14:49:17 user nova-compute[72239]:       <entry name="uuid">db15ad45-8f28-4e0c-8d7e-7db75f33fe92</entry>
Jul 31 14:49:17 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:49:17 user nova-compute[72239]:     </system>
Jul 31 14:49:17 user nova-compute[72239]:   </sysinfo>
Jul 31 14:49:17 user nova-compute[72239]:   <os>
Jul 31 14:49:17 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:49:17 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:49:17 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:49:17 user nova-compute[72239]:   </os>
Jul 31 14:49:17 user nova-compute[72239]:   <features>
Jul 31 14:49:17 user nova-compute[72239]:     <acpi/>
Jul 31 14:49:17 user nova-compute[72239]:     <apic/>
Jul 31 14:49:17 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:49:17 user nova-compute[72239]:   </features>
Jul 31 14:49:17 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:49:17 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:49:17 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:49:17 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:49:17 user nova-compute[72239]:   </clock>
Jul 31 14:49:17 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:49:17 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:49:17 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:49:17 user nova-compute[72239]:   </cpu>
Jul 31 14:49:17 user nova-compute[72239]:   <devices>
Jul 31 14:49:17 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:49:17 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:49:17 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk"/>
Jul 31 14:49:17 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:49:17 user nova-compute[72239]:     </disk>
Jul 31 14:49:17 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:49:17 user nova-compute[72239]:       <mac address="fa:16:3e:55:1a:9a"/>
Jul 31 14:49:17 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:49:17 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:49:17 user nova-compute[72239]:       <target dev="tap4a60ced2-5c"/>
Jul 31 14:49:17 user nova-compute[72239]:     </interface>
Jul 31 14:49:17 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:49:17 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/console.log" append="off"/>
Jul 31 14:49:17 user nova-compute[72239]:     </serial>
Jul 31 14:49:17 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:49:17 user nova-compute[72239]:     <video>
Jul 31 14:49:17 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:49:17 user nova-compute[72239]:     </video>
Jul 31 14:49:17 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:49:17 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:49:17 user nova-compute[72239]:     </rng>
Jul 31 14:49:17 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:49:17 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:49:17 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:49:17 user nova-compute[72239]:     </memballoon>
Jul 31 14:49:17 user nova-compute[72239]:   </devices>
Jul 31 14:49:17 user nova-compute[72239]: </domain>
Jul 31 14:49:17 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:49:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1651644081',display_name='tempest-AttachVolumeTestJSON-server-1651644081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1651644081',id=17,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLc/1qoHPqiofv/4pq100FlHUUylmOhucQEOjm11Kc1EqvJcfHvM7rWQswLn8aCkbuoEn1btWVn/JCFreVgCA/Qh5g2ERD7C+D0EfwpykQR0pThmq61xI0NeRT3g5N4h2A==',key_name='tempest-keypair-1206654507',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a18e5e2cd6854f0985aa161b1e8a6db7',ramdisk_id='',reservation_id='r-32farejl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-853601938',owner_user_name='tempest-AttachVolumeTestJSON-853601938-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:49:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f8df817a91d41c8a421e2ba562c5015',uuid=db15ad45-8f28-4e0c-8d7e-7db75f33fe92,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "address": "fa:16:3e:55:1a:9a", "network": {"id": "50e01a2d-5e91-4aca-a74c-7687f91ed21e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-937098047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e5e2cd6854f0985aa161b1e8a6db7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a60ced2-5c", "ovs_interfaceid": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Converting VIF {"id": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "address": "fa:16:3e:55:1a:9a", "network": {"id": "50e01a2d-5e91-4aca-a74c-7687f91ed21e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-937098047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e5e2cd6854f0985aa161b1e8a6db7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a60ced2-5c", "ovs_interfaceid": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:1a:9a,bridge_name='br-int',has_traffic_filtering=True,id=4a60ced2-5c35-4f83-9734-e812bce6fad2,network=Network(50e01a2d-5e91-4aca-a74c-7687f91ed21e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a60ced2-5c') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG os_vif [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:1a:9a,bridge_name='br-int',has_traffic_filtering=True,id=4a60ced2-5c35-4f83-9734-e812bce6fad2,network=Network(50e01a2d-5e91-4aca-a74c-7687f91ed21e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a60ced2-5c') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a60ced2-5c, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4a60ced2-5c, col_values=(('external_ids', {'iface-id': '4a60ced2-5c35-4f83-9734-e812bce6fad2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:1a:9a', 'vm-uuid': 'db15ad45-8f28-4e0c-8d7e-7db75f33fe92'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4561ee2-25b2-45e7-be0b-e34c89fab5a6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:17 user nova-compute[72239]: INFO os_vif [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:1a:9a,bridge_name='br-int',has_traffic_filtering=True,id=4a60ced2-5c35-4f83-9734-e812bce6fad2,network=Network(50e01a2d-5e91-4aca-a74c-7687f91ed21e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a60ced2-5c')
Jul 31 14:49:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfab7d9c-5773-4166-bf0b-4bf54193403d]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-7d0b7126-f5c6-4ecf-a067-6d7526dcc883 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Flushing IO for device /dev/sdd {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce7d498-5a67-4f54-b83b-50d9067ecea9]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-7d0b7126-f5c6-4ecf-a067-6d7526dcc883 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[065aba8f-0fca-4a4b-8304-5770c8841a89]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-7d0b7126-f5c6-4ecf-a067-6d7526dcc883 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-7d0b7126-f5c6-4ecf-a067-6d7526dcc883 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] SCSI volumes sdd have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 14:49:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0b7126-f5c6-4ecf-a067-6d7526dcc883 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 14:49:18 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:49:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] No VIF found with MAC fa:16:3e:55:1a:9a, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:49:18 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:18 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f1b012-0773-47d2-a71a-2835bab3b98e]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:49:18 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0b7126-f5c6-4ecf-a067-6d7526dcc883 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:49:18 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:18 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:18 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6057f75-ca35-4934-b760-846fd7a3ccce]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:49:18 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0b7126-f5c6-4ecf-a067-6d7526dcc883 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b, portal: 172.16.0.220,3260]
Jul 31 14:49:18 user nova-compute[72239]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b, portal: 172.16.0.220,3260] successful.
Jul 31 14:49:18 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:49:18 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:18 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:32b7cef1-8b74-487a-8939-0de22a5ca46b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:18 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7e438e-86fd-45f8-819d-a86d4d27d6a3]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:49:18 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0b7126-f5c6-4ecf-a067-6d7526dcc883 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:49:18 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-7d0b7126-f5c6-4ecf-a067-6d7526dcc883 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.354s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:49:18 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d0b7126-f5c6-4ecf-a067-6d7526dcc883 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] <== disconnect_volume: return (356ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:49:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d0b7126-f5c6-4ecf-a067-6d7526dcc883 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 14:49:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:19 user nova-compute[72239]: DEBUG nova.objects.instance [None req-7d0b7126-f5c6-4ecf-a067-6d7526dcc883 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lazy-loading 'flavor' on Instance uuid 82116af8-3702-401b-8d00-9291d4caeb03 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:49:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7d0b7126-f5c6-4ecf-a067-6d7526dcc883 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "82116af8-3702-401b-8d00-9291d4caeb03" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.083s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:49:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:20 user nova-compute[72239]: DEBUG nova.compute.manager [req-64f1f39f-f143-4e76-9bd7-72bd2e7009a7 req-1e804118-6014-4279-a5a5-79e364d1d441 service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Received event network-vif-plugged-4a60ced2-5c35-4f83-9734-e812bce6fad2 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:49:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-64f1f39f-f143-4e76-9bd7-72bd2e7009a7 req-1e804118-6014-4279-a5a5-79e364d1d441 service nova] Acquiring lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:49:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-64f1f39f-f143-4e76-9bd7-72bd2e7009a7 req-1e804118-6014-4279-a5a5-79e364d1d441 service nova] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:49:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-64f1f39f-f143-4e76-9bd7-72bd2e7009a7 req-1e804118-6014-4279-a5a5-79e364d1d441 service nova] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:49:20 user nova-compute[72239]: DEBUG nova.compute.manager [req-64f1f39f-f143-4e76-9bd7-72bd2e7009a7 req-1e804118-6014-4279-a5a5-79e364d1d441 service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] No waiting events found dispatching network-vif-plugged-4a60ced2-5c35-4f83-9734-e812bce6fad2 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:49:20 user nova-compute[72239]: WARNING nova.compute.manager [req-64f1f39f-f143-4e76-9bd7-72bd2e7009a7 req-1e804118-6014-4279-a5a5-79e364d1d441 service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Received unexpected event network-vif-plugged-4a60ced2-5c35-4f83-9734-e812bce6fad2 for instance with vm_state building and task_state spawning.
Jul 31 14:49:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:22 user nova-compute[72239]: DEBUG nova.compute.manager [req-44092580-c66d-4053-a1fd-881df254c8b1 req-18dfcfd1-dc0c-43e9-aaad-1ce92858e987 service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Received event network-vif-plugged-4a60ced2-5c35-4f83-9734-e812bce6fad2 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:49:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-44092580-c66d-4053-a1fd-881df254c8b1 req-18dfcfd1-dc0c-43e9-aaad-1ce92858e987 service nova] Acquiring lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:49:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-44092580-c66d-4053-a1fd-881df254c8b1 req-18dfcfd1-dc0c-43e9-aaad-1ce92858e987 service nova] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:49:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-44092580-c66d-4053-a1fd-881df254c8b1 req-18dfcfd1-dc0c-43e9-aaad-1ce92858e987 service nova] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:49:22 user nova-compute[72239]: DEBUG nova.compute.manager [req-44092580-c66d-4053-a1fd-881df254c8b1 req-18dfcfd1-dc0c-43e9-aaad-1ce92858e987 service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] No waiting events found dispatching network-vif-plugged-4a60ced2-5c35-4f83-9734-e812bce6fad2 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:49:22 user nova-compute[72239]: WARNING nova.compute.manager [req-44092580-c66d-4053-a1fd-881df254c8b1 req-18dfcfd1-dc0c-43e9-aaad-1ce92858e987 service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Received unexpected event network-vif-plugged-4a60ced2-5c35-4f83-9734-e812bce6fad2 for instance with vm_state building and task_state spawning.
Jul 31 14:49:22 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814962.2485132, db15ad45-8f28-4e0c-8d7e-7db75f33fe92 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:49:22 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] VM Resumed (Lifecycle Event)
Jul 31 14:49:22 user nova-compute[72239]: DEBUG nova.compute.manager [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:49:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 14:49:22 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Instance spawned successfully.
Jul 31 14:49:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 14:49:22 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:49:22 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:49:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:49:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:49:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:49:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:49:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:49:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:49:22 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:49:22 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814962.2490563, db15ad45-8f28-4e0c-8d7e-7db75f33fe92 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:49:22 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] VM Started (Lifecycle Event)
Jul 31 14:49:22 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:49:22 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:49:22 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:49:22 user nova-compute[72239]: INFO nova.compute.manager [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Took 8.20 seconds to spawn the instance on the hypervisor.
Jul 31 14:49:22 user nova-compute[72239]: DEBUG nova.compute.manager [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:49:22 user nova-compute[72239]: INFO nova.compute.manager [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Took 9.61 seconds to build instance.
Jul 31 14:49:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-648f7bef-db84-49a5-83c5-6c631bd566bf tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.829s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:49:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Acquiring lock "1e626a09-1282-4864-8336-6720c7caa0da" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:49:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "1e626a09-1282-4864-8336-6720c7caa0da" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:49:23 user nova-compute[72239]: DEBUG nova.compute.manager [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 14:49:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:49:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:49:23 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 14:49:23 user nova-compute[72239]: INFO nova.compute.claims [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Claim successful on node user
Jul 31 14:49:23 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:24 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:49:24 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:49:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.748s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:49:24 user nova-compute[72239]: DEBUG nova.compute.manager [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 14:49:24 user nova-compute[72239]: DEBUG nova.compute.manager [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 14:49:24 user nova-compute[72239]: DEBUG nova.network.neutron [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 14:49:24 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 14:49:24 user nova-compute[72239]: DEBUG nova.compute.manager [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 14:49:24 user nova-compute[72239]: DEBUG nova.policy [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c842cf4052f4822948614bb63072812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd888450f903d41c5b6fde5de0b513a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 14:49:24 user nova-compute[72239]: DEBUG nova.compute.manager [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 14:49:24 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 14:49:24 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Creating image(s)
Jul 31 14:49:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Acquiring lock "/opt/stack/data/nova/instances/1e626a09-1282-4864-8336-6720c7caa0da/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:49:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "/opt/stack/data/nova/instances/1e626a09-1282-4864-8336-6720c7caa0da/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:49:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "/opt/stack/data/nova/instances/1e626a09-1282-4864-8336-6720c7caa0da/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:49:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.212s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Acquiring lock "ca449065000c92aac3b7b9fa685f9a7710929444" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:49:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:49:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.196s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/1e626a09-1282-4864-8336-6720c7caa0da/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/1e626a09-1282-4864-8336-6720c7caa0da/disk 1073741824" returned: 0 in 0.078s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:49:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:25 user nova-compute[72239]: DEBUG nova.network.neutron [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Successfully created port: ccc3c5f4-a0e1-4844-a193-b56945bf71a2 {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:49:25 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.173s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:25 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1e626a09-1282-4864-8336-6720c7caa0da/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 14:49:25 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e626a09-1282-4864-8336-6720c7caa0da/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:49:25 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e626a09-1282-4864-8336-6720c7caa0da/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:49:25 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Cannot resize image /opt/stack/data/nova/instances/1e626a09-1282-4864-8336-6720c7caa0da/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 14:49:25 user nova-compute[72239]: DEBUG nova.objects.instance [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lazy-loading 'migration_context' on Instance uuid 1e626a09-1282-4864-8336-6720c7caa0da {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:49:25 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 14:49:25 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Ensure instance console log exists: /opt/stack/data/nova/instances/1e626a09-1282-4864-8336-6720c7caa0da/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 14:49:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:49:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:49:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG nova.network.neutron [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Successfully updated port: ccc3c5f4-a0e1-4844-a193-b56945bf71a2 {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Acquiring lock "refresh_cache-1e626a09-1282-4864-8336-6720c7caa0da" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Acquired lock "refresh_cache-1e626a09-1282-4864-8336-6720c7caa0da" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG nova.network.neutron [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG nova.compute.manager [req-af3a94d6-c99f-490d-8e43-fca394062410 req-cd3c22cc-7959-4883-900c-e179ee2dd918 service nova] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Received event network-changed-ccc3c5f4-a0e1-4844-a193-b56945bf71a2 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG nova.compute.manager [req-af3a94d6-c99f-490d-8e43-fca394062410 req-cd3c22cc-7959-4883-900c-e179ee2dd918 service nova] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Refreshing instance network info cache due to event network-changed-ccc3c5f4-a0e1-4844-a193-b56945bf71a2. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-af3a94d6-c99f-490d-8e43-fca394062410 req-cd3c22cc-7959-4883-900c-e179ee2dd918 service nova] Acquiring lock "refresh_cache-1e626a09-1282-4864-8336-6720c7caa0da" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG nova.network.neutron [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG nova.network.neutron [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Updating instance_info_cache with network_info: [{"id": "ccc3c5f4-a0e1-4844-a193-b56945bf71a2", "address": "fa:16:3e:18:b6:8f", "network": {"id": "807530ad-b1c8-4426-9036-a796ba7dee91", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-277511856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d888450f903d41c5b6fde5de0b513a84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccc3c5f4-a0", "ovs_interfaceid": "ccc3c5f4-a0e1-4844-a193-b56945bf71a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Releasing lock "refresh_cache-1e626a09-1282-4864-8336-6720c7caa0da" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG nova.compute.manager [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Instance network_info: |[{"id": "ccc3c5f4-a0e1-4844-a193-b56945bf71a2", "address": "fa:16:3e:18:b6:8f", "network": {"id": "807530ad-b1c8-4426-9036-a796ba7dee91", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-277511856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d888450f903d41c5b6fde5de0b513a84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccc3c5f4-a0", "ovs_interfaceid": "ccc3c5f4-a0e1-4844-a193-b56945bf71a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-af3a94d6-c99f-490d-8e43-fca394062410 req-cd3c22cc-7959-4883-900c-e179ee2dd918 service nova] Acquired lock "refresh_cache-1e626a09-1282-4864-8336-6720c7caa0da" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG nova.network.neutron [req-af3a94d6-c99f-490d-8e43-fca394062410 req-cd3c22cc-7959-4883-900c-e179ee2dd918 service nova] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Refreshing network info cache for port ccc3c5f4-a0e1-4844-a193-b56945bf71a2 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Start _get_guest_xml network_info=[{"id": "ccc3c5f4-a0e1-4844-a193-b56945bf71a2", "address": "fa:16:3e:18:b6:8f", "network": {"id": "807530ad-b1c8-4426-9036-a796ba7dee91", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-277511856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d888450f903d41c5b6fde5de0b513a84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccc3c5f4-a0", "ovs_interfaceid": "ccc3c5f4-a0e1-4844-a193-b56945bf71a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:49:26 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:49:26 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:49:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:49:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1779041065',display_name='tempest-VolumesSnapshotTestJSON-instance-1779041065',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1779041065',id=18,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrSoaNrdvepS2CVBLnx26vmHUJXTnOOByJ7ZgRP59n/aaMblKHXjI0w+QD690h1MduepNaDFnoNU5TAjAnoqinK+oMc1rtFqInABCwIsZG0taFHE8rv7UL+syU8S9hE9w==',key_name='tempest-keypair-2036772718',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d888450f903d41c5b6fde5de0b513a84',ramdisk_id='',reservation_id='r-vjn61cas',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2087706080',owner_user_name='tempest-VolumesSnapshotTestJSON-2087706080-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:49:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c842cf4052f4822948614bb63072812',uuid=1e626a09-1282-4864-8336-6720c7caa0da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccc3c5f4-a0e1-4844-a193-b56945bf71a2", "address": "fa:16:3e:18:b6:8f", "network": {"id": "807530ad-b1c8-4426-9036-a796ba7dee91", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-277511856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d888450f903d41c5b6fde5de0b513a84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccc3c5f4-a0", "ovs_interfaceid": "ccc3c5f4-a0e1-4844-a193-b56945bf71a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Converting VIF {"id": "ccc3c5f4-a0e1-4844-a193-b56945bf71a2", "address": "fa:16:3e:18:b6:8f", "network": {"id": "807530ad-b1c8-4426-9036-a796ba7dee91", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-277511856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d888450f903d41c5b6fde5de0b513a84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccc3c5f4-a0", "ovs_interfaceid": "ccc3c5f4-a0e1-4844-a193-b56945bf71a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:b6:8f,bridge_name='br-int',has_traffic_filtering=True,id=ccc3c5f4-a0e1-4844-a193-b56945bf71a2,network=Network(807530ad-b1c8-4426-9036-a796ba7dee91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccc3c5f4-a0') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG nova.objects.instance [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e626a09-1282-4864-8336-6720c7caa0da {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:49:26 user nova-compute[72239]:   <uuid>1e626a09-1282-4864-8336-6720c7caa0da</uuid>
Jul 31 14:49:26 user nova-compute[72239]:   <name>instance-00000012</name>
Jul 31 14:49:26 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:49:26 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:49:26 user nova-compute[72239]:   <metadata>
Jul 31 14:49:26 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:49:26 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:49:26 user nova-compute[72239]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1779041065</nova:name>
Jul 31 14:49:26 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:49:26</nova:creationTime>
Jul 31 14:49:26 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:49:26 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:49:26 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:49:26 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:49:26 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:49:26 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:49:26 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:49:26 user nova-compute[72239]:       <nova:owner>
Jul 31 14:49:26 user nova-compute[72239]:         <nova:user uuid="3c842cf4052f4822948614bb63072812">tempest-VolumesSnapshotTestJSON-2087706080-project-member</nova:user>
Jul 31 14:49:26 user nova-compute[72239]:         <nova:project uuid="d888450f903d41c5b6fde5de0b513a84">tempest-VolumesSnapshotTestJSON-2087706080</nova:project>
Jul 31 14:49:26 user nova-compute[72239]:       </nova:owner>
Jul 31 14:49:26 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:49:26 user nova-compute[72239]:       <nova:ports>
Jul 31 14:49:26 user nova-compute[72239]:         <nova:port uuid="ccc3c5f4-a0e1-4844-a193-b56945bf71a2">
Jul 31 14:49:26 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 31 14:49:26 user nova-compute[72239]:         </nova:port>
Jul 31 14:49:26 user nova-compute[72239]:       </nova:ports>
Jul 31 14:49:26 user nova-compute[72239]:     </nova:instance>
Jul 31 14:49:26 user nova-compute[72239]:   </metadata>
Jul 31 14:49:26 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:49:26 user nova-compute[72239]:     <system>
Jul 31 14:49:26 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:49:26 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:49:26 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:49:26 user nova-compute[72239]:       <entry name="serial">1e626a09-1282-4864-8336-6720c7caa0da</entry>
Jul 31 14:49:26 user nova-compute[72239]:       <entry name="uuid">1e626a09-1282-4864-8336-6720c7caa0da</entry>
Jul 31 14:49:26 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:49:26 user nova-compute[72239]:     </system>
Jul 31 14:49:26 user nova-compute[72239]:   </sysinfo>
Jul 31 14:49:26 user nova-compute[72239]:   <os>
Jul 31 14:49:26 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:49:26 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:49:26 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:49:26 user nova-compute[72239]:   </os>
Jul 31 14:49:26 user nova-compute[72239]:   <features>
Jul 31 14:49:26 user nova-compute[72239]:     <acpi/>
Jul 31 14:49:26 user nova-compute[72239]:     <apic/>
Jul 31 14:49:26 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:49:26 user nova-compute[72239]:   </features>
Jul 31 14:49:26 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:49:26 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:49:26 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:49:26 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:49:26 user nova-compute[72239]:   </clock>
Jul 31 14:49:26 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:49:26 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:49:26 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:49:26 user nova-compute[72239]:   </cpu>
Jul 31 14:49:26 user nova-compute[72239]:   <devices>
Jul 31 14:49:26 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:49:26 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:49:26 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/1e626a09-1282-4864-8336-6720c7caa0da/disk"/>
Jul 31 14:49:26 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:49:26 user nova-compute[72239]:     </disk>
Jul 31 14:49:26 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:49:26 user nova-compute[72239]:       <mac address="fa:16:3e:18:b6:8f"/>
Jul 31 14:49:26 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:49:26 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:49:26 user nova-compute[72239]:       <target dev="tapccc3c5f4-a0"/>
Jul 31 14:49:26 user nova-compute[72239]:     </interface>
Jul 31 14:49:26 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:49:26 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/1e626a09-1282-4864-8336-6720c7caa0da/console.log" append="off"/>
Jul 31 14:49:26 user nova-compute[72239]:     </serial>
Jul 31 14:49:26 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:49:26 user nova-compute[72239]:     <video>
Jul 31 14:49:26 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:49:26 user nova-compute[72239]:     </video>
Jul 31 14:49:26 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:49:26 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:49:26 user nova-compute[72239]:     </rng>
Jul 31 14:49:26 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:49:26 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:49:26 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:49:26 user nova-compute[72239]:     </memballoon>
Jul 31 14:49:26 user nova-compute[72239]:   </devices>
Jul 31 14:49:26 user nova-compute[72239]: </domain>
Jul 31 14:49:26 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:49:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1779041065',display_name='tempest-VolumesSnapshotTestJSON-instance-1779041065',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1779041065',id=18,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrSoaNrdvepS2CVBLnx26vmHUJXTnOOByJ7ZgRP59n/aaMblKHXjI0w+QD690h1MduepNaDFnoNU5TAjAnoqinK+oMc1rtFqInABCwIsZG0taFHE8rv7UL+syU8S9hE9w==',key_name='tempest-keypair-2036772718',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d888450f903d41c5b6fde5de0b513a84',ramdisk_id='',reservation_id='r-vjn61cas',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2087706080',owner_user_name='tempest-VolumesSnapshotTestJSON-2087706080-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:49:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c842cf4052f4822948614bb63072812',uuid=1e626a09-1282-4864-8336-6720c7caa0da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ccc3c5f4-a0e1-4844-a193-b56945bf71a2", "address": "fa:16:3e:18:b6:8f", "network": {"id": "807530ad-b1c8-4426-9036-a796ba7dee91", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-277511856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d888450f903d41c5b6fde5de0b513a84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccc3c5f4-a0", "ovs_interfaceid": "ccc3c5f4-a0e1-4844-a193-b56945bf71a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Converting VIF {"id": "ccc3c5f4-a0e1-4844-a193-b56945bf71a2", "address": "fa:16:3e:18:b6:8f", "network": {"id": "807530ad-b1c8-4426-9036-a796ba7dee91", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-277511856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d888450f903d41c5b6fde5de0b513a84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccc3c5f4-a0", "ovs_interfaceid": "ccc3c5f4-a0e1-4844-a193-b56945bf71a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:b6:8f,bridge_name='br-int',has_traffic_filtering=True,id=ccc3c5f4-a0e1-4844-a193-b56945bf71a2,network=Network(807530ad-b1c8-4426-9036-a796ba7dee91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccc3c5f4-a0') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG os_vif [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:b6:8f,bridge_name='br-int',has_traffic_filtering=True,id=ccc3c5f4-a0e1-4844-a193-b56945bf71a2,network=Network(807530ad-b1c8-4426-9036-a796ba7dee91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccc3c5f4-a0') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapccc3c5f4-a0, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapccc3c5f4-a0, col_values=(('external_ids', {'iface-id': 'ccc3c5f4-a0e1-4844-a193-b56945bf71a2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:b6:8f', 'vm-uuid': '1e626a09-1282-4864-8336-6720c7caa0da'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:26 user nova-compute[72239]: INFO os_vif [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:b6:8f,bridge_name='br-int',has_traffic_filtering=True,id=ccc3c5f4-a0e1-4844-a193-b56945bf71a2,network=Network(807530ad-b1c8-4426-9036-a796ba7dee91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccc3c5f4-a0')
Jul 31 14:49:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:49:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] No VIF found with MAC fa:16:3e:18:b6:8f, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:49:27 user nova-compute[72239]: DEBUG nova.network.neutron [req-af3a94d6-c99f-490d-8e43-fca394062410 req-cd3c22cc-7959-4883-900c-e179ee2dd918 service nova] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Updated VIF entry in instance network info cache for port ccc3c5f4-a0e1-4844-a193-b56945bf71a2. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:49:27 user nova-compute[72239]: DEBUG nova.network.neutron [req-af3a94d6-c99f-490d-8e43-fca394062410 req-cd3c22cc-7959-4883-900c-e179ee2dd918 service nova] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Updating instance_info_cache with network_info: [{"id": "ccc3c5f4-a0e1-4844-a193-b56945bf71a2", "address": "fa:16:3e:18:b6:8f", "network": {"id": "807530ad-b1c8-4426-9036-a796ba7dee91", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-277511856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d888450f903d41c5b6fde5de0b513a84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccc3c5f4-a0", "ovs_interfaceid": "ccc3c5f4-a0e1-4844-a193-b56945bf71a2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:49:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-af3a94d6-c99f-490d-8e43-fca394062410 req-cd3c22cc-7959-4883-900c-e179ee2dd918 service nova] Releasing lock "refresh_cache-1e626a09-1282-4864-8336-6720c7caa0da" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:49:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:28 user nova-compute[72239]: DEBUG nova.compute.manager [req-1607d36b-2248-4a2b-a093-308b30d65df4 req-02840f86-80bd-4f1e-8a83-09671a94ef5b service nova] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Received event network-vif-plugged-ccc3c5f4-a0e1-4844-a193-b56945bf71a2 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:49:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-1607d36b-2248-4a2b-a093-308b30d65df4 req-02840f86-80bd-4f1e-8a83-09671a94ef5b service nova] Acquiring lock "1e626a09-1282-4864-8336-6720c7caa0da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:49:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-1607d36b-2248-4a2b-a093-308b30d65df4 req-02840f86-80bd-4f1e-8a83-09671a94ef5b service nova] Lock "1e626a09-1282-4864-8336-6720c7caa0da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:49:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-1607d36b-2248-4a2b-a093-308b30d65df4 req-02840f86-80bd-4f1e-8a83-09671a94ef5b service nova] Lock "1e626a09-1282-4864-8336-6720c7caa0da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:49:28 user nova-compute[72239]: DEBUG nova.compute.manager [req-1607d36b-2248-4a2b-a093-308b30d65df4 req-02840f86-80bd-4f1e-8a83-09671a94ef5b service nova] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] No waiting events found dispatching network-vif-plugged-ccc3c5f4-a0e1-4844-a193-b56945bf71a2 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:49:28 user nova-compute[72239]: WARNING nova.compute.manager [req-1607d36b-2248-4a2b-a093-308b30d65df4 req-02840f86-80bd-4f1e-8a83-09671a94ef5b service nova] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Received unexpected event network-vif-plugged-ccc3c5f4-a0e1-4844-a193-b56945bf71a2 for instance with vm_state building and task_state spawning.
Jul 31 14:49:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:30 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814970.7299387, 1e626a09-1282-4864-8336-6720c7caa0da => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:49:30 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] VM Resumed (Lifecycle Event)
Jul 31 14:49:30 user nova-compute[72239]: DEBUG nova.compute.manager [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:49:30 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 14:49:30 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Instance spawned successfully.
Jul 31 14:49:30 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 14:49:30 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:49:30 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:49:30 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:49:30 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:49:30 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:49:30 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:49:30 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:49:30 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:49:30 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:49:30 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690814970.7314558, 1e626a09-1282-4864-8336-6720c7caa0da => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:49:30 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] VM Started (Lifecycle Event)
Jul 31 14:49:30 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:49:30 user nova-compute[72239]: DEBUG nova.compute.manager [req-d96173bf-973d-46ee-b066-a5d71731b236 req-09b9fdb8-63e5-4286-8663-5902761584c2 service nova] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Received event network-vif-plugged-ccc3c5f4-a0e1-4844-a193-b56945bf71a2 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:49:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d96173bf-973d-46ee-b066-a5d71731b236 req-09b9fdb8-63e5-4286-8663-5902761584c2 service nova] Acquiring lock "1e626a09-1282-4864-8336-6720c7caa0da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:49:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d96173bf-973d-46ee-b066-a5d71731b236 req-09b9fdb8-63e5-4286-8663-5902761584c2 service nova] Lock "1e626a09-1282-4864-8336-6720c7caa0da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:49:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d96173bf-973d-46ee-b066-a5d71731b236 req-09b9fdb8-63e5-4286-8663-5902761584c2 service nova] Lock "1e626a09-1282-4864-8336-6720c7caa0da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:49:30 user nova-compute[72239]: DEBUG nova.compute.manager [req-d96173bf-973d-46ee-b066-a5d71731b236 req-09b9fdb8-63e5-4286-8663-5902761584c2 service nova] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] No waiting events found dispatching network-vif-plugged-ccc3c5f4-a0e1-4844-a193-b56945bf71a2 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:49:30 user nova-compute[72239]: WARNING nova.compute.manager [req-d96173bf-973d-46ee-b066-a5d71731b236 req-09b9fdb8-63e5-4286-8663-5902761584c2 service nova] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Received unexpected event network-vif-plugged-ccc3c5f4-a0e1-4844-a193-b56945bf71a2 for instance with vm_state building and task_state spawning.
Jul 31 14:49:30 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:49:30 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:49:30 user nova-compute[72239]: INFO nova.compute.manager [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Took 6.47 seconds to spawn the instance on the hypervisor.
Jul 31 14:49:30 user nova-compute[72239]: DEBUG nova.compute.manager [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:49:31 user nova-compute[72239]: INFO nova.compute.manager [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Took 7.75 seconds to build instance.
Jul 31 14:49:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-de18db9c-6026-4e02-bfd5-b6ede44d6aaa tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "1e626a09-1282-4864-8336-6720c7caa0da" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.152s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:49:31 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:36 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:38 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-8c7bc504-7440-4164-9830-e99ea13796f1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Acquiring lock "0d9bc124-66f7-4ccf-91f6-dcc4c2d78997" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:49:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-8c7bc504-7440-4164-9830-e99ea13796f1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "0d9bc124-66f7-4ccf-91f6-dcc4c2d78997" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:49:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-8c7bc504-7440-4164-9830-e99ea13796f1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Acquiring lock "0d9bc124-66f7-4ccf-91f6-dcc4c2d78997-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:49:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-8c7bc504-7440-4164-9830-e99ea13796f1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "0d9bc124-66f7-4ccf-91f6-dcc4c2d78997-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:49:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-8c7bc504-7440-4164-9830-e99ea13796f1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "0d9bc124-66f7-4ccf-91f6-dcc4c2d78997-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:49:39 user nova-compute[72239]: INFO nova.compute.manager [None req-8c7bc504-7440-4164-9830-e99ea13796f1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Terminating instance
Jul 31 14:49:39 user nova-compute[72239]: DEBUG nova.compute.manager [None req-8c7bc504-7440-4164-9830-e99ea13796f1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 14:49:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:39 user nova-compute[72239]: DEBUG nova.compute.manager [req-f970c9c3-9015-4ede-92ad-02639ac17a14 req-c30823e7-8f55-4cca-897e-eb1b7d13fbe0 service nova] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Received event network-vif-unplugged-e085294c-8c7d-4ba1-9fed-fe8e2f13e022 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:49:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-f970c9c3-9015-4ede-92ad-02639ac17a14 req-c30823e7-8f55-4cca-897e-eb1b7d13fbe0 service nova] Acquiring lock "0d9bc124-66f7-4ccf-91f6-dcc4c2d78997-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:49:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-f970c9c3-9015-4ede-92ad-02639ac17a14 req-c30823e7-8f55-4cca-897e-eb1b7d13fbe0 service nova] Lock "0d9bc124-66f7-4ccf-91f6-dcc4c2d78997-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:49:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-f970c9c3-9015-4ede-92ad-02639ac17a14 req-c30823e7-8f55-4cca-897e-eb1b7d13fbe0 service nova] Lock "0d9bc124-66f7-4ccf-91f6-dcc4c2d78997-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:49:39 user nova-compute[72239]: DEBUG nova.compute.manager [req-f970c9c3-9015-4ede-92ad-02639ac17a14 req-c30823e7-8f55-4cca-897e-eb1b7d13fbe0 service nova] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] No waiting events found dispatching network-vif-unplugged-e085294c-8c7d-4ba1-9fed-fe8e2f13e022 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:49:39 user nova-compute[72239]: DEBUG nova.compute.manager [req-f970c9c3-9015-4ede-92ad-02639ac17a14 req-c30823e7-8f55-4cca-897e-eb1b7d13fbe0 service nova] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Received event network-vif-unplugged-e085294c-8c7d-4ba1-9fed-fe8e2f13e022 for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 14:49:39 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Instance destroyed successfully.
Jul 31 14:49:40 user nova-compute[72239]: DEBUG nova.objects.instance [None req-8c7bc504-7440-4164-9830-e99ea13796f1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lazy-loading 'resources' on Instance uuid 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:49:40 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-8c7bc504-7440-4164-9830-e99ea13796f1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:47:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1488453940',display_name='tempest-VolumesAdminNegativeTest-server-1488453940',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1488453940',id=15,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:47:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6aad7d4ecc24425a8571cc2ac8041628',ramdisk_id='',reservation_id='r-8dsprsya',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1841650306',owner_user_name='tempest-VolumesAdminNegativeTest-1841650306-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:47:44Z,user_data=None,user_id='c6f0cfea2c0f4ec8bfa115354e65da96',uuid=0d9bc124-66f7-4ccf-91f6-dcc4c2d78997,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e085294c-8c7d-4ba1-9fed-fe8e2f13e022", "address": "fa:16:3e:05:1b:99", "network": {"id": "f05d7a54-33c7-463e-a73e-8d726fe2a9b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-181910970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aad7d4ecc24425a8571cc2ac8041628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape085294c-8c", "ovs_interfaceid": "e085294c-8c7d-4ba1-9fed-fe8e2f13e022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:49:40 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-8c7bc504-7440-4164-9830-e99ea13796f1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Converting VIF {"id": "e085294c-8c7d-4ba1-9fed-fe8e2f13e022", "address": "fa:16:3e:05:1b:99", "network": {"id": "f05d7a54-33c7-463e-a73e-8d726fe2a9b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-181910970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aad7d4ecc24425a8571cc2ac8041628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape085294c-8c", "ovs_interfaceid": "e085294c-8c7d-4ba1-9fed-fe8e2f13e022", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:49:40 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-8c7bc504-7440-4164-9830-e99ea13796f1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:1b:99,bridge_name='br-int',has_traffic_filtering=True,id=e085294c-8c7d-4ba1-9fed-fe8e2f13e022,network=Network(f05d7a54-33c7-463e-a73e-8d726fe2a9b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape085294c-8c') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:49:40 user nova-compute[72239]: DEBUG os_vif [None req-8c7bc504-7440-4164-9830-e99ea13796f1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:1b:99,bridge_name='br-int',has_traffic_filtering=True,id=e085294c-8c7d-4ba1-9fed-fe8e2f13e022,network=Network(f05d7a54-33c7-463e-a73e-8d726fe2a9b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape085294c-8c') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:49:40 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:40 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape085294c-8c, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:49:40 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:40 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:49:40 user nova-compute[72239]: INFO os_vif [None req-8c7bc504-7440-4164-9830-e99ea13796f1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:1b:99,bridge_name='br-int',has_traffic_filtering=True,id=e085294c-8c7d-4ba1-9fed-fe8e2f13e022,network=Network(f05d7a54-33c7-463e-a73e-8d726fe2a9b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape085294c-8c')
Jul 31 14:49:40 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-8c7bc504-7440-4164-9830-e99ea13796f1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Deleting instance files /opt/stack/data/nova/instances/0d9bc124-66f7-4ccf-91f6-dcc4c2d78997_del
Jul 31 14:49:40 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-8c7bc504-7440-4164-9830-e99ea13796f1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Deletion of /opt/stack/data/nova/instances/0d9bc124-66f7-4ccf-91f6-dcc4c2d78997_del complete
Jul 31 14:49:40 user nova-compute[72239]: INFO nova.compute.manager [None req-8c7bc504-7440-4164-9830-e99ea13796f1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Took 0.95 seconds to destroy the instance on the hypervisor.
Jul 31 14:49:40 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-8c7bc504-7440-4164-9830-e99ea13796f1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 14:49:40 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 14:49:40 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 14:49:41 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:49:41 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Took 0.67 seconds to deallocate network for instance.
Jul 31 14:49:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-8c7bc504-7440-4164-9830-e99ea13796f1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:49:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-8c7bc504-7440-4164-9830-e99ea13796f1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:49:41 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-8c7bc504-7440-4164-9830-e99ea13796f1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:49:41 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-8c7bc504-7440-4164-9830-e99ea13796f1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:49:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-8c7bc504-7440-4164-9830-e99ea13796f1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.437s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:49:41 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-8c7bc504-7440-4164-9830-e99ea13796f1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Deleted allocations for instance 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997
Jul 31 14:49:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-8c7bc504-7440-4164-9830-e99ea13796f1 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "0d9bc124-66f7-4ccf-91f6-dcc4c2d78997" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.244s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:49:42 user nova-compute[72239]: DEBUG nova.compute.manager [req-fb295bab-36b9-4180-a2f5-cf3b515a00e7 req-90fe2cda-3607-49f3-84e4-8aefcbaef751 service nova] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Received event network-vif-plugged-e085294c-8c7d-4ba1-9fed-fe8e2f13e022 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:49:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-fb295bab-36b9-4180-a2f5-cf3b515a00e7 req-90fe2cda-3607-49f3-84e4-8aefcbaef751 service nova] Acquiring lock "0d9bc124-66f7-4ccf-91f6-dcc4c2d78997-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:49:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-fb295bab-36b9-4180-a2f5-cf3b515a00e7 req-90fe2cda-3607-49f3-84e4-8aefcbaef751 service nova] Lock "0d9bc124-66f7-4ccf-91f6-dcc4c2d78997-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:49:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-fb295bab-36b9-4180-a2f5-cf3b515a00e7 req-90fe2cda-3607-49f3-84e4-8aefcbaef751 service nova] Lock "0d9bc124-66f7-4ccf-91f6-dcc4c2d78997-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:49:42 user nova-compute[72239]: DEBUG nova.compute.manager [req-fb295bab-36b9-4180-a2f5-cf3b515a00e7 req-90fe2cda-3607-49f3-84e4-8aefcbaef751 service nova] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] No waiting events found dispatching network-vif-plugged-e085294c-8c7d-4ba1-9fed-fe8e2f13e022 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:49:42 user nova-compute[72239]: WARNING nova.compute.manager [req-fb295bab-36b9-4180-a2f5-cf3b515a00e7 req-90fe2cda-3607-49f3-84e4-8aefcbaef751 service nova] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Received unexpected event network-vif-plugged-e085294c-8c7d-4ba1-9fed-fe8e2f13e022 for instance with vm_state deleted and task_state None.
Jul 31 14:49:42 user nova-compute[72239]: DEBUG nova.compute.manager [req-fb295bab-36b9-4180-a2f5-cf3b515a00e7 req-90fe2cda-3607-49f3-84e4-8aefcbaef751 service nova] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Received event network-vif-deleted-e085294c-8c7d-4ba1-9fed-fe8e2f13e022 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:49:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:54 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690814979.9945219, 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997 => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:49:54 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] VM Stopped (Lifecycle Event)
Jul 31 14:49:55 user nova-compute[72239]: DEBUG nova.compute.manager [None req-020bf718-ba16-43a8-a6e4-8f9764eff64d None None] [instance: 0d9bc124-66f7-4ccf-91f6-dcc4c2d78997] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:49:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:55 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:49:55 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:49:55 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:49:55 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Cleaning up deleted instances {{(pid=72239) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 14:49:55 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] There are 0 instances to clean {{(pid=72239) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 14:49:55 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:49:57 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:49:57 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Cleaning up deleted instances with incomplete migration  {{(pid=72239) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 14:49:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:58 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:49:58 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:49:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:49:59 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:49:59 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 14:50:00 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:00 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:50:00 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 14:50:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-97917500-bc78-433b-8d3d-181ed13667dc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:50:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-97917500-bc78-433b-8d3d-181ed13667dc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:50:00 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 14:50:00 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Updating instance_info_cache with network_info: [{"id": "60c1bdaa-524e-41da-96d7-56c77f959c71", "address": "fa:16:3e:a4:5f:0e", "network": {"id": "edecce7c-9fe9-4028-997d-b1ceef4e22bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1931054498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e59830ca9e40718341c3f2b0375af0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c1bdaa-52", "ovs_interfaceid": "60c1bdaa-524e-41da-96d7-56c77f959c71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:50:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-97917500-bc78-433b-8d3d-181ed13667dc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:50:00 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 14:50:00 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:50:00 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:50:01 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:50:01 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:50:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:01 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 14:50:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:02 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:50:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:03 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:50:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f11022e-a007-4d4c-adc1-b54ea59b9e6a/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f11022e-a007-4d4c-adc1-b54ea59b9e6a/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f11022e-a007-4d4c-adc1-b54ea59b9e6a/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2f11022e-a007-4d4c-adc1-b54ea59b9e6a/disk.rescue --force-share --output=json" returned: 0 in 0.150s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e626a09-1282-4864-8336-6720c7caa0da/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e626a09-1282-4864-8336-6720c7caa0da/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e626a09-1282-4864-8336-6720c7caa0da/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e626a09-1282-4864-8336-6720c7caa0da/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62122879-2a72-4ddf-a028-317eda0da465/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62122879-2a72-4ddf-a028-317eda0da465/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62122879-2a72-4ddf-a028-317eda0da465/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62122879-2a72-4ddf-a028-317eda0da465/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:50:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk.rescue --force-share --output=json" returned: 0 in 0.134s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:06 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:50:06 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:50:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=6923MB free_disk=25.20859146118164GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 14:50:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Applying migration context for instance d3e3612b-c6b9-4308-a45a-1ff3805e18bb as it has an incoming, in-progress migration dd60a421-3ed6-462e-9ed9-0ca2f7ff54a0. Migration status is finished {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Jul 31 14:50:06 user nova-compute[72239]: INFO nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Updating resource usage from migration dd60a421-3ed6-462e-9ed9-0ca2f7ff54a0
Jul 31 14:50:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 20abf743-de5b-4122-aad0-e2124c7804b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:50:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 7d81b881-b44e-4fb3-8245-9dea634bdec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:50:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 079a5ed7-ee25-495b-a2a4-924d830a670a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:50:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 97917500-bc78-433b-8d3d-181ed13667dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:50:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 62122879-2a72-4ddf-a028-317eda0da465 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:50:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 82116af8-3702-401b-8d00-9291d4caeb03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:50:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 2f11022e-a007-4d4c-adc1-b54ea59b9e6a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:50:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Migration dd60a421-3ed6-462e-9ed9-0ca2f7ff54a0 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Jul 31 14:50:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance d3e3612b-c6b9-4308-a45a-1ff3805e18bb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:50:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance c10918e9-9731-48ea-860e-8a02cb6a0ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:50:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance db15ad45-8f28-4e0c-8d7e-7db75f33fe92 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:50:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 1e626a09-1282-4864-8336-6720c7caa0da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:50:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 14:50:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=30GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 14:50:06 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Refreshing inventories for resource provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 14:50:06 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Updating ProviderTree inventory for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 14:50:06 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Updating inventory in ProviderTree for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 14:50:06 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Refreshing aggregate associations for resource provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e, aggregates: None {{(pid=72239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 14:50:07 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Refreshing trait associations for resource provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI {{(pid=72239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 14:50:07 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:50:07 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:50:07 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 14:50:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.926s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:07 user nova-compute[72239]: DEBUG nova.network.neutron [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Port d6ef6541-6b7e-4dc5-8149-a10940dfe87b binding to destination host user is already ACTIVE {{(pid=72239) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 31 14:50:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Acquiring lock "refresh_cache-d3e3612b-c6b9-4308-a45a-1ff3805e18bb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:50:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Acquired lock "refresh_cache-d3e3612b-c6b9-4308-a45a-1ff3805e18bb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:50:07 user nova-compute[72239]: DEBUG nova.network.neutron [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:50:08 user nova-compute[72239]: DEBUG nova.network.neutron [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Updating instance_info_cache with network_info: [{"id": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "address": "fa:16:3e:f4:8d:da", "network": {"id": "ad1d78ca-d597-4586-8b1b-4dc00fac3c3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-398965992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "506aad3c95a94800a4cc333a3478da17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ef6541-6b", "ovs_interfaceid": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:50:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Releasing lock "refresh_cache-d3e3612b-c6b9-4308-a45a-1ff3805e18bb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:50:08 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Creating tmpfile /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/tmpkbzfcm75 to verify with other compute node that the instance is on the same shared storage. {{(pid=72239) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Jul 31 14:50:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:09 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Instance destroyed successfully.
Jul 31 14:50:09 user nova-compute[72239]: DEBUG nova.objects.instance [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lazy-loading 'resources' on Instance uuid d3e3612b-c6b9-4308-a45a-1ff3805e18bb {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:44:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-704430368',display_name='tempest-ServerActionsTestOtherB-server-704430368',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-704430368',id=5,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMAieHq8I0ZAPg3BJdF9GCCYAxcsl1TuUTZpA9U0PVBIFwXLp4luFdF9A4kOklr7N7b3+Doyb1i/MuF4moMlBsM1nlQtqnIuFR3yVshdpPI3XQmqmueJHWFXMGjAp573g==',key_name='tempest-keypair-1046174319',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:48:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='506aad3c95a94800a4cc333a3478da17',ramdisk_id='',reservation_id='r-rcs9kimd',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-858495710',owner_user_name='tempest-ServerActionsTestOtherB-858495710-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:48:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c92e1d7e3b944359fcbf9475dcacef0',uuid=d3e3612b-c6b9-4308-a45a-1ff3805e18bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "address": "fa:16:3e:f4:8d:da", "network": {"id": "ad1d78ca-d597-4586-8b1b-4dc00fac3c3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-398965992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "506aad3c95a94800a4cc333a3478da17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ef6541-6b", "ovs_interfaceid": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Converting VIF {"id": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "address": "fa:16:3e:f4:8d:da", "network": {"id": "ad1d78ca-d597-4586-8b1b-4dc00fac3c3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-398965992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "506aad3c95a94800a4cc333a3478da17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ef6541-6b", "ovs_interfaceid": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:8d:da,bridge_name='br-int',has_traffic_filtering=True,id=d6ef6541-6b7e-4dc5-8149-a10940dfe87b,network=Network(ad1d78ca-d597-4586-8b1b-4dc00fac3c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ef6541-6b') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG os_vif [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:8d:da,bridge_name='br-int',has_traffic_filtering=True,id=d6ef6541-6b7e-4dc5-8149-a10940dfe87b,network=Network(ad1d78ca-d597-4586-8b1b-4dc00fac3c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ef6541-6b') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6ef6541-6b, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:50:09 user nova-compute[72239]: INFO os_vif [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:8d:da,bridge_name='br-int',has_traffic_filtering=True,id=d6ef6541-6b7e-4dc5-8149-a10940dfe87b,network=Network(ad1d78ca-d597-4586-8b1b-4dc00fac3c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ef6541-6b')
Jul 31 14:50:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PjhAmCqu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:50:09 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:50:09 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe45300-d9c2-4b00-b731-00136596960e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[555b577b-0218-48c1-820b-71c9c95c5e77]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:50:09 user nova-compute[72239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)
Jul 31 14:50:09 user nova-compute[72239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:50:09 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:50:09 user nova-compute[72239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)
Jul 31 14:50:09 user nova-compute[72239]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:50:09 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41214b05e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f'): ({'sdb'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Removing single pathed devices sdb {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad59ec78-3afb-453b-86dd-41636f3ff276]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG nova.compute.manager [req-6d7f6ccb-4983-4dd8-9ba1-d997083f8570 req-0d8545f6-4455-42db-8c59-ded59de6861f service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Received event network-vif-unplugged-d6ef6541-6b7e-4dc5-8149-a10940dfe87b {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-6d7f6ccb-4983-4dd8-9ba1-d997083f8570 req-0d8545f6-4455-42db-8c59-ded59de6861f service nova] Acquiring lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-6d7f6ccb-4983-4dd8-9ba1-d997083f8570 req-0d8545f6-4455-42db-8c59-ded59de6861f service nova] Lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-6d7f6ccb-4983-4dd8-9ba1-d997083f8570 req-0d8545f6-4455-42db-8c59-ded59de6861f service nova] Lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG nova.compute.manager [req-6d7f6ccb-4983-4dd8-9ba1-d997083f8570 req-0d8545f6-4455-42db-8c59-ded59de6861f service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] No waiting events found dispatching network-vif-unplugged-d6ef6541-6b7e-4dc5-8149-a10940dfe87b {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:50:09 user nova-compute[72239]: WARNING nova.compute.manager [req-6d7f6ccb-4983-4dd8-9ba1-d997083f8570 req-0d8545f6-4455-42db-8c59-ded59de6861f service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Received unexpected event network-vif-unplugged-d6ef6541-6b7e-4dc5-8149-a10940dfe87b for instance with vm_state resized and task_state resize_reverting.
Jul 31 14:50:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[86077b65-1117-4a03-b0e9-fe47db075028]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Flushing IO for device /dev/sdb {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[778abbd4-1676-4de8-bce8-18c58b01ebde]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[400d9a00-346a-4761-9ef8-1cf70a51925e]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a34b629-67fc-4957-b1b5-75f32b2528ea]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e500c195-ee9e-4f98-bb8a-f067be972836]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f, portal: 172.16.0.220,3260]
Jul 31 14:50:09 user nova-compute[72239]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f, portal: 172.16.0.220,3260] successful.
Jul 31 14:50:09 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cab5bda3-81da-4a19-bbaf-e3ffc3ece695]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] <== disconnect_volume: return (298ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:50:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 14:50:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:10 user nova-compute[72239]: DEBUG nova.objects.instance [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lazy-loading 'migration_context' on Instance uuid d3e3612b-c6b9-4308-a45a-1ff3805e18bb {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:50:10 user nova-compute[72239]: INFO nova.compute.manager [None req-5961c1cc-f49f-4063-a1fb-3f0b33e4dab1 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Unrescuing
Jul 31 14:50:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5961c1cc-f49f-4063-a1fb-3f0b33e4dab1 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Acquiring lock "refresh_cache-97917500-bc78-433b-8d3d-181ed13667dc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:50:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5961c1cc-f49f-4063-a1fb-3f0b33e4dab1 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Acquired lock "refresh_cache-97917500-bc78-433b-8d3d-181ed13667dc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:50:10 user nova-compute[72239]: DEBUG nova.network.neutron [None req-5961c1cc-f49f-4063-a1fb-3f0b33e4dab1 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:50:10 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:50:10 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:50:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.497s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:11 user nova-compute[72239]: INFO nova.compute.manager [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Swapping old allocation on dict_keys(['98aeb34d-09d0-4a3a-9216-4d8197134e8e']) held by migration dd60a421-3ed6-462e-9ed9-0ca2f7ff54a0 for instance
Jul 31 14:50:11 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Overwriting current allocation {'allocations': {'98aeb34d-09d0-4a3a-9216-4d8197134e8e': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 22}}, 'project_id': '506aad3c95a94800a4cc333a3478da17', 'user_id': '7c92e1d7e3b944359fcbf9475dcacef0', 'consumer_generation': 1} on consumer d3e3612b-c6b9-4308-a45a-1ff3805e18bb {{(pid=72239) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Jul 31 14:50:11 user nova-compute[72239]: DEBUG nova.compute.manager [req-6c34971f-688d-44d0-a09c-95f0809f49a2 req-0844c202-785e-405e-b3d4-3d293a10cd29 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Received event network-vif-plugged-d6ef6541-6b7e-4dc5-8149-a10940dfe87b {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:50:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-6c34971f-688d-44d0-a09c-95f0809f49a2 req-0844c202-785e-405e-b3d4-3d293a10cd29 service nova] Acquiring lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-6c34971f-688d-44d0-a09c-95f0809f49a2 req-0844c202-785e-405e-b3d4-3d293a10cd29 service nova] Lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-6c34971f-688d-44d0-a09c-95f0809f49a2 req-0844c202-785e-405e-b3d4-3d293a10cd29 service nova] Lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:11 user nova-compute[72239]: DEBUG nova.compute.manager [req-6c34971f-688d-44d0-a09c-95f0809f49a2 req-0844c202-785e-405e-b3d4-3d293a10cd29 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] No waiting events found dispatching network-vif-plugged-d6ef6541-6b7e-4dc5-8149-a10940dfe87b {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:50:11 user nova-compute[72239]: WARNING nova.compute.manager [req-6c34971f-688d-44d0-a09c-95f0809f49a2 req-0844c202-785e-405e-b3d4-3d293a10cd29 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Received unexpected event network-vif-plugged-d6ef6541-6b7e-4dc5-8149-a10940dfe87b for instance with vm_state resized and task_state resize_reverting.
Jul 31 14:50:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Acquiring lock "refresh_cache-d3e3612b-c6b9-4308-a45a-1ff3805e18bb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:50:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Acquired lock "refresh_cache-d3e3612b-c6b9-4308-a45a-1ff3805e18bb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:50:11 user nova-compute[72239]: DEBUG nova.network.neutron [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:50:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Acquiring lock "82116af8-3702-401b-8d00-9291d4caeb03" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "82116af8-3702-401b-8d00-9291d4caeb03" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:11 user nova-compute[72239]: DEBUG nova.objects.instance [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lazy-loading 'flavor' on Instance uuid 82116af8-3702-401b-8d00-9291d4caeb03 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:50:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "82116af8-3702-401b-8d00-9291d4caeb03" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:11 user nova-compute[72239]: DEBUG nova.network.neutron [None req-5961c1cc-f49f-4063-a1fb-3f0b33e4dab1 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Updating instance_info_cache with network_info: [{"id": "60c1bdaa-524e-41da-96d7-56c77f959c71", "address": "fa:16:3e:a4:5f:0e", "network": {"id": "edecce7c-9fe9-4028-997d-b1ceef4e22bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1931054498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e59830ca9e40718341c3f2b0375af0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c1bdaa-52", "ovs_interfaceid": "60c1bdaa-524e-41da-96d7-56c77f959c71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:50:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5961c1cc-f49f-4063-a1fb-3f0b33e4dab1 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Releasing lock "refresh_cache-97917500-bc78-433b-8d3d-181ed13667dc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:50:11 user nova-compute[72239]: DEBUG nova.objects.instance [None req-5961c1cc-f49f-4063-a1fb-3f0b33e4dab1 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lazy-loading 'flavor' on Instance uuid 97917500-bc78-433b-8d3d-181ed13667dc {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:50:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Acquiring lock "82116af8-3702-401b-8d00-9291d4caeb03" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "82116af8-3702-401b-8d00-9291d4caeb03" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:11 user nova-compute[72239]: INFO nova.compute.manager [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Attaching volume 6c0c265f-6df0-4b90-8961-0dbda33cdbea to /dev/vdb
Jul 31 14:50:11 user nova-compute[72239]: DEBUG os_brick.utils [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:50:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:11 user nova-compute[72239]: DEBUG nova.network.neutron [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Updating instance_info_cache with network_info: [{"id": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "address": "fa:16:3e:f4:8d:da", "network": {"id": "ad1d78ca-d597-4586-8b1b-4dc00fac3c3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-398965992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "506aad3c95a94800a4cc333a3478da17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ef6541-6b", "ovs_interfaceid": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:50:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:11 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae02784-7c7e-4232-b174-b96d01cdd844]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Releasing lock "refresh_cache-d3e3612b-c6b9-4308-a45a-1ff3805e18bb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:50:11 user nova-compute[72239]: DEBUG os_brick.utils [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:50:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:11 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a65e4a-98e2-49f5-8317-c3b1018de749]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:11 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa24d74-771e-4b86-a7d1-b44faa4b24a8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:11 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6404e42-7aa8-49b7-8fc2-5e7bf2b59012]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:11 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dce4b79-eb0d-4aaf-a48a-39e49333cdc0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:50:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b466693f-da62-459a-9086-e209f3f4245c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 14:50:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd3f487-629b-4107-9805-574b1d17c632]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:50:12 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 14:50:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[52343ffa-afaf-4256-bbfb-25e0dd5f9346]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 14:50:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 14:50:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 14:50:12 user nova-compute[72239]: DEBUG os_brick.utils [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:50:12 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Updating existing volume attachment record: 48ce940a-5831-446a-aabc-44a47a0963b3 {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 14:50:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc26844-9aac-4bab-a353-e804b76166f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:50:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 14:50:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:50:12 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 14:50:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[040dc67d-51c9-4860-a3ff-defa391ac0d0]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 14:50:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 14:50:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 14:50:12 user nova-compute[72239]: DEBUG os_brick.utils [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] <== get_connector_properties: return (198ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:50:12 user nova-compute[72239]: DEBUG nova.compute.manager [req-541b845c-b33b-4f48-8e45-232cdfd39347 req-0997cf18-28da-450e-84b2-64c46719f48e service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Received event network-vif-unplugged-60c1bdaa-524e-41da-96d7-56c77f959c71 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:50:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-541b845c-b33b-4f48-8e45-232cdfd39347 req-0997cf18-28da-450e-84b2-64c46719f48e service nova] Acquiring lock "97917500-bc78-433b-8d3d-181ed13667dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-541b845c-b33b-4f48-8e45-232cdfd39347 req-0997cf18-28da-450e-84b2-64c46719f48e service nova] Lock "97917500-bc78-433b-8d3d-181ed13667dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-541b845c-b33b-4f48-8e45-232cdfd39347 req-0997cf18-28da-450e-84b2-64c46719f48e service nova] Lock "97917500-bc78-433b-8d3d-181ed13667dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:12 user nova-compute[72239]: DEBUG nova.compute.manager [req-541b845c-b33b-4f48-8e45-232cdfd39347 req-0997cf18-28da-450e-84b2-64c46719f48e service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] No waiting events found dispatching network-vif-unplugged-60c1bdaa-524e-41da-96d7-56c77f959c71 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:50:12 user nova-compute[72239]: WARNING nova.compute.manager [req-541b845c-b33b-4f48-8e45-232cdfd39347 req-0997cf18-28da-450e-84b2-64c46719f48e service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Received unexpected event network-vif-unplugged-60c1bdaa-524e-41da-96d7-56c77f959c71 for instance with vm_state rescued and task_state unrescuing.
Jul 31 14:50:12 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Instance destroyed successfully.
Jul 31 14:50:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:14 user nova-compute[72239]: DEBUG nova.compute.manager [req-adc61418-0b50-4eec-88a4-bf40f2417825 req-1f2f5ddd-0861-46c2-8307-0d8815c8c09f service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Received event network-vif-plugged-60c1bdaa-524e-41da-96d7-56c77f959c71 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:50:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-adc61418-0b50-4eec-88a4-bf40f2417825 req-1f2f5ddd-0861-46c2-8307-0d8815c8c09f service nova] Acquiring lock "97917500-bc78-433b-8d3d-181ed13667dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-adc61418-0b50-4eec-88a4-bf40f2417825 req-1f2f5ddd-0861-46c2-8307-0d8815c8c09f service nova] Lock "97917500-bc78-433b-8d3d-181ed13667dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-adc61418-0b50-4eec-88a4-bf40f2417825 req-1f2f5ddd-0861-46c2-8307-0d8815c8c09f service nova] Lock "97917500-bc78-433b-8d3d-181ed13667dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:14 user nova-compute[72239]: DEBUG nova.compute.manager [req-adc61418-0b50-4eec-88a4-bf40f2417825 req-1f2f5ddd-0861-46c2-8307-0d8815c8c09f service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] No waiting events found dispatching network-vif-plugged-60c1bdaa-524e-41da-96d7-56c77f959c71 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:50:14 user nova-compute[72239]: WARNING nova.compute.manager [req-adc61418-0b50-4eec-88a4-bf40f2417825 req-1f2f5ddd-0861-46c2-8307-0d8815c8c09f service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Received unexpected event network-vif-plugged-60c1bdaa-524e-41da-96d7-56c77f959c71 for instance with vm_state rescued and task_state unrescuing.
Jul 31 14:50:14 user nova-compute[72239]: DEBUG nova.compute.manager [req-adc61418-0b50-4eec-88a4-bf40f2417825 req-1f2f5ddd-0861-46c2-8307-0d8815c8c09f service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Received event network-changed-60c1bdaa-524e-41da-96d7-56c77f959c71 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:50:14 user nova-compute[72239]: DEBUG nova.compute.manager [req-adc61418-0b50-4eec-88a4-bf40f2417825 req-1f2f5ddd-0861-46c2-8307-0d8815c8c09f service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Refreshing instance network info cache due to event network-changed-60c1bdaa-524e-41da-96d7-56c77f959c71. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:50:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-adc61418-0b50-4eec-88a4-bf40f2417825 req-1f2f5ddd-0861-46c2-8307-0d8815c8c09f service nova] Acquiring lock "refresh_cache-97917500-bc78-433b-8d3d-181ed13667dc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:50:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-adc61418-0b50-4eec-88a4-bf40f2417825 req-1f2f5ddd-0861-46c2-8307-0d8815c8c09f service nova] Acquired lock "refresh_cache-97917500-bc78-433b-8d3d-181ed13667dc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:50:14 user nova-compute[72239]: DEBUG nova.network.neutron [req-adc61418-0b50-4eec-88a4-bf40f2417825 req-1f2f5ddd-0861-46c2-8307-0d8815c8c09f service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Refreshing network info cache for port 60c1bdaa-524e-41da-96d7-56c77f959c71 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:50:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:15 user nova-compute[72239]: DEBUG nova.network.neutron [req-adc61418-0b50-4eec-88a4-bf40f2417825 req-1f2f5ddd-0861-46c2-8307-0d8815c8c09f service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Updated VIF entry in instance network info cache for port 60c1bdaa-524e-41da-96d7-56c77f959c71. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:50:15 user nova-compute[72239]: DEBUG nova.network.neutron [req-adc61418-0b50-4eec-88a4-bf40f2417825 req-1f2f5ddd-0861-46c2-8307-0d8815c8c09f service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Updating instance_info_cache with network_info: [{"id": "60c1bdaa-524e-41da-96d7-56c77f959c71", "address": "fa:16:3e:a4:5f:0e", "network": {"id": "edecce7c-9fe9-4028-997d-b1ceef4e22bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1931054498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e59830ca9e40718341c3f2b0375af0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c1bdaa-52", "ovs_interfaceid": "60c1bdaa-524e-41da-96d7-56c77f959c71", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:50:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-adc61418-0b50-4eec-88a4-bf40f2417825 req-1f2f5ddd-0861-46c2-8307-0d8815c8c09f service nova] Releasing lock "refresh_cache-97917500-bc78-433b-8d3d-181ed13667dc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:50:15 user nova-compute[72239]: DEBUG nova.compute.manager [req-adc61418-0b50-4eec-88a4-bf40f2417825 req-1f2f5ddd-0861-46c2-8307-0d8815c8c09f service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Received event network-changed-60c1bdaa-524e-41da-96d7-56c77f959c71 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:50:15 user nova-compute[72239]: DEBUG nova.compute.manager [req-adc61418-0b50-4eec-88a4-bf40f2417825 req-1f2f5ddd-0861-46c2-8307-0d8815c8c09f service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Refreshing instance network info cache due to event network-changed-60c1bdaa-524e-41da-96d7-56c77f959c71. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:50:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-adc61418-0b50-4eec-88a4-bf40f2417825 req-1f2f5ddd-0861-46c2-8307-0d8815c8c09f service nova] Acquiring lock "refresh_cache-97917500-bc78-433b-8d3d-181ed13667dc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:50:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-adc61418-0b50-4eec-88a4-bf40f2417825 req-1f2f5ddd-0861-46c2-8307-0d8815c8c09f service nova] Acquired lock "refresh_cache-97917500-bc78-433b-8d3d-181ed13667dc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:50:15 user nova-compute[72239]: DEBUG nova.network.neutron [req-adc61418-0b50-4eec-88a4-bf40f2417825 req-1f2f5ddd-0861-46c2-8307-0d8815c8c09f service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Refreshing network info cache for port 60c1bdaa-524e-41da-96d7-56c77f959c71 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:50:15 user nova-compute[72239]: DEBUG nova.network.neutron [req-adc61418-0b50-4eec-88a4-bf40f2417825 req-1f2f5ddd-0861-46c2-8307-0d8815c8c09f service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Updated VIF entry in instance network info cache for port 60c1bdaa-524e-41da-96d7-56c77f959c71. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:50:15 user nova-compute[72239]: DEBUG nova.network.neutron [req-adc61418-0b50-4eec-88a4-bf40f2417825 req-1f2f5ddd-0861-46c2-8307-0d8815c8c09f service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Updating instance_info_cache with network_info: [{"id": "60c1bdaa-524e-41da-96d7-56c77f959c71", "address": "fa:16:3e:a4:5f:0e", "network": {"id": "edecce7c-9fe9-4028-997d-b1ceef4e22bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1931054498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e59830ca9e40718341c3f2b0375af0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c1bdaa-52", "ovs_interfaceid": "60c1bdaa-524e-41da-96d7-56c77f959c71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:50:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-adc61418-0b50-4eec-88a4-bf40f2417825 req-1f2f5ddd-0861-46c2-8307-0d8815c8c09f service nova] Releasing lock "refresh_cache-97917500-bc78-433b-8d3d-181ed13667dc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:50:15 user nova-compute[72239]: DEBUG nova.compute.manager [req-adc61418-0b50-4eec-88a4-bf40f2417825 req-1f2f5ddd-0861-46c2-8307-0d8815c8c09f service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Received event network-vif-plugged-60c1bdaa-524e-41da-96d7-56c77f959c71 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:50:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-adc61418-0b50-4eec-88a4-bf40f2417825 req-1f2f5ddd-0861-46c2-8307-0d8815c8c09f service nova] Acquiring lock "97917500-bc78-433b-8d3d-181ed13667dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-adc61418-0b50-4eec-88a4-bf40f2417825 req-1f2f5ddd-0861-46c2-8307-0d8815c8c09f service nova] Lock "97917500-bc78-433b-8d3d-181ed13667dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-adc61418-0b50-4eec-88a4-bf40f2417825 req-1f2f5ddd-0861-46c2-8307-0d8815c8c09f service nova] Lock "97917500-bc78-433b-8d3d-181ed13667dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:15 user nova-compute[72239]: DEBUG nova.compute.manager [req-adc61418-0b50-4eec-88a4-bf40f2417825 req-1f2f5ddd-0861-46c2-8307-0d8815c8c09f service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] No waiting events found dispatching network-vif-plugged-60c1bdaa-524e-41da-96d7-56c77f959c71 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:50:15 user nova-compute[72239]: WARNING nova.compute.manager [req-adc61418-0b50-4eec-88a4-bf40f2417825 req-1f2f5ddd-0861-46c2-8307-0d8815c8c09f service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Received unexpected event network-vif-plugged-60c1bdaa-524e-41da-96d7-56c77f959c71 for instance with vm_state rescued and task_state unrescuing.
Jul 31 14:50:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Removed pending event for 97917500-bc78-433b-8d3d-181ed13667dc due to event {{(pid=72239) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 14:50:16 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815016.447412, 97917500-bc78-433b-8d3d-181ed13667dc => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:50:16 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] VM Resumed (Lifecycle Event)
Jul 31 14:50:16 user nova-compute[72239]: DEBUG nova.compute.manager [None req-5961c1cc-f49f-4063-a1fb-3f0b33e4dab1 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:50:16 user nova-compute[72239]: DEBUG nova.compute.manager [req-51b6c188-c133-4cce-8f5a-2ce120b07320 req-55e42f89-df15-428b-9ba1-8aa9e8a3d122 service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Received event network-vif-plugged-60c1bdaa-524e-41da-96d7-56c77f959c71 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:50:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-51b6c188-c133-4cce-8f5a-2ce120b07320 req-55e42f89-df15-428b-9ba1-8aa9e8a3d122 service nova] Acquiring lock "97917500-bc78-433b-8d3d-181ed13667dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-51b6c188-c133-4cce-8f5a-2ce120b07320 req-55e42f89-df15-428b-9ba1-8aa9e8a3d122 service nova] Lock "97917500-bc78-433b-8d3d-181ed13667dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-51b6c188-c133-4cce-8f5a-2ce120b07320 req-55e42f89-df15-428b-9ba1-8aa9e8a3d122 service nova] Lock "97917500-bc78-433b-8d3d-181ed13667dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:16 user nova-compute[72239]: DEBUG nova.compute.manager [req-51b6c188-c133-4cce-8f5a-2ce120b07320 req-55e42f89-df15-428b-9ba1-8aa9e8a3d122 service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] No waiting events found dispatching network-vif-plugged-60c1bdaa-524e-41da-96d7-56c77f959c71 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:50:16 user nova-compute[72239]: WARNING nova.compute.manager [req-51b6c188-c133-4cce-8f5a-2ce120b07320 req-55e42f89-df15-428b-9ba1-8aa9e8a3d122 service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Received unexpected event network-vif-plugged-60c1bdaa-524e-41da-96d7-56c77f959c71 for instance with vm_state rescued and task_state unrescuing.
Jul 31 14:50:16 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:50:16 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:50:16 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 31 14:50:16 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815016.450857, 97917500-bc78-433b-8d3d-181ed13667dc => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:50:16 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] VM Started (Lifecycle Event)
Jul 31 14:50:16 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:50:16 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:50:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWHqTQVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:50:23 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:50:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:50:23 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:50:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:50:23 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 14:50:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c18ba2-7875-4b4b-afee-9a0951bd0580]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 14:50:23 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e4eef9-b2c1-4ee7-928a-41ab7c5642dd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea] added
Jul 31 14:50:23 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6140b528-bbf0-45c3-b8a7-11b00008cc41]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da5f442-0112-4ea0-9180-fd3781ec9fa9]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vWHqTQVa {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vWHqTQVa" returned: 0 in 0.038s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[389479fa-5743-4515-bf0d-b8aa3572a051]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vWHqTQVa'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd5201a-c7bb-4f37-8ff0-f777fb1f4b79]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54b9088-876b-46dc-bbcf-8dcd741d6398]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:50:23 user nova-compute[72239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)
Jul 31 14:50:23 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:50:23 user nova-compute[72239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)
Jul 31 14:50:23 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aef8a0a-1384-44c0-92ef-05fe11caa3ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea, portal: 172.16.0.220,3260]
Jul 31 14:50:23 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea, portal: 172.16.0.220,3260] successful.
Jul 31 14:50:23 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49a1184-a708-46ee-96d9-0d980132f021]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[30c610f1-4c4f-40e8-8a2d-30b2562e175e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:50:23 user nova-compute[72239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)
Jul 31 14:50:23 user nova-compute[72239]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea (non-flash)
Jul 31 14:50:23 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:50:23 user nova-compute[72239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)
Jul 31 14:50:23 user nova-compute[72239]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea (non-flash)
Jul 31 14:50:23 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] HCTL ('33', '-', '-', 0) found on session 21 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[186a8743-ab1b-4e1c-9694-628885ca2e08]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: None {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:50:23 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:24 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:24 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690815009.1675534, d3e3612b-c6b9-4308-a45a-1ff3805e18bb => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:50:24 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] VM Stopped (Lifecycle Event)
Jul 31 14:50:24 user nova-compute[72239]: DEBUG nova.compute.manager [None req-de9a31b0-5e02-457d-bf53-90c262416daa None None] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:50:24 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:24 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Searching for a device in session 21 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:50:24 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWHqTQVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 14:50:24 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:50:24 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '26531376334393265', 'path': '/dev/sdb'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:50:24 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531376334393265', 'path': '/dev/sdb'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 14:50:24 user nova-compute[72239]: DEBUG nova.objects.instance [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lazy-loading 'flavor' on Instance uuid 82116af8-3702-401b-8d00-9291d4caeb03 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:50:24 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 14:50:24 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:50:24 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 14:50:24 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:50:24 user nova-compute[72239]:   <serial>6c0c265f-6df0-4b90-8961-0dbda33cdbea</serial>
Jul 31 14:50:24 user nova-compute[72239]: </disk>
Jul 31 14:50:24 user nova-compute[72239]:  {{(pid=72239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 14:50:24 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:50:24 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:50:24 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] No VIF found with MAC fa:16:3e:2e:96:96, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:50:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2fcb12e0-b93b-4694-bf36-88b36e535849 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "82116af8-3702-401b-8d00-9291d4caeb03" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.273s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c9435dbc-d51f-431b-8f15-26e9a6ed5df9 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Acquiring lock "82116af8-3702-401b-8d00-9291d4caeb03" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c9435dbc-d51f-431b-8f15-26e9a6ed5df9 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "82116af8-3702-401b-8d00-9291d4caeb03" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:27 user nova-compute[72239]: INFO nova.compute.manager [None req-c9435dbc-d51f-431b-8f15-26e9a6ed5df9 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Detaching volume 6c0c265f-6df0-4b90-8961-0dbda33cdbea
Jul 31 14:50:27 user nova-compute[72239]: INFO nova.virt.block_device [None req-c9435dbc-d51f-431b-8f15-26e9a6ed5df9 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Attempting to driver detach volume 6c0c265f-6df0-4b90-8961-0dbda33cdbea from mountpoint /dev/vdb
Jul 31 14:50:27 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-c9435dbc-d51f-431b-8f15-26e9a6ed5df9 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Attempting to detach device vdb from instance 82116af8-3702-401b-8d00-9291d4caeb03 from the persistent domain config. {{(pid=72239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 14:50:27 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-c9435dbc-d51f-431b-8f15-26e9a6ed5df9 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 14:50:27 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:50:27 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 14:50:27 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:50:27 user nova-compute[72239]:   <serial>6c0c265f-6df0-4b90-8961-0dbda33cdbea</serial>
Jul 31 14:50:27 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 14:50:27 user nova-compute[72239]: </disk>
Jul 31 14:50:27 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 14:50:27 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-c9435dbc-d51f-431b-8f15-26e9a6ed5df9 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Successfully detached device vdb from instance 82116af8-3702-401b-8d00-9291d4caeb03 from the persistent domain config.
Jul 31 14:50:27 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-c9435dbc-d51f-431b-8f15-26e9a6ed5df9 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 82116af8-3702-401b-8d00-9291d4caeb03 from the live domain config. {{(pid=72239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 14:50:27 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-c9435dbc-d51f-431b-8f15-26e9a6ed5df9 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 14:50:27 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:50:27 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 14:50:27 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:50:27 user nova-compute[72239]:   <serial>6c0c265f-6df0-4b90-8961-0dbda33cdbea</serial>
Jul 31 14:50:27 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 14:50:27 user nova-compute[72239]: </disk>
Jul 31 14:50:27 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Received event <DeviceRemovedEvent: 1690815028.120835, 82116af8-3702-401b-8d00-9291d4caeb03 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72239) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-c9435dbc-d51f-431b-8f15-26e9a6ed5df9 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 82116af8-3702-401b-8d00-9291d4caeb03 {{(pid=72239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 14:50:28 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-c9435dbc-d51f-431b-8f15-26e9a6ed5df9 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Successfully detached device vdb from instance 82116af8-3702-401b-8d00-9291d4caeb03 from the live domain config.
Jul 31 14:50:28 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9435dbc-d51f-431b-8f15-26e9a6ed5df9 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9435dbc-d51f-431b-8f15-26e9a6ed5df9 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vWHqTQVa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:50:28 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-c9435dbc-d51f-431b-8f15-26e9a6ed5df9 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-c9435dbc-d51f-431b-8f15-26e9a6ed5df9 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-c9435dbc-d51f-431b-8f15-26e9a6ed5df9 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9435dbc-d51f-431b-8f15-26e9a6ed5df9 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf20d5d-df84-4830-8bcc-4ccd4e477801]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7416769e-9db2-4efe-a916-e2dfc1a569cc]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9435dbc-d51f-431b-8f15-26e9a6ed5df9 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:50:28 user nova-compute[72239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)
Jul 31 14:50:28 user nova-compute[72239]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea (non-flash)
Jul 31 14:50:28 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9435dbc-d51f-431b-8f15-26e9a6ed5df9 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:50:28 user nova-compute[72239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)
Jul 31 14:50:28 user nova-compute[72239]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea (non-flash)
Jul 31 14:50:28 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9435dbc-d51f-431b-8f15-26e9a6ed5df9 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4120449480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea'): ({'sdb'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-c9435dbc-d51f-431b-8f15-26e9a6ed5df9 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Removing single pathed devices sdb {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[78e0f9fb-62a5-4183-82ac-db1247549a7b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffde5b97-ef9a-47c0-a018-28b5a66001fe]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-c9435dbc-d51f-431b-8f15-26e9a6ed5df9 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Flushing IO for device /dev/sdb {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Starting finish_revert_migration {{(pid=72239) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cedcaf-31ac-4f05-8585-f770bdd1ad2d]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-c9435dbc-d51f-431b-8f15-26e9a6ed5df9 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Start _get_guest_xml network_info=[{"id": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "address": "fa:16:3e:f4:8d:da", "network": {"id": "ad1d78ca-d597-4586-8b1b-4dc00fac3c3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-398965992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "506aad3c95a94800a4cc333a3478da17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ef6541-6b", "ovs_interfaceid": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '98cab053-7d5e-4452-b4cd-48d88db23732', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PjhAmCqu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'd3e3612b-c6b9-4308-a45a-1ff3805e18bb', 'attached_at': '2023-07-31T14:50:28.000000', 'detached_at': '', 'volume_id': '0442beb2-94e8-445b-b688-af66bd23814f', 'serial': '0442beb2-94e8-445b-b688-af66bd23814f'}, 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:50:28 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:50:28 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:50:28 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG nova.objects.instance [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lazy-loading 'vcpu_model' on Instance uuid d3e3612b-c6b9-4308-a45a-1ff3805e18bb {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe171499-a5ae-4cd1-9ece-cc76a295d98a]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-c9435dbc-d51f-431b-8f15-26e9a6ed5df9 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-c9435dbc-d51f-431b-8f15-26e9a6ed5df9 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9435dbc-d51f-431b-8f15-26e9a6ed5df9 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PjhAmCqu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:50:28 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f6cb1c-ee36-4467-8b53-97b98a537e6e]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9435dbc-d51f-431b-8f15-26e9a6ed5df9 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1261922-4ecf-4c74-8ed6-c91b7f33bbe8]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9435dbc-d51f-431b-8f15-26e9a6ed5df9 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea, portal: 172.16.0.220,3260]
Jul 31 14:50:28 user nova-compute[72239]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea, portal: 172.16.0.220,3260] successful.
Jul 31 14:50:28 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6c0c265f-6df0-4b90-8961-0dbda33cdbea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c3a8dd-e50d-41fa-8a6f-8254a41fd583]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9435dbc-d51f-431b-8f15-26e9a6ed5df9 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-c9435dbc-d51f-431b-8f15-26e9a6ed5df9 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9435dbc-d51f-431b-8f15-26e9a6ed5df9 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] <== disconnect_volume: return (345ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9435dbc-d51f-431b-8f15-26e9a6ed5df9 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.105s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:50:28 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:50:28 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d55fa4e-8507-4bd2-ada2-dacd163fbf43]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 14:50:28 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[020e4ad8-29ba-4649-9c5f-543a9378b07e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f] added
Jul 31 14:50:28 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[74daf234-2971-4202-9978-f100079f2b20]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05d0d2b-072f-4121-8e3c-e29c502cfd8d]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PjhAmCqu {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PjhAmCqu" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1bdf9c-0986-4808-a72b-1ef9b15f853b]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PjhAmCqu'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9385841-1940-4dac-9d02-f2a9b91da725]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee82472a-76b1-48c3-bd0f-8d136c2a51ae]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:50:28 user nova-compute[72239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)
Jul 31 14:50:28 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:50:28 user nova-compute[72239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)
Jul 31 14:50:28 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ee7b82-a00e-4678-b94b-b05494827947]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f, portal: 172.16.0.220,3260]
Jul 31 14:50:28 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f, portal: 172.16.0.220,3260] successful.
Jul 31 14:50:28 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5c811f-ad0d-4822-b126-1a04fa74332b]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0519d7c-922a-4659-8b7f-7d1ceca8a233]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:50:28 user nova-compute[72239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)
Jul 31 14:50:28 user nova-compute[72239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:50:28 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:50:28 user nova-compute[72239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)
Jul 31 14:50:28 user nova-compute[72239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:50:28 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.315s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[735ba409-b311-4bc2-a869-d265068c43ad]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PjhAmCqu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Acquiring lock "2393ac0e-4b6c-429e-a73e-a395e79031e0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Lock "2393ac0e-4b6c-429e-a73e-a395e79031e0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG nova.compute.manager [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:28 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 14:50:28 user nova-compute[72239]: INFO nova.compute.claims [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Claim successful on node user
Jul 31 14:50:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:29 user nova-compute[72239]: DEBUG nova.objects.instance [None req-c9435dbc-d51f-431b-8f15-26e9a6ed5df9 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lazy-loading 'flavor' on Instance uuid 82116af8-3702-401b-8d00-9291d4caeb03 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:50:29 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c9435dbc-d51f-431b-8f15-26e9a6ed5df9 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "82116af8-3702-401b-8d00-9291d4caeb03" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.719s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:29 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:50:29 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:50:29 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.512s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:29 user nova-compute[72239]: DEBUG nova.compute.manager [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 14:50:29 user nova-compute[72239]: DEBUG nova.compute.manager [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 14:50:29 user nova-compute[72239]: DEBUG nova.network.neutron [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 14:50:29 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 14:50:29 user nova-compute[72239]: DEBUG nova.compute.manager [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 14:50:29 user nova-compute[72239]: DEBUG nova.policy [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb45b0c1b7404ad2835ebab1ca3b4ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a74501c9a7e4063b3f84e4bf0f15559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 14:50:29 user nova-compute[72239]: DEBUG nova.compute.manager [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 14:50:29 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 14:50:29 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Creating image(s)
Jul 31 14:50:29 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Acquiring lock "/opt/stack/data/nova/instances/2393ac0e-4b6c-429e-a73e-a395e79031e0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:29 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Lock "/opt/stack/data/nova/instances/2393ac0e-4b6c-429e-a73e-a395e79031e0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:29 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Lock "/opt/stack/data/nova/instances/2393ac0e-4b6c-429e-a73e-a395e79031e0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:29 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:29 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.141s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:29 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Acquiring lock "ca449065000c92aac3b7b9fa685f9a7710929444" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:29 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:29 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:29 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:50:29 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] <== connect_volume: return (1486ms) {'type': 'block', 'scsi_wwn': '23762643838376331', 'path': '/dev/sdb'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:50:29 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762643838376331', 'path': '/dev/sdb'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 14:50:29 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:44:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-704430368',display_name='tempest-ServerActionsTestOtherB-server-704430368',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-704430368',id=5,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMAieHq8I0ZAPg3BJdF9GCCYAxcsl1TuUTZpA9U0PVBIFwXLp4luFdF9A4kOklr7N7b3+Doyb1i/MuF4moMlBsM1nlQtqnIuFR3yVshdpPI3XQmqmueJHWFXMGjAp573g==',key_name='tempest-keypair-1046174319',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:48:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='506aad3c95a94800a4cc333a3478da17',ramdisk_id='',reservation_id='r-rcs9kimd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-858495710',owner_user_name='tempest-ServerActionsTestOtherB-858495710-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:50:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c92e1d7e3b944359fcbf9475dcacef0',uuid=d3e3612b-c6b9-4308-a45a-1ff3805e18bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "address": "fa:16:3e:f4:8d:da", "network": {"id": "ad1d78ca-d597-4586-8b1b-4dc00fac3c3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-398965992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "506aad3c95a94800a4cc333a3478da17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ef6541-6b", "ovs_interfaceid": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:50:29 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Converting VIF {"id": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "address": "fa:16:3e:f4:8d:da", "network": {"id": "ad1d78ca-d597-4586-8b1b-4dc00fac3c3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-398965992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "506aad3c95a94800a4cc333a3478da17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ef6541-6b", "ovs_interfaceid": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:50:29 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:8d:da,bridge_name='br-int',has_traffic_filtering=True,id=d6ef6541-6b7e-4dc5-8149-a10940dfe87b,network=Network(ad1d78ca-d597-4586-8b1b-4dc00fac3c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ef6541-6b') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:50:29 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:50:29 user nova-compute[72239]:   <uuid>d3e3612b-c6b9-4308-a45a-1ff3805e18bb</uuid>
Jul 31 14:50:29 user nova-compute[72239]:   <name>instance-00000005</name>
Jul 31 14:50:29 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:50:29 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:50:29 user nova-compute[72239]:   <metadata>
Jul 31 14:50:29 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:50:29 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:50:29 user nova-compute[72239]:       <nova:name>tempest-ServerActionsTestOtherB-server-704430368</nova:name>
Jul 31 14:50:29 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:50:28</nova:creationTime>
Jul 31 14:50:29 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:50:29 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:50:29 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:50:29 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:50:29 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:50:29 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:50:29 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:50:29 user nova-compute[72239]:       <nova:owner>
Jul 31 14:50:29 user nova-compute[72239]:         <nova:user uuid="7c92e1d7e3b944359fcbf9475dcacef0">tempest-ServerActionsTestOtherB-858495710-project-member</nova:user>
Jul 31 14:50:29 user nova-compute[72239]:         <nova:project uuid="506aad3c95a94800a4cc333a3478da17">tempest-ServerActionsTestOtherB-858495710</nova:project>
Jul 31 14:50:29 user nova-compute[72239]:       </nova:owner>
Jul 31 14:50:29 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:50:29 user nova-compute[72239]:       <nova:ports>
Jul 31 14:50:29 user nova-compute[72239]:         <nova:port uuid="d6ef6541-6b7e-4dc5-8149-a10940dfe87b">
Jul 31 14:50:29 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 31 14:50:29 user nova-compute[72239]:         </nova:port>
Jul 31 14:50:29 user nova-compute[72239]:       </nova:ports>
Jul 31 14:50:29 user nova-compute[72239]:     </nova:instance>
Jul 31 14:50:29 user nova-compute[72239]:   </metadata>
Jul 31 14:50:29 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:50:29 user nova-compute[72239]:     <system>
Jul 31 14:50:29 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:50:29 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:50:29 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:50:29 user nova-compute[72239]:       <entry name="serial">d3e3612b-c6b9-4308-a45a-1ff3805e18bb</entry>
Jul 31 14:50:29 user nova-compute[72239]:       <entry name="uuid">d3e3612b-c6b9-4308-a45a-1ff3805e18bb</entry>
Jul 31 14:50:29 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:50:29 user nova-compute[72239]:     </system>
Jul 31 14:50:29 user nova-compute[72239]:   </sysinfo>
Jul 31 14:50:29 user nova-compute[72239]:   <os>
Jul 31 14:50:29 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:50:29 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:50:29 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:50:29 user nova-compute[72239]:   </os>
Jul 31 14:50:29 user nova-compute[72239]:   <features>
Jul 31 14:50:29 user nova-compute[72239]:     <acpi/>
Jul 31 14:50:29 user nova-compute[72239]:     <apic/>
Jul 31 14:50:29 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:50:29 user nova-compute[72239]:   </features>
Jul 31 14:50:29 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:50:29 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:50:29 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:50:29 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:50:29 user nova-compute[72239]:   </clock>
Jul 31 14:50:29 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:50:29 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:50:29 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:50:29 user nova-compute[72239]:   </cpu>
Jul 31 14:50:29 user nova-compute[72239]:   <devices>
Jul 31 14:50:29 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:50:29 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:50:29 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk"/>
Jul 31 14:50:29 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:50:29 user nova-compute[72239]:     </disk>
Jul 31 14:50:29 user nova-compute[72239]:     <disk type="block" device="disk">
Jul 31 14:50:29 user nova-compute[72239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:50:29 user nova-compute[72239]:       <source dev="/dev/sdb"/>
Jul 31 14:50:29 user nova-compute[72239]:       <target dev="vdb" bus="virtio"/>
Jul 31 14:50:29 user nova-compute[72239]:       <serial>0442beb2-94e8-445b-b688-af66bd23814f</serial>
Jul 31 14:50:29 user nova-compute[72239]:     </disk>
Jul 31 14:50:29 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:50:29 user nova-compute[72239]:       <mac address="fa:16:3e:f4:8d:da"/>
Jul 31 14:50:29 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:50:29 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:50:29 user nova-compute[72239]:       <target dev="tapd6ef6541-6b"/>
Jul 31 14:50:29 user nova-compute[72239]:     </interface>
Jul 31 14:50:29 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:50:29 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/console.log" append="off"/>
Jul 31 14:50:29 user nova-compute[72239]:     </serial>
Jul 31 14:50:29 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:50:29 user nova-compute[72239]:     <video>
Jul 31 14:50:29 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:50:29 user nova-compute[72239]:     </video>
Jul 31 14:50:29 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:50:29 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:50:29 user nova-compute[72239]:     </rng>
Jul 31 14:50:29 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:50:29 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:50:29 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:50:29 user nova-compute[72239]:     </memballoon>
Jul 31 14:50:29 user nova-compute[72239]:   </devices>
Jul 31 14:50:29 user nova-compute[72239]: </domain>
Jul 31 14:50:29 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:50:29 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:44:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-704430368',display_name='tempest-ServerActionsTestOtherB-server-704430368',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-704430368',id=5,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMAieHq8I0ZAPg3BJdF9GCCYAxcsl1TuUTZpA9U0PVBIFwXLp4luFdF9A4kOklr7N7b3+Doyb1i/MuF4moMlBsM1nlQtqnIuFR3yVshdpPI3XQmqmueJHWFXMGjAp573g==',key_name='tempest-keypair-1046174319',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:48:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='506aad3c95a94800a4cc333a3478da17',ramdisk_id='',reservation_id='r-rcs9kimd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-858495710',owner_user_name='tempest-ServerActionsTestOtherB-858495710-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:50:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c92e1d7e3b944359fcbf9475dcacef0',uuid=d3e3612b-c6b9-4308-a45a-1ff3805e18bb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "address": "fa:16:3e:f4:8d:da", "network": {"id": "ad1d78ca-d597-4586-8b1b-4dc00fac3c3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-398965992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "506aad3c95a94800a4cc333a3478da17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ef6541-6b", "ovs_interfaceid": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:50:29 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Converting VIF {"id": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "address": "fa:16:3e:f4:8d:da", "network": {"id": "ad1d78ca-d597-4586-8b1b-4dc00fac3c3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-398965992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "506aad3c95a94800a4cc333a3478da17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ef6541-6b", "ovs_interfaceid": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:50:29 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:8d:da,bridge_name='br-int',has_traffic_filtering=True,id=d6ef6541-6b7e-4dc5-8149-a10940dfe87b,network=Network(ad1d78ca-d597-4586-8b1b-4dc00fac3c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ef6541-6b') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:50:29 user nova-compute[72239]: DEBUG os_vif [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:8d:da,bridge_name='br-int',has_traffic_filtering=True,id=d6ef6541-6b7e-4dc5-8149-a10940dfe87b,network=Network(ad1d78ca-d597-4586-8b1b-4dc00fac3c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ef6541-6b') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:50:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:50:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:50:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd6ef6541-6b, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:50:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd6ef6541-6b, col_values=(('external_ids', {'iface-id': 'd6ef6541-6b7e-4dc5-8149-a10940dfe87b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:8d:da', 'vm-uuid': 'd3e3612b-c6b9-4308-a45a-1ff3805e18bb'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:50:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:50:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:29 user nova-compute[72239]: INFO os_vif [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:8d:da,bridge_name='br-int',has_traffic_filtering=True,id=d6ef6541-6b7e-4dc5-8149-a10940dfe87b,network=Network(ad1d78ca-d597-4586-8b1b-4dc00fac3c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ef6541-6b')
Jul 31 14:50:29 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.147s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:29 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/2393ac0e-4b6c-429e-a73e-a395e79031e0/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:30 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/2393ac0e-4b6c-429e-a73e-a395e79031e0/disk 1073741824" returned: 0 in 0.054s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:30 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:30 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.172s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:30 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2393ac0e-4b6c-429e-a73e-a395e79031e0/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 14:50:30 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2393ac0e-4b6c-429e-a73e-a395e79031e0/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:30 user nova-compute[72239]: DEBUG nova.network.neutron [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Successfully created port: db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:50:30 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2393ac0e-4b6c-429e-a73e-a395e79031e0/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:30 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Cannot resize image /opt/stack/data/nova/instances/2393ac0e-4b6c-429e-a73e-a395e79031e0/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 14:50:30 user nova-compute[72239]: DEBUG nova.objects.instance [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Lazy-loading 'migration_context' on Instance uuid 2393ac0e-4b6c-429e-a73e-a395e79031e0 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:50:30 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 14:50:30 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Ensure instance console log exists: /opt/stack/data/nova/instances/2393ac0e-4b6c-429e-a73e-a395e79031e0/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 14:50:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG nova.network.neutron [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Successfully updated port: db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Acquiring lock "refresh_cache-2393ac0e-4b6c-429e-a73e-a395e79031e0" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Acquired lock "refresh_cache-2393ac0e-4b6c-429e-a73e-a395e79031e0" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG nova.network.neutron [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG nova.compute.manager [req-0ec57dc0-91b4-4591-96e8-7f442376b924 req-24714718-73c1-48d1-a12c-9ea7a3bfaebc service nova] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Received event network-changed-db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG nova.compute.manager [req-0ec57dc0-91b4-4591-96e8-7f442376b924 req-24714718-73c1-48d1-a12c-9ea7a3bfaebc service nova] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Refreshing instance network info cache due to event network-changed-db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0ec57dc0-91b4-4591-96e8-7f442376b924 req-24714718-73c1-48d1-a12c-9ea7a3bfaebc service nova] Acquiring lock "refresh_cache-2393ac0e-4b6c-429e-a73e-a395e79031e0" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG nova.network.neutron [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG nova.compute.manager [req-e10198e0-26e2-4f9f-9248-50945b8451cd req-c5c946c9-32a2-4dcd-9394-8d16c4d04242 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Received event network-vif-plugged-d6ef6541-6b7e-4dc5-8149-a10940dfe87b {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e10198e0-26e2-4f9f-9248-50945b8451cd req-c5c946c9-32a2-4dcd-9394-8d16c4d04242 service nova] Acquiring lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e10198e0-26e2-4f9f-9248-50945b8451cd req-c5c946c9-32a2-4dcd-9394-8d16c4d04242 service nova] Lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e10198e0-26e2-4f9f-9248-50945b8451cd req-c5c946c9-32a2-4dcd-9394-8d16c4d04242 service nova] Lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG nova.compute.manager [req-e10198e0-26e2-4f9f-9248-50945b8451cd req-c5c946c9-32a2-4dcd-9394-8d16c4d04242 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] No waiting events found dispatching network-vif-plugged-d6ef6541-6b7e-4dc5-8149-a10940dfe87b {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:50:31 user nova-compute[72239]: WARNING nova.compute.manager [req-e10198e0-26e2-4f9f-9248-50945b8451cd req-c5c946c9-32a2-4dcd-9394-8d16c4d04242 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Received unexpected event network-vif-plugged-d6ef6541-6b7e-4dc5-8149-a10940dfe87b for instance with vm_state resized and task_state resize_reverting.
Jul 31 14:50:31 user nova-compute[72239]: DEBUG nova.network.neutron [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Updating instance_info_cache with network_info: [{"id": "db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c", "address": "fa:16:3e:0d:4d:56", "network": {"id": "bcfa9b25-4156-49df-8aa7-70f499ea3479", "bridge": "br-int", "label": "tempest-VolumesActionsTest-203290973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a74501c9a7e4063b3f84e4bf0f15559", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7aebe9-bd", "ovs_interfaceid": "db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Releasing lock "refresh_cache-2393ac0e-4b6c-429e-a73e-a395e79031e0" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG nova.compute.manager [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Instance network_info: |[{"id": "db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c", "address": "fa:16:3e:0d:4d:56", "network": {"id": "bcfa9b25-4156-49df-8aa7-70f499ea3479", "bridge": "br-int", "label": "tempest-VolumesActionsTest-203290973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a74501c9a7e4063b3f84e4bf0f15559", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7aebe9-bd", "ovs_interfaceid": "db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0ec57dc0-91b4-4591-96e8-7f442376b924 req-24714718-73c1-48d1-a12c-9ea7a3bfaebc service nova] Acquired lock "refresh_cache-2393ac0e-4b6c-429e-a73e-a395e79031e0" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG nova.network.neutron [req-0ec57dc0-91b4-4591-96e8-7f442376b924 req-24714718-73c1-48d1-a12c-9ea7a3bfaebc service nova] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Refreshing network info cache for port db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Start _get_guest_xml network_info=[{"id": "db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c", "address": "fa:16:3e:0d:4d:56", "network": {"id": "bcfa9b25-4156-49df-8aa7-70f499ea3479", "bridge": "br-int", "label": "tempest-VolumesActionsTest-203290973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a74501c9a7e4063b3f84e4bf0f15559", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7aebe9-bd", "ovs_interfaceid": "db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:50:31 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:50:31 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:50:31 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:50:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1861214242',display_name='tempest-VolumesActionsTest-instance-1861214242',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1861214242',id=19,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a74501c9a7e4063b3f84e4bf0f15559',ramdisk_id='',reservation_id='r-jgw0i7tx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-200342881',owner_user_name='tempest-VolumesActionsTest-200342881-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:50:30Z,user_data=None,user_id='fb45b0c1b7404ad2835ebab1ca3b4ff6',uuid=2393ac0e-4b6c-429e-a73e-a395e79031e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c", "address": "fa:16:3e:0d:4d:56", "network": {"id": "bcfa9b25-4156-49df-8aa7-70f499ea3479", "bridge": "br-int", "label": "tempest-VolumesActionsTest-203290973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a74501c9a7e4063b3f84e4bf0f15559", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7aebe9-bd", "ovs_interfaceid": "db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Converting VIF {"id": "db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c", "address": "fa:16:3e:0d:4d:56", "network": {"id": "bcfa9b25-4156-49df-8aa7-70f499ea3479", "bridge": "br-int", "label": "tempest-VolumesActionsTest-203290973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a74501c9a7e4063b3f84e4bf0f15559", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7aebe9-bd", "ovs_interfaceid": "db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:4d:56,bridge_name='br-int',has_traffic_filtering=True,id=db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c,network=Network(bcfa9b25-4156-49df-8aa7-70f499ea3479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb7aebe9-bd') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG nova.objects.instance [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Lazy-loading 'pci_devices' on Instance uuid 2393ac0e-4b6c-429e-a73e-a395e79031e0 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:50:31 user nova-compute[72239]:   <uuid>2393ac0e-4b6c-429e-a73e-a395e79031e0</uuid>
Jul 31 14:50:31 user nova-compute[72239]:   <name>instance-00000013</name>
Jul 31 14:50:31 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:50:31 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:50:31 user nova-compute[72239]:   <metadata>
Jul 31 14:50:31 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:50:31 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:50:31 user nova-compute[72239]:       <nova:name>tempest-VolumesActionsTest-instance-1861214242</nova:name>
Jul 31 14:50:31 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:50:31</nova:creationTime>
Jul 31 14:50:31 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:50:31 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:50:31 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:50:31 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:50:31 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:50:31 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:50:31 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:50:31 user nova-compute[72239]:       <nova:owner>
Jul 31 14:50:31 user nova-compute[72239]:         <nova:user uuid="fb45b0c1b7404ad2835ebab1ca3b4ff6">tempest-VolumesActionsTest-200342881-project-member</nova:user>
Jul 31 14:50:31 user nova-compute[72239]:         <nova:project uuid="2a74501c9a7e4063b3f84e4bf0f15559">tempest-VolumesActionsTest-200342881</nova:project>
Jul 31 14:50:31 user nova-compute[72239]:       </nova:owner>
Jul 31 14:50:31 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:50:31 user nova-compute[72239]:       <nova:ports>
Jul 31 14:50:31 user nova-compute[72239]:         <nova:port uuid="db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c">
Jul 31 14:50:31 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 31 14:50:31 user nova-compute[72239]:         </nova:port>
Jul 31 14:50:31 user nova-compute[72239]:       </nova:ports>
Jul 31 14:50:31 user nova-compute[72239]:     </nova:instance>
Jul 31 14:50:31 user nova-compute[72239]:   </metadata>
Jul 31 14:50:31 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:50:31 user nova-compute[72239]:     <system>
Jul 31 14:50:31 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:50:31 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:50:31 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:50:31 user nova-compute[72239]:       <entry name="serial">2393ac0e-4b6c-429e-a73e-a395e79031e0</entry>
Jul 31 14:50:31 user nova-compute[72239]:       <entry name="uuid">2393ac0e-4b6c-429e-a73e-a395e79031e0</entry>
Jul 31 14:50:31 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:50:31 user nova-compute[72239]:     </system>
Jul 31 14:50:31 user nova-compute[72239]:   </sysinfo>
Jul 31 14:50:31 user nova-compute[72239]:   <os>
Jul 31 14:50:31 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:50:31 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:50:31 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:50:31 user nova-compute[72239]:   </os>
Jul 31 14:50:31 user nova-compute[72239]:   <features>
Jul 31 14:50:31 user nova-compute[72239]:     <acpi/>
Jul 31 14:50:31 user nova-compute[72239]:     <apic/>
Jul 31 14:50:31 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:50:31 user nova-compute[72239]:   </features>
Jul 31 14:50:31 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:50:31 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:50:31 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:50:31 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:50:31 user nova-compute[72239]:   </clock>
Jul 31 14:50:31 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:50:31 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:50:31 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:50:31 user nova-compute[72239]:   </cpu>
Jul 31 14:50:31 user nova-compute[72239]:   <devices>
Jul 31 14:50:31 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:50:31 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:50:31 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/2393ac0e-4b6c-429e-a73e-a395e79031e0/disk"/>
Jul 31 14:50:31 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:50:31 user nova-compute[72239]:     </disk>
Jul 31 14:50:31 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:50:31 user nova-compute[72239]:       <mac address="fa:16:3e:0d:4d:56"/>
Jul 31 14:50:31 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:50:31 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:50:31 user nova-compute[72239]:       <target dev="tapdb7aebe9-bd"/>
Jul 31 14:50:31 user nova-compute[72239]:     </interface>
Jul 31 14:50:31 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:50:31 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/2393ac0e-4b6c-429e-a73e-a395e79031e0/console.log" append="off"/>
Jul 31 14:50:31 user nova-compute[72239]:     </serial>
Jul 31 14:50:31 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:50:31 user nova-compute[72239]:     <video>
Jul 31 14:50:31 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:50:31 user nova-compute[72239]:     </video>
Jul 31 14:50:31 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:50:31 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:50:31 user nova-compute[72239]:     </rng>
Jul 31 14:50:31 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:50:31 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:50:31 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:50:31 user nova-compute[72239]:     </memballoon>
Jul 31 14:50:31 user nova-compute[72239]:   </devices>
Jul 31 14:50:31 user nova-compute[72239]: </domain>
Jul 31 14:50:31 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:50:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1861214242',display_name='tempest-VolumesActionsTest-instance-1861214242',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1861214242',id=19,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a74501c9a7e4063b3f84e4bf0f15559',ramdisk_id='',reservation_id='r-jgw0i7tx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-200342881',owner_user_name='tempest-VolumesActionsTest-200342881-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:50:30Z,user_data=None,user_id='fb45b0c1b7404ad2835ebab1ca3b4ff6',uuid=2393ac0e-4b6c-429e-a73e-a395e79031e0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c", "address": "fa:16:3e:0d:4d:56", "network": {"id": "bcfa9b25-4156-49df-8aa7-70f499ea3479", "bridge": "br-int", "label": "tempest-VolumesActionsTest-203290973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a74501c9a7e4063b3f84e4bf0f15559", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7aebe9-bd", "ovs_interfaceid": "db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Converting VIF {"id": "db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c", "address": "fa:16:3e:0d:4d:56", "network": {"id": "bcfa9b25-4156-49df-8aa7-70f499ea3479", "bridge": "br-int", "label": "tempest-VolumesActionsTest-203290973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a74501c9a7e4063b3f84e4bf0f15559", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7aebe9-bd", "ovs_interfaceid": "db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:4d:56,bridge_name='br-int',has_traffic_filtering=True,id=db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c,network=Network(bcfa9b25-4156-49df-8aa7-70f499ea3479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb7aebe9-bd') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG os_vif [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:4d:56,bridge_name='br-int',has_traffic_filtering=True,id=db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c,network=Network(bcfa9b25-4156-49df-8aa7-70f499ea3479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb7aebe9-bd') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb7aebe9-bd, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdb7aebe9-bd, col_values=(('external_ids', {'iface-id': 'db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:4d:56', 'vm-uuid': '2393ac0e-4b6c-429e-a73e-a395e79031e0'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:50:31 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:31 user nova-compute[72239]: INFO os_vif [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:4d:56,bridge_name='br-int',has_traffic_filtering=True,id=db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c,network=Network(bcfa9b25-4156-49df-8aa7-70f499ea3479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb7aebe9-bd')
Jul 31 14:50:32 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:50:32 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] No VIF found with MAC fa:16:3e:0d:4d:56, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:50:32 user nova-compute[72239]: DEBUG nova.network.neutron [req-0ec57dc0-91b4-4591-96e8-7f442376b924 req-24714718-73c1-48d1-a12c-9ea7a3bfaebc service nova] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Updated VIF entry in instance network info cache for port db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:50:32 user nova-compute[72239]: DEBUG nova.network.neutron [req-0ec57dc0-91b4-4591-96e8-7f442376b924 req-24714718-73c1-48d1-a12c-9ea7a3bfaebc service nova] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Updating instance_info_cache with network_info: [{"id": "db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c", "address": "fa:16:3e:0d:4d:56", "network": {"id": "bcfa9b25-4156-49df-8aa7-70f499ea3479", "bridge": "br-int", "label": "tempest-VolumesActionsTest-203290973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a74501c9a7e4063b3f84e4bf0f15559", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7aebe9-bd", "ovs_interfaceid": "db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:50:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0ec57dc0-91b4-4591-96e8-7f442376b924 req-24714718-73c1-48d1-a12c-9ea7a3bfaebc service nova] Releasing lock "refresh_cache-2393ac0e-4b6c-429e-a73e-a395e79031e0" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:50:33 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:33 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:33 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:33 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815033.6117973, d3e3612b-c6b9-4308-a45a-1ff3805e18bb => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:50:33 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] VM Resumed (Lifecycle Event)
Jul 31 14:50:33 user nova-compute[72239]: DEBUG nova.compute.manager [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:50:33 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Instance running successfully.
Jul 31 14:50:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] finish_revert_migration finished successfully. {{(pid=72239) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Jul 31 14:50:33 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:50:33 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:50:33 user nova-compute[72239]: DEBUG nova.compute.manager [req-34b11de5-daeb-4877-91af-e7b1d564a680 req-7377ddff-40c4-4316-accd-465fdf0c9665 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Received event network-vif-plugged-d6ef6541-6b7e-4dc5-8149-a10940dfe87b {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:50:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-34b11de5-daeb-4877-91af-e7b1d564a680 req-7377ddff-40c4-4316-accd-465fdf0c9665 service nova] Acquiring lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-34b11de5-daeb-4877-91af-e7b1d564a680 req-7377ddff-40c4-4316-accd-465fdf0c9665 service nova] Lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-34b11de5-daeb-4877-91af-e7b1d564a680 req-7377ddff-40c4-4316-accd-465fdf0c9665 service nova] Lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:33 user nova-compute[72239]: DEBUG nova.compute.manager [req-34b11de5-daeb-4877-91af-e7b1d564a680 req-7377ddff-40c4-4316-accd-465fdf0c9665 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] No waiting events found dispatching network-vif-plugged-d6ef6541-6b7e-4dc5-8149-a10940dfe87b {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:50:33 user nova-compute[72239]: WARNING nova.compute.manager [req-34b11de5-daeb-4877-91af-e7b1d564a680 req-7377ddff-40c4-4316-accd-465fdf0c9665 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Received unexpected event network-vif-plugged-d6ef6541-6b7e-4dc5-8149-a10940dfe87b for instance with vm_state resized and task_state resize_reverting.
Jul 31 14:50:33 user nova-compute[72239]: DEBUG nova.compute.manager [req-34b11de5-daeb-4877-91af-e7b1d564a680 req-7377ddff-40c4-4316-accd-465fdf0c9665 service nova] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Received event network-vif-plugged-db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:50:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-34b11de5-daeb-4877-91af-e7b1d564a680 req-7377ddff-40c4-4316-accd-465fdf0c9665 service nova] Acquiring lock "2393ac0e-4b6c-429e-a73e-a395e79031e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-34b11de5-daeb-4877-91af-e7b1d564a680 req-7377ddff-40c4-4316-accd-465fdf0c9665 service nova] Lock "2393ac0e-4b6c-429e-a73e-a395e79031e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-34b11de5-daeb-4877-91af-e7b1d564a680 req-7377ddff-40c4-4316-accd-465fdf0c9665 service nova] Lock "2393ac0e-4b6c-429e-a73e-a395e79031e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:33 user nova-compute[72239]: DEBUG nova.compute.manager [req-34b11de5-daeb-4877-91af-e7b1d564a680 req-7377ddff-40c4-4316-accd-465fdf0c9665 service nova] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] No waiting events found dispatching network-vif-plugged-db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:50:33 user nova-compute[72239]: WARNING nova.compute.manager [req-34b11de5-daeb-4877-91af-e7b1d564a680 req-7377ddff-40c4-4316-accd-465fdf0c9665 service nova] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Received unexpected event network-vif-plugged-db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c for instance with vm_state building and task_state spawning.
Jul 31 14:50:33 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 31 14:50:33 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815033.6139529, d3e3612b-c6b9-4308-a45a-1ff3805e18bb => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:50:33 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] VM Started (Lifecycle Event)
Jul 31 14:50:33 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:50:33 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:50:33 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 31 14:50:33 user nova-compute[72239]: INFO nova.compute.manager [None req-814258a7-dc22-462d-8c8f-d14e4cbf440b tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Updating instance to original state: 'active'
Jul 31 14:50:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:35 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815035.6010687, 2393ac0e-4b6c-429e-a73e-a395e79031e0 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:50:35 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] VM Resumed (Lifecycle Event)
Jul 31 14:50:35 user nova-compute[72239]: DEBUG nova.compute.manager [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:50:35 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 14:50:35 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Instance spawned successfully.
Jul 31 14:50:35 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 14:50:35 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:50:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5855ae26-2544-485f-85b4-b15daa085016 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Acquiring lock "62122879-2a72-4ddf-a028-317eda0da465" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5855ae26-2544-485f-85b4-b15daa085016 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "62122879-2a72-4ddf-a028-317eda0da465" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5855ae26-2544-485f-85b4-b15daa085016 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Acquiring lock "62122879-2a72-4ddf-a028-317eda0da465-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5855ae26-2544-485f-85b4-b15daa085016 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "62122879-2a72-4ddf-a028-317eda0da465-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5855ae26-2544-485f-85b4-b15daa085016 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "62122879-2a72-4ddf-a028-317eda0da465-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:35 user nova-compute[72239]: INFO nova.compute.manager [None req-5855ae26-2544-485f-85b4-b15daa085016 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Terminating instance
Jul 31 14:50:35 user nova-compute[72239]: DEBUG nova.compute.manager [None req-5855ae26-2544-485f-85b4-b15daa085016 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 14:50:35 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:50:35 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:50:35 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:50:35 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:50:35 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:50:35 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:50:35 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:50:35 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:50:35 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815035.602026, 2393ac0e-4b6c-429e-a73e-a395e79031e0 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:50:35 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] VM Started (Lifecycle Event)
Jul 31 14:50:35 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:50:35 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:50:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:35 user nova-compute[72239]: INFO nova.compute.manager [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Took 6.11 seconds to spawn the instance on the hypervisor.
Jul 31 14:50:35 user nova-compute[72239]: DEBUG nova.compute.manager [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:50:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:35 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:50:35 user nova-compute[72239]: DEBUG nova.compute.manager [req-022d3af3-3856-4b5c-9918-33d7deb06db8 req-1e4065a5-1959-4222-aea9-fa382c001e7e service nova] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Received event network-vif-plugged-db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:50:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-022d3af3-3856-4b5c-9918-33d7deb06db8 req-1e4065a5-1959-4222-aea9-fa382c001e7e service nova] Acquiring lock "2393ac0e-4b6c-429e-a73e-a395e79031e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-022d3af3-3856-4b5c-9918-33d7deb06db8 req-1e4065a5-1959-4222-aea9-fa382c001e7e service nova] Lock "2393ac0e-4b6c-429e-a73e-a395e79031e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-022d3af3-3856-4b5c-9918-33d7deb06db8 req-1e4065a5-1959-4222-aea9-fa382c001e7e service nova] Lock "2393ac0e-4b6c-429e-a73e-a395e79031e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:35 user nova-compute[72239]: DEBUG nova.compute.manager [req-022d3af3-3856-4b5c-9918-33d7deb06db8 req-1e4065a5-1959-4222-aea9-fa382c001e7e service nova] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] No waiting events found dispatching network-vif-plugged-db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:50:35 user nova-compute[72239]: WARNING nova.compute.manager [req-022d3af3-3856-4b5c-9918-33d7deb06db8 req-1e4065a5-1959-4222-aea9-fa382c001e7e service nova] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Received unexpected event network-vif-plugged-db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c for instance with vm_state building and task_state spawning.
Jul 31 14:50:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:35 user nova-compute[72239]: INFO nova.compute.manager [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Took 6.99 seconds to build instance.
Jul 31 14:50:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d1ec30c7-c317-4098-a567-cf121f816964 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Lock "2393ac0e-4b6c-429e-a73e-a395e79031e0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.099s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:36 user nova-compute[72239]: DEBUG nova.compute.manager [req-1f6b253b-5dd2-4008-b0cf-786ba028466c req-dc52f38f-d6bd-4ea9-9e5b-ffef93f5e056 service nova] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Received event network-vif-unplugged-7bc07641-e336-4044-9615-fea49f5b056c {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:50:36 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-1f6b253b-5dd2-4008-b0cf-786ba028466c req-dc52f38f-d6bd-4ea9-9e5b-ffef93f5e056 service nova] Acquiring lock "62122879-2a72-4ddf-a028-317eda0da465-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:36 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-1f6b253b-5dd2-4008-b0cf-786ba028466c req-dc52f38f-d6bd-4ea9-9e5b-ffef93f5e056 service nova] Lock "62122879-2a72-4ddf-a028-317eda0da465-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:36 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-1f6b253b-5dd2-4008-b0cf-786ba028466c req-dc52f38f-d6bd-4ea9-9e5b-ffef93f5e056 service nova] Lock "62122879-2a72-4ddf-a028-317eda0da465-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:36 user nova-compute[72239]: DEBUG nova.compute.manager [req-1f6b253b-5dd2-4008-b0cf-786ba028466c req-dc52f38f-d6bd-4ea9-9e5b-ffef93f5e056 service nova] [instance: 62122879-2a72-4ddf-a028-317eda0da465] No waiting events found dispatching network-vif-unplugged-7bc07641-e336-4044-9615-fea49f5b056c {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:50:36 user nova-compute[72239]: DEBUG nova.compute.manager [req-1f6b253b-5dd2-4008-b0cf-786ba028466c req-dc52f38f-d6bd-4ea9-9e5b-ffef93f5e056 service nova] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Received event network-vif-unplugged-7bc07641-e336-4044-9615-fea49f5b056c for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 14:50:36 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Instance destroyed successfully.
Jul 31 14:50:36 user nova-compute[72239]: DEBUG nova.objects.instance [None req-5855ae26-2544-485f-85b4-b15daa085016 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lazy-loading 'resources' on Instance uuid 62122879-2a72-4ddf-a028-317eda0da465 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:50:36 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-5855ae26-2544-485f-85b4-b15daa085016 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:44:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-189505167',display_name='tempest-VolumesAdminNegativeTest-server-189505167',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-189505167',id=8,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4kZUaCf+F4oCkncSIsfc5+enaKqNDv+6vwD5z6khTKLoFMKLUdOqFKyUsjo4h/rOQ9AFcsum7pSFLn4Rr3FzXqr4CgzCNiYvpP6LABZjYccaFZoUc0imgdLvxj3Ry4vw==',key_name='tempest-keypair-462772525',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:44:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6aad7d4ecc24425a8571cc2ac8041628',ramdisk_id='',reservation_id='r-nliz7znl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1841650306',owner_user_name='tempest-VolumesAdminNegativeTest-1841650306-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:44:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6f0cfea2c0f4ec8bfa115354e65da96',uuid=62122879-2a72-4ddf-a028-317eda0da465,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7bc07641-e336-4044-9615-fea49f5b056c", "address": "fa:16:3e:f6:05:0e", "network": {"id": "f05d7a54-33c7-463e-a73e-8d726fe2a9b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-181910970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aad7d4ecc24425a8571cc2ac8041628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc07641-e3", "ovs_interfaceid": "7bc07641-e336-4044-9615-fea49f5b056c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:50:36 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-5855ae26-2544-485f-85b4-b15daa085016 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Converting VIF {"id": "7bc07641-e336-4044-9615-fea49f5b056c", "address": "fa:16:3e:f6:05:0e", "network": {"id": "f05d7a54-33c7-463e-a73e-8d726fe2a9b0", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-181910970-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6aad7d4ecc24425a8571cc2ac8041628", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bc07641-e3", "ovs_interfaceid": "7bc07641-e336-4044-9615-fea49f5b056c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:50:36 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-5855ae26-2544-485f-85b4-b15daa085016 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f6:05:0e,bridge_name='br-int',has_traffic_filtering=True,id=7bc07641-e336-4044-9615-fea49f5b056c,network=Network(f05d7a54-33c7-463e-a73e-8d726fe2a9b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc07641-e3') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:50:36 user nova-compute[72239]: DEBUG os_vif [None req-5855ae26-2544-485f-85b4-b15daa085016 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:05:0e,bridge_name='br-int',has_traffic_filtering=True,id=7bc07641-e336-4044-9615-fea49f5b056c,network=Network(f05d7a54-33c7-463e-a73e-8d726fe2a9b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc07641-e3') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:50:36 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:36 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7bc07641-e3, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:50:36 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:36 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:50:36 user nova-compute[72239]: INFO os_vif [None req-5855ae26-2544-485f-85b4-b15daa085016 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f6:05:0e,bridge_name='br-int',has_traffic_filtering=True,id=7bc07641-e336-4044-9615-fea49f5b056c,network=Network(f05d7a54-33c7-463e-a73e-8d726fe2a9b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7bc07641-e3')
Jul 31 14:50:36 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-5855ae26-2544-485f-85b4-b15daa085016 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Deleting instance files /opt/stack/data/nova/instances/62122879-2a72-4ddf-a028-317eda0da465_del
Jul 31 14:50:36 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-5855ae26-2544-485f-85b4-b15daa085016 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Deletion of /opt/stack/data/nova/instances/62122879-2a72-4ddf-a028-317eda0da465_del complete
Jul 31 14:50:36 user nova-compute[72239]: INFO nova.compute.manager [None req-5855ae26-2544-485f-85b4-b15daa085016 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Took 0.95 seconds to destroy the instance on the hypervisor.
Jul 31 14:50:36 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-5855ae26-2544-485f-85b4-b15daa085016 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 14:50:36 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 14:50:36 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 62122879-2a72-4ddf-a028-317eda0da465] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._sync_power_states {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:50:37 user nova-compute[72239]: WARNING nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] While synchronizing instance power states, found 12 instances in the database and 11 instances on the hypervisor.
Jul 31 14:50:37 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Triggering sync for uuid 20abf743-de5b-4122-aad0-e2124c7804b7 {{(pid=72239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Triggering sync for uuid 7d81b881-b44e-4fb3-8245-9dea634bdec9 {{(pid=72239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Triggering sync for uuid 079a5ed7-ee25-495b-a2a4-924d830a670a {{(pid=72239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Triggering sync for uuid d3e3612b-c6b9-4308-a45a-1ff3805e18bb {{(pid=72239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Triggering sync for uuid 97917500-bc78-433b-8d3d-181ed13667dc {{(pid=72239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Triggering sync for uuid 62122879-2a72-4ddf-a028-317eda0da465 {{(pid=72239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Triggering sync for uuid 82116af8-3702-401b-8d00-9291d4caeb03 {{(pid=72239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Triggering sync for uuid 2f11022e-a007-4d4c-adc1-b54ea59b9e6a {{(pid=72239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Triggering sync for uuid c10918e9-9731-48ea-860e-8a02cb6a0ad9 {{(pid=72239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Triggering sync for uuid db15ad45-8f28-4e0c-8d7e-7db75f33fe92 {{(pid=72239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Triggering sync for uuid 1e626a09-1282-4864-8336-6720c7caa0da {{(pid=72239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Triggering sync for uuid 2393ac0e-4b6c-429e-a73e-a395e79031e0 {{(pid=72239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "20abf743-de5b-4122-aad0-e2124c7804b7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "20abf743-de5b-4122-aad0-e2124c7804b7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "7d81b881-b44e-4fb3-8245-9dea634bdec9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "079a5ed7-ee25-495b-a2a4-924d830a670a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "079a5ed7-ee25-495b-a2a4-924d830a670a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "97917500-bc78-433b-8d3d-181ed13667dc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "97917500-bc78-433b-8d3d-181ed13667dc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "62122879-2a72-4ddf-a028-317eda0da465" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "82116af8-3702-401b-8d00-9291d4caeb03" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "82116af8-3702-401b-8d00-9291d4caeb03" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "1e626a09-1282-4864-8336-6720c7caa0da" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "1e626a09-1282-4864-8336-6720c7caa0da" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "2393ac0e-4b6c-429e-a73e-a395e79031e0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "2393ac0e-4b6c-429e-a73e-a395e79031e0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:37 user nova-compute[72239]: WARNING oslo_messaging._drivers.amqpdriver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Jul 31 14:50:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "20abf743-de5b-4122-aad0-e2124c7804b7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.125s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.127s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.129s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "97917500-bc78-433b-8d3d-181ed13667dc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.130s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "2393ac0e-4b6c-429e-a73e-a395e79031e0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.127s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.135s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "1e626a09-1282-4864-8336-6720c7caa0da" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.133s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.148s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "079a5ed7-ee25-495b-a2a4-924d830a670a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.195s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "82116af8-3702-401b-8d00-9291d4caeb03" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.190s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.212s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:50:37 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Took 0.99 seconds to deallocate network for instance.
Jul 31 14:50:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5855ae26-2544-485f-85b4-b15daa085016 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5855ae26-2544-485f-85b4-b15daa085016 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:37 user nova-compute[72239]: INFO nova.compute.manager [None req-a283f278-633a-491e-93c0-b87ab1b8115b tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Unrescuing
Jul 31 14:50:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a283f278-633a-491e-93c0-b87ab1b8115b tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "refresh_cache-2f11022e-a007-4d4c-adc1-b54ea59b9e6a" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a283f278-633a-491e-93c0-b87ab1b8115b tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquired lock "refresh_cache-2f11022e-a007-4d4c-adc1-b54ea59b9e6a" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:50:37 user nova-compute[72239]: DEBUG nova.network.neutron [None req-a283f278-633a-491e-93c0-b87ab1b8115b tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:50:38 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-5855ae26-2544-485f-85b4-b15daa085016 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:50:38 user nova-compute[72239]: DEBUG nova.compute.manager [req-68fec6fd-6a4f-4fae-a492-53be88e1672f req-f9090c25-12ef-4406-ba8a-be19d55df4b8 service nova] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Received event network-vif-plugged-7bc07641-e336-4044-9615-fea49f5b056c {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:50:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-68fec6fd-6a4f-4fae-a492-53be88e1672f req-f9090c25-12ef-4406-ba8a-be19d55df4b8 service nova] Acquiring lock "62122879-2a72-4ddf-a028-317eda0da465-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-68fec6fd-6a4f-4fae-a492-53be88e1672f req-f9090c25-12ef-4406-ba8a-be19d55df4b8 service nova] Lock "62122879-2a72-4ddf-a028-317eda0da465-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-68fec6fd-6a4f-4fae-a492-53be88e1672f req-f9090c25-12ef-4406-ba8a-be19d55df4b8 service nova] Lock "62122879-2a72-4ddf-a028-317eda0da465-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:38 user nova-compute[72239]: DEBUG nova.compute.manager [req-68fec6fd-6a4f-4fae-a492-53be88e1672f req-f9090c25-12ef-4406-ba8a-be19d55df4b8 service nova] [instance: 62122879-2a72-4ddf-a028-317eda0da465] No waiting events found dispatching network-vif-plugged-7bc07641-e336-4044-9615-fea49f5b056c {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:50:38 user nova-compute[72239]: WARNING nova.compute.manager [req-68fec6fd-6a4f-4fae-a492-53be88e1672f req-f9090c25-12ef-4406-ba8a-be19d55df4b8 service nova] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Received unexpected event network-vif-plugged-7bc07641-e336-4044-9615-fea49f5b056c for instance with vm_state deleted and task_state None.
Jul 31 14:50:38 user nova-compute[72239]: DEBUG nova.compute.manager [req-68fec6fd-6a4f-4fae-a492-53be88e1672f req-f9090c25-12ef-4406-ba8a-be19d55df4b8 service nova] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Received event network-vif-deleted-7bc07641-e336-4044-9615-fea49f5b056c {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:50:38 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-5855ae26-2544-485f-85b4-b15daa085016 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:50:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5855ae26-2544-485f-85b4-b15daa085016 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.516s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:38 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-5855ae26-2544-485f-85b4-b15daa085016 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Deleted allocations for instance 62122879-2a72-4ddf-a028-317eda0da465
Jul 31 14:50:38 user nova-compute[72239]: DEBUG nova.network.neutron [None req-a283f278-633a-491e-93c0-b87ab1b8115b tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Updating instance_info_cache with network_info: [{"id": "91cadad3-732b-4fed-af92-b54692837973", "address": "fa:16:3e:44:72:66", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91cadad3-73", "ovs_interfaceid": "91cadad3-732b-4fed-af92-b54692837973", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:50:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a283f278-633a-491e-93c0-b87ab1b8115b tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Releasing lock "refresh_cache-2f11022e-a007-4d4c-adc1-b54ea59b9e6a" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:50:38 user nova-compute[72239]: DEBUG nova.objects.instance [None req-a283f278-633a-491e-93c0-b87ab1b8115b tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lazy-loading 'flavor' on Instance uuid 2f11022e-a007-4d4c-adc1-b54ea59b9e6a {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:50:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5855ae26-2544-485f-85b4-b15daa085016 tempest-VolumesAdminNegativeTest-1841650306 tempest-VolumesAdminNegativeTest-1841650306-project-member] Lock "62122879-2a72-4ddf-a028-317eda0da465" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.722s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "62122879-2a72-4ddf-a028-317eda0da465" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.019s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:38 user nova-compute[72239]: INFO nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 62122879-2a72-4ddf-a028-317eda0da465] During sync_power_state the instance has a pending task (deleting). Skip.
Jul 31 14:50:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "62122879-2a72-4ddf-a028-317eda0da465" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:38 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:38 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:38 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:38 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:39 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Instance destroyed successfully.
Jul 31 14:50:40 user nova-compute[72239]: DEBUG nova.compute.manager [req-eb3fc91d-249d-411d-924e-b68deb3dcf56 req-6b5fe85f-6818-4098-bafb-4ce4809f3752 service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Received event network-vif-unplugged-91cadad3-732b-4fed-af92-b54692837973 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:50:40 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-eb3fc91d-249d-411d-924e-b68deb3dcf56 req-6b5fe85f-6818-4098-bafb-4ce4809f3752 service nova] Acquiring lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:40 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-eb3fc91d-249d-411d-924e-b68deb3dcf56 req-6b5fe85f-6818-4098-bafb-4ce4809f3752 service nova] Lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:40 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-eb3fc91d-249d-411d-924e-b68deb3dcf56 req-6b5fe85f-6818-4098-bafb-4ce4809f3752 service nova] Lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:40 user nova-compute[72239]: DEBUG nova.compute.manager [req-eb3fc91d-249d-411d-924e-b68deb3dcf56 req-6b5fe85f-6818-4098-bafb-4ce4809f3752 service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] No waiting events found dispatching network-vif-unplugged-91cadad3-732b-4fed-af92-b54692837973 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:50:40 user nova-compute[72239]: WARNING nova.compute.manager [req-eb3fc91d-249d-411d-924e-b68deb3dcf56 req-6b5fe85f-6818-4098-bafb-4ce4809f3752 service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Received unexpected event network-vif-unplugged-91cadad3-732b-4fed-af92-b54692837973 for instance with vm_state rescued and task_state unrescuing.
Jul 31 14:50:40 user nova-compute[72239]: DEBUG nova.compute.manager [req-eb3fc91d-249d-411d-924e-b68deb3dcf56 req-6b5fe85f-6818-4098-bafb-4ce4809f3752 service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Received event network-vif-plugged-91cadad3-732b-4fed-af92-b54692837973 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:50:40 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-eb3fc91d-249d-411d-924e-b68deb3dcf56 req-6b5fe85f-6818-4098-bafb-4ce4809f3752 service nova] Acquiring lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:40 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-eb3fc91d-249d-411d-924e-b68deb3dcf56 req-6b5fe85f-6818-4098-bafb-4ce4809f3752 service nova] Lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:40 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-eb3fc91d-249d-411d-924e-b68deb3dcf56 req-6b5fe85f-6818-4098-bafb-4ce4809f3752 service nova] Lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:40 user nova-compute[72239]: DEBUG nova.compute.manager [req-eb3fc91d-249d-411d-924e-b68deb3dcf56 req-6b5fe85f-6818-4098-bafb-4ce4809f3752 service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] No waiting events found dispatching network-vif-plugged-91cadad3-732b-4fed-af92-b54692837973 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:50:40 user nova-compute[72239]: WARNING nova.compute.manager [req-eb3fc91d-249d-411d-924e-b68deb3dcf56 req-6b5fe85f-6818-4098-bafb-4ce4809f3752 service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Received unexpected event network-vif-plugged-91cadad3-732b-4fed-af92-b54692837973 for instance with vm_state rescued and task_state unrescuing.
Jul 31 14:50:40 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:41 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:41 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:41 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:41 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:41 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:41 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:42 user nova-compute[72239]: DEBUG nova.compute.manager [req-2d56deec-eff8-4729-a40c-0507945bb4cd req-407e7ca6-0aaf-4dd1-a6c2-86f33575fc37 service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Received event network-vif-plugged-91cadad3-732b-4fed-af92-b54692837973 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:50:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-2d56deec-eff8-4729-a40c-0507945bb4cd req-407e7ca6-0aaf-4dd1-a6c2-86f33575fc37 service nova] Acquiring lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-2d56deec-eff8-4729-a40c-0507945bb4cd req-407e7ca6-0aaf-4dd1-a6c2-86f33575fc37 service nova] Lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-2d56deec-eff8-4729-a40c-0507945bb4cd req-407e7ca6-0aaf-4dd1-a6c2-86f33575fc37 service nova] Lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:42 user nova-compute[72239]: DEBUG nova.compute.manager [req-2d56deec-eff8-4729-a40c-0507945bb4cd req-407e7ca6-0aaf-4dd1-a6c2-86f33575fc37 service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] No waiting events found dispatching network-vif-plugged-91cadad3-732b-4fed-af92-b54692837973 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:50:42 user nova-compute[72239]: WARNING nova.compute.manager [req-2d56deec-eff8-4729-a40c-0507945bb4cd req-407e7ca6-0aaf-4dd1-a6c2-86f33575fc37 service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Received unexpected event network-vif-plugged-91cadad3-732b-4fed-af92-b54692837973 for instance with vm_state rescued and task_state unrescuing.
Jul 31 14:50:42 user nova-compute[72239]: DEBUG nova.compute.manager [req-2d56deec-eff8-4729-a40c-0507945bb4cd req-407e7ca6-0aaf-4dd1-a6c2-86f33575fc37 service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Received event network-vif-plugged-91cadad3-732b-4fed-af92-b54692837973 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:50:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-2d56deec-eff8-4729-a40c-0507945bb4cd req-407e7ca6-0aaf-4dd1-a6c2-86f33575fc37 service nova] Acquiring lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-2d56deec-eff8-4729-a40c-0507945bb4cd req-407e7ca6-0aaf-4dd1-a6c2-86f33575fc37 service nova] Lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-2d56deec-eff8-4729-a40c-0507945bb4cd req-407e7ca6-0aaf-4dd1-a6c2-86f33575fc37 service nova] Lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:42 user nova-compute[72239]: DEBUG nova.compute.manager [req-2d56deec-eff8-4729-a40c-0507945bb4cd req-407e7ca6-0aaf-4dd1-a6c2-86f33575fc37 service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] No waiting events found dispatching network-vif-plugged-91cadad3-732b-4fed-af92-b54692837973 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:50:42 user nova-compute[72239]: WARNING nova.compute.manager [req-2d56deec-eff8-4729-a40c-0507945bb4cd req-407e7ca6-0aaf-4dd1-a6c2-86f33575fc37 service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Received unexpected event network-vif-plugged-91cadad3-732b-4fed-af92-b54692837973 for instance with vm_state rescued and task_state unrescuing.
Jul 31 14:50:43 user nova-compute[72239]: DEBUG nova.compute.manager [None req-a283f278-633a-491e-93c0-b87ab1b8115b tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:50:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Removed pending event for 2f11022e-a007-4d4c-adc1-b54ea59b9e6a due to event {{(pid=72239) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 14:50:43 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815043.3468935, 2f11022e-a007-4d4c-adc1-b54ea59b9e6a => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:50:43 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] VM Resumed (Lifecycle Event)
Jul 31 14:50:43 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:50:43 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:50:43 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 31 14:50:43 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815043.3473423, 2f11022e-a007-4d4c-adc1-b54ea59b9e6a => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:50:43 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] VM Started (Lifecycle Event)
Jul 31 14:50:43 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:50:43 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:50:43 user nova-compute[72239]: INFO nova.compute.manager [None req-0f10b1c9-cae9-44ab-b405-b8165f119ded tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Unrescuing
Jul 31 14:50:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0f10b1c9-cae9-44ab-b405-b8165f119ded tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "refresh_cache-7d81b881-b44e-4fb3-8245-9dea634bdec9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:50:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0f10b1c9-cae9-44ab-b405-b8165f119ded tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquired lock "refresh_cache-7d81b881-b44e-4fb3-8245-9dea634bdec9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:50:43 user nova-compute[72239]: DEBUG nova.network.neutron [None req-0f10b1c9-cae9-44ab-b405-b8165f119ded tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:50:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-806f43a6-588b-437e-a89b-2fb88cb55068 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Acquiring lock "97917500-bc78-433b-8d3d-181ed13667dc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-806f43a6-588b-437e-a89b-2fb88cb55068 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lock "97917500-bc78-433b-8d3d-181ed13667dc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:44 user nova-compute[72239]: INFO nova.compute.manager [None req-806f43a6-588b-437e-a89b-2fb88cb55068 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Detaching volume 8aa94ef5-0195-46eb-875d-acb827d145a9
Jul 31 14:50:44 user nova-compute[72239]: INFO nova.virt.block_device [None req-806f43a6-588b-437e-a89b-2fb88cb55068 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Attempting to driver detach volume 8aa94ef5-0195-46eb-875d-acb827d145a9 from mountpoint /dev/vdb
Jul 31 14:50:44 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-806f43a6-588b-437e-a89b-2fb88cb55068 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Attempting to detach device vdb from instance 97917500-bc78-433b-8d3d-181ed13667dc from the persistent domain config. {{(pid=72239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 14:50:44 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-806f43a6-588b-437e-a89b-2fb88cb55068 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 14:50:44 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:50:44 user nova-compute[72239]:   <source dev="/dev/sdc"/>
Jul 31 14:50:44 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:50:44 user nova-compute[72239]:   <serial>8aa94ef5-0195-46eb-875d-acb827d145a9</serial>
Jul 31 14:50:44 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 14:50:44 user nova-compute[72239]: </disk>
Jul 31 14:50:44 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 14:50:44 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-806f43a6-588b-437e-a89b-2fb88cb55068 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Successfully detached device vdb from instance 97917500-bc78-433b-8d3d-181ed13667dc from the persistent domain config.
Jul 31 14:50:44 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-806f43a6-588b-437e-a89b-2fb88cb55068 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 97917500-bc78-433b-8d3d-181ed13667dc from the live domain config. {{(pid=72239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 14:50:44 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-806f43a6-588b-437e-a89b-2fb88cb55068 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 14:50:44 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:50:44 user nova-compute[72239]:   <source dev="/dev/sdc"/>
Jul 31 14:50:44 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:50:44 user nova-compute[72239]:   <serial>8aa94ef5-0195-46eb-875d-acb827d145a9</serial>
Jul 31 14:50:44 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 14:50:44 user nova-compute[72239]: </disk>
Jul 31 14:50:44 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 14:50:44 user nova-compute[72239]: DEBUG nova.network.neutron [None req-0f10b1c9-cae9-44ab-b405-b8165f119ded tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Updating instance_info_cache with network_info: [{"id": "60f70f18-4024-4388-ae64-3c2cca0cafbc", "address": "fa:16:3e:a5:de:4b", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f70f18-40", "ovs_interfaceid": "60f70f18-4024-4388-ae64-3c2cca0cafbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:50:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0f10b1c9-cae9-44ab-b405-b8165f119ded tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Releasing lock "refresh_cache-7d81b881-b44e-4fb3-8245-9dea634bdec9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:50:44 user nova-compute[72239]: DEBUG nova.objects.instance [None req-0f10b1c9-cae9-44ab-b405-b8165f119ded tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lazy-loading 'flavor' on Instance uuid 7d81b881-b44e-4fb3-8245-9dea634bdec9 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Received event <DeviceRemovedEvent: 1690815045.2983646, 97917500-bc78-433b-8d3d-181ed13667dc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72239) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-806f43a6-588b-437e-a89b-2fb88cb55068 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 97917500-bc78-433b-8d3d-181ed13667dc {{(pid=72239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 14:50:45 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-806f43a6-588b-437e-a89b-2fb88cb55068 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Successfully detached device vdb from instance 97917500-bc78-433b-8d3d-181ed13667dc from the live domain config.
Jul 31 14:50:45 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-806f43a6-588b-437e-a89b-2fb88cb55068 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-806f43a6-588b-437e-a89b-2fb88cb55068 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vluiLoTm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:50:45 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-806f43a6-588b-437e-a89b-2fb88cb55068 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:50:45 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-806f43a6-588b-437e-a89b-2fb88cb55068 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-806f43a6-588b-437e-a89b-2fb88cb55068 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-806f43a6-588b-437e-a89b-2fb88cb55068 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4898e9-806a-415d-af50-17f00c6f7109]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG nova.compute.manager [req-711528f4-ab8e-44b6-ae83-897bf2a123fc req-f8122cf2-0855-4876-a9b6-50bae2f0beef service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received event network-vif-unplugged-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-711528f4-ab8e-44b6-ae83-897bf2a123fc req-f8122cf2-0855-4876-a9b6-50bae2f0beef service nova] Acquiring lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-711528f4-ab8e-44b6-ae83-897bf2a123fc req-f8122cf2-0855-4876-a9b6-50bae2f0beef service nova] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-711528f4-ab8e-44b6-ae83-897bf2a123fc req-f8122cf2-0855-4876-a9b6-50bae2f0beef service nova] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG nova.compute.manager [req-711528f4-ab8e-44b6-ae83-897bf2a123fc req-f8122cf2-0855-4876-a9b6-50bae2f0beef service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] No waiting events found dispatching network-vif-unplugged-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:50:45 user nova-compute[72239]: WARNING nova.compute.manager [req-711528f4-ab8e-44b6-ae83-897bf2a123fc req-f8122cf2-0855-4876-a9b6-50bae2f0beef service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received unexpected event network-vif-unplugged-60f70f18-4024-4388-ae64-3c2cca0cafbc for instance with vm_state rescued and task_state unrescuing.
Jul 31 14:50:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab009cab-95da-4638-8471-70708b55ab4a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-806f43a6-588b-437e-a89b-2fb88cb55068 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:50:45 user nova-compute[72239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)
Jul 31 14:50:45 user nova-compute[72239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:50:45 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-806f43a6-588b-437e-a89b-2fb88cb55068 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:50:45 user nova-compute[72239]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 (non-flash)
Jul 31 14:50:45 user nova-compute[72239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:50:45 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-806f43a6-588b-437e-a89b-2fb88cb55068 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4120449990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9'): ({'sdc'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-806f43a6-588b-437e-a89b-2fb88cb55068 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Removing single pathed devices sdc {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[23862cdb-d5fc-46c0-8ddc-611f91aeda84]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.034s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf23fbd3-8c7a-4c26-8f02-c2f7447f1b19]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-806f43a6-588b-437e-a89b-2fb88cb55068 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Flushing IO for device /dev/sdc {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[27879657-458e-467d-b7d7-523b1982e980]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-806f43a6-588b-437e-a89b-2fb88cb55068 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[648dfe99-60a1-4e03-99e6-82d4b5daf9c1]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-806f43a6-588b-437e-a89b-2fb88cb55068 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-806f43a6-588b-437e-a89b-2fb88cb55068 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] SCSI volumes sdc have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-806f43a6-588b-437e-a89b-2fb88cb55068 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b347abbb-8a0b-4801-8a43-cca1e211905c]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-806f43a6-588b-437e-a89b-2fb88cb55068 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc6cf86-f720-41ff-a4c8-eabef508ff44]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-806f43a6-588b-437e-a89b-2fb88cb55068 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9, portal: 172.16.0.220,3260]
Jul 31 14:50:45 user nova-compute[72239]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9, portal: 172.16.0.220,3260] successful.
Jul 31 14:50:45 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8aa94ef5-0195-46eb-875d-acb827d145a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de71682-d4cf-44a0-b477-3d4a2e72239e]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-806f43a6-588b-437e-a89b-2fb88cb55068 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-806f43a6-588b-437e-a89b-2fb88cb55068 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-806f43a6-588b-437e-a89b-2fb88cb55068 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] <== disconnect_volume: return (364ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-806f43a6-588b-437e-a89b-2fb88cb55068 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:45 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Instance destroyed successfully.
Jul 31 14:50:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:46 user nova-compute[72239]: DEBUG nova.objects.instance [None req-806f43a6-588b-437e-a89b-2fb88cb55068 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lazy-loading 'flavor' on Instance uuid 97917500-bc78-433b-8d3d-181ed13667dc {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:50:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-806f43a6-588b-437e-a89b-2fb88cb55068 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lock "97917500-bc78-433b-8d3d-181ed13667dc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.030s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:47 user nova-compute[72239]: DEBUG nova.compute.manager [req-d7f19b20-870f-4c05-8f13-69c4e3cc7f2f req-764ff38b-3779-43bf-b2c8-eaaada510128 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received event network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:50:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d7f19b20-870f-4c05-8f13-69c4e3cc7f2f req-764ff38b-3779-43bf-b2c8-eaaada510128 service nova] Acquiring lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d7f19b20-870f-4c05-8f13-69c4e3cc7f2f req-764ff38b-3779-43bf-b2c8-eaaada510128 service nova] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d7f19b20-870f-4c05-8f13-69c4e3cc7f2f req-764ff38b-3779-43bf-b2c8-eaaada510128 service nova] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:47 user nova-compute[72239]: DEBUG nova.compute.manager [req-d7f19b20-870f-4c05-8f13-69c4e3cc7f2f req-764ff38b-3779-43bf-b2c8-eaaada510128 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] No waiting events found dispatching network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:50:47 user nova-compute[72239]: WARNING nova.compute.manager [req-d7f19b20-870f-4c05-8f13-69c4e3cc7f2f req-764ff38b-3779-43bf-b2c8-eaaada510128 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received unexpected event network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc for instance with vm_state rescued and task_state unrescuing.
Jul 31 14:50:47 user nova-compute[72239]: DEBUG nova.compute.manager [req-d7f19b20-870f-4c05-8f13-69c4e3cc7f2f req-764ff38b-3779-43bf-b2c8-eaaada510128 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received event network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:50:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d7f19b20-870f-4c05-8f13-69c4e3cc7f2f req-764ff38b-3779-43bf-b2c8-eaaada510128 service nova] Acquiring lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d7f19b20-870f-4c05-8f13-69c4e3cc7f2f req-764ff38b-3779-43bf-b2c8-eaaada510128 service nova] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d7f19b20-870f-4c05-8f13-69c4e3cc7f2f req-764ff38b-3779-43bf-b2c8-eaaada510128 service nova] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:47 user nova-compute[72239]: DEBUG nova.compute.manager [req-d7f19b20-870f-4c05-8f13-69c4e3cc7f2f req-764ff38b-3779-43bf-b2c8-eaaada510128 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] No waiting events found dispatching network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:50:47 user nova-compute[72239]: WARNING nova.compute.manager [req-d7f19b20-870f-4c05-8f13-69c4e3cc7f2f req-764ff38b-3779-43bf-b2c8-eaaada510128 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received unexpected event network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc for instance with vm_state rescued and task_state unrescuing.
Jul 31 14:50:47 user nova-compute[72239]: DEBUG nova.compute.manager [req-d7f19b20-870f-4c05-8f13-69c4e3cc7f2f req-764ff38b-3779-43bf-b2c8-eaaada510128 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received event network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:50:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d7f19b20-870f-4c05-8f13-69c4e3cc7f2f req-764ff38b-3779-43bf-b2c8-eaaada510128 service nova] Acquiring lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d7f19b20-870f-4c05-8f13-69c4e3cc7f2f req-764ff38b-3779-43bf-b2c8-eaaada510128 service nova] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d7f19b20-870f-4c05-8f13-69c4e3cc7f2f req-764ff38b-3779-43bf-b2c8-eaaada510128 service nova] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:47 user nova-compute[72239]: DEBUG nova.compute.manager [req-d7f19b20-870f-4c05-8f13-69c4e3cc7f2f req-764ff38b-3779-43bf-b2c8-eaaada510128 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] No waiting events found dispatching network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:50:47 user nova-compute[72239]: WARNING nova.compute.manager [req-d7f19b20-870f-4c05-8f13-69c4e3cc7f2f req-764ff38b-3779-43bf-b2c8-eaaada510128 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received unexpected event network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc for instance with vm_state rescued and task_state unrescuing.
Jul 31 14:50:47 user nova-compute[72239]: DEBUG nova.compute.manager [req-d7f19b20-870f-4c05-8f13-69c4e3cc7f2f req-764ff38b-3779-43bf-b2c8-eaaada510128 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received event network-vif-unplugged-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:50:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d7f19b20-870f-4c05-8f13-69c4e3cc7f2f req-764ff38b-3779-43bf-b2c8-eaaada510128 service nova] Acquiring lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d7f19b20-870f-4c05-8f13-69c4e3cc7f2f req-764ff38b-3779-43bf-b2c8-eaaada510128 service nova] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d7f19b20-870f-4c05-8f13-69c4e3cc7f2f req-764ff38b-3779-43bf-b2c8-eaaada510128 service nova] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:47 user nova-compute[72239]: DEBUG nova.compute.manager [req-d7f19b20-870f-4c05-8f13-69c4e3cc7f2f req-764ff38b-3779-43bf-b2c8-eaaada510128 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] No waiting events found dispatching network-vif-unplugged-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:50:47 user nova-compute[72239]: WARNING nova.compute.manager [req-d7f19b20-870f-4c05-8f13-69c4e3cc7f2f req-764ff38b-3779-43bf-b2c8-eaaada510128 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received unexpected event network-vif-unplugged-60f70f18-4024-4388-ae64-3c2cca0cafbc for instance with vm_state rescued and task_state unrescuing.
Jul 31 14:50:47 user nova-compute[72239]: DEBUG nova.compute.manager [req-d7f19b20-870f-4c05-8f13-69c4e3cc7f2f req-764ff38b-3779-43bf-b2c8-eaaada510128 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received event network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:50:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d7f19b20-870f-4c05-8f13-69c4e3cc7f2f req-764ff38b-3779-43bf-b2c8-eaaada510128 service nova] Acquiring lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d7f19b20-870f-4c05-8f13-69c4e3cc7f2f req-764ff38b-3779-43bf-b2c8-eaaada510128 service nova] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d7f19b20-870f-4c05-8f13-69c4e3cc7f2f req-764ff38b-3779-43bf-b2c8-eaaada510128 service nova] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:47 user nova-compute[72239]: DEBUG nova.compute.manager [req-d7f19b20-870f-4c05-8f13-69c4e3cc7f2f req-764ff38b-3779-43bf-b2c8-eaaada510128 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] No waiting events found dispatching network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:50:47 user nova-compute[72239]: WARNING nova.compute.manager [req-d7f19b20-870f-4c05-8f13-69c4e3cc7f2f req-764ff38b-3779-43bf-b2c8-eaaada510128 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received unexpected event network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc for instance with vm_state rescued and task_state unrescuing.
Jul 31 14:50:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:49 user nova-compute[72239]: DEBUG nova.compute.manager [req-2e27f16f-f5bc-4090-8778-1e9fdb45658a req-15f195d1-cdd9-4a84-91ea-d370521eb2d7 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received event network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:50:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-2e27f16f-f5bc-4090-8778-1e9fdb45658a req-15f195d1-cdd9-4a84-91ea-d370521eb2d7 service nova] Acquiring lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-2e27f16f-f5bc-4090-8778-1e9fdb45658a req-15f195d1-cdd9-4a84-91ea-d370521eb2d7 service nova] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-2e27f16f-f5bc-4090-8778-1e9fdb45658a req-15f195d1-cdd9-4a84-91ea-d370521eb2d7 service nova] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:49 user nova-compute[72239]: DEBUG nova.compute.manager [req-2e27f16f-f5bc-4090-8778-1e9fdb45658a req-15f195d1-cdd9-4a84-91ea-d370521eb2d7 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] No waiting events found dispatching network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:50:49 user nova-compute[72239]: WARNING nova.compute.manager [req-2e27f16f-f5bc-4090-8778-1e9fdb45658a req-15f195d1-cdd9-4a84-91ea-d370521eb2d7 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received unexpected event network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc for instance with vm_state rescued and task_state unrescuing.
Jul 31 14:50:49 user nova-compute[72239]: DEBUG nova.compute.manager [req-2e27f16f-f5bc-4090-8778-1e9fdb45658a req-15f195d1-cdd9-4a84-91ea-d370521eb2d7 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received event network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:50:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-2e27f16f-f5bc-4090-8778-1e9fdb45658a req-15f195d1-cdd9-4a84-91ea-d370521eb2d7 service nova] Acquiring lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:50:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-2e27f16f-f5bc-4090-8778-1e9fdb45658a req-15f195d1-cdd9-4a84-91ea-d370521eb2d7 service nova] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:50:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-2e27f16f-f5bc-4090-8778-1e9fdb45658a req-15f195d1-cdd9-4a84-91ea-d370521eb2d7 service nova] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:50:49 user nova-compute[72239]: DEBUG nova.compute.manager [req-2e27f16f-f5bc-4090-8778-1e9fdb45658a req-15f195d1-cdd9-4a84-91ea-d370521eb2d7 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] No waiting events found dispatching network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:50:49 user nova-compute[72239]: WARNING nova.compute.manager [req-2e27f16f-f5bc-4090-8778-1e9fdb45658a req-15f195d1-cdd9-4a84-91ea-d370521eb2d7 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received unexpected event network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc for instance with vm_state rescued and task_state unrescuing.
Jul 31 14:50:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Removed pending event for 7d81b881-b44e-4fb3-8245-9dea634bdec9 due to event {{(pid=72239) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 14:50:49 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815049.776713, 7d81b881-b44e-4fb3-8245-9dea634bdec9 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:50:49 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] VM Resumed (Lifecycle Event)
Jul 31 14:50:49 user nova-compute[72239]: DEBUG nova.compute.manager [None req-0f10b1c9-cae9-44ab-b405-b8165f119ded tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:50:49 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:50:49 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:50:49 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 31 14:50:49 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815049.779581, 7d81b881-b44e-4fb3-8245-9dea634bdec9 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:50:49 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] VM Started (Lifecycle Event)
Jul 31 14:50:49 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:50:49 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:50:51 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690815036.476723, 62122879-2a72-4ddf-a028-317eda0da465 => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:50:51 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 62122879-2a72-4ddf-a028-317eda0da465] VM Stopped (Lifecycle Event)
Jul 31 14:50:51 user nova-compute[72239]: DEBUG nova.compute.manager [None req-fd9f85e0-3438-49b6-a2fd-5c8317b83b8c None None] [instance: 62122879-2a72-4ddf-a028-317eda0da465] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:50:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:52 user nova-compute[72239]: DEBUG nova.compute.manager [req-d2f94c92-5077-456b-81d1-ab6d3c37cfb3 req-dbe2fa82-7651-4535-81d6-39c9fc8e2bf7 service nova] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Received event network-changed-8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:50:52 user nova-compute[72239]: DEBUG nova.compute.manager [req-d2f94c92-5077-456b-81d1-ab6d3c37cfb3 req-dbe2fa82-7651-4535-81d6-39c9fc8e2bf7 service nova] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Refreshing instance network info cache due to event network-changed-8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:50:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d2f94c92-5077-456b-81d1-ab6d3c37cfb3 req-dbe2fa82-7651-4535-81d6-39c9fc8e2bf7 service nova] Acquiring lock "refresh_cache-c10918e9-9731-48ea-860e-8a02cb6a0ad9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:50:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d2f94c92-5077-456b-81d1-ab6d3c37cfb3 req-dbe2fa82-7651-4535-81d6-39c9fc8e2bf7 service nova] Acquired lock "refresh_cache-c10918e9-9731-48ea-860e-8a02cb6a0ad9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:50:52 user nova-compute[72239]: DEBUG nova.network.neutron [req-d2f94c92-5077-456b-81d1-ab6d3c37cfb3 req-dbe2fa82-7651-4535-81d6-39c9fc8e2bf7 service nova] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Refreshing network info cache for port 8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:50:52 user nova-compute[72239]: DEBUG nova.network.neutron [req-d2f94c92-5077-456b-81d1-ab6d3c37cfb3 req-dbe2fa82-7651-4535-81d6-39c9fc8e2bf7 service nova] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Updated VIF entry in instance network info cache for port 8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:50:52 user nova-compute[72239]: DEBUG nova.network.neutron [req-d2f94c92-5077-456b-81d1-ab6d3c37cfb3 req-dbe2fa82-7651-4535-81d6-39c9fc8e2bf7 service nova] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Updating instance_info_cache with network_info: [{"id": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "address": "fa:16:3e:56:1c:d6", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8307e7-0d", "ovs_interfaceid": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:50:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d2f94c92-5077-456b-81d1-ab6d3c37cfb3 req-dbe2fa82-7651-4535-81d6-39c9fc8e2bf7 service nova] Releasing lock "refresh_cache-c10918e9-9731-48ea-860e-8a02cb6a0ad9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:50:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:55 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:50:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:58 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:50:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:50:59 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:51:00 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:51:00 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 14:51:00 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Didn't find any instances for network info cache update. {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 14:51:01 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:51:01 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:51:01 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 14:51:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:02 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:51:02 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:51:02 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:51:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:51:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:51:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:51:02 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 14:51:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:02 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:51:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json" returned: 0 in 0.127s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json" returned: 0 in 0.128s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:03 user nova-compute[72239]: DEBUG nova.compute.manager [req-007e87a8-78f1-401b-afcd-a2faa16e6a75 req-d79e7d75-c717-4e75-b2f7-858abb8659d0 service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Received event network-changed-4a60ced2-5c35-4f83-9734-e812bce6fad2 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:51:03 user nova-compute[72239]: DEBUG nova.compute.manager [req-007e87a8-78f1-401b-afcd-a2faa16e6a75 req-d79e7d75-c717-4e75-b2f7-858abb8659d0 service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Refreshing instance network info cache due to event network-changed-4a60ced2-5c35-4f83-9734-e812bce6fad2. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:51:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-007e87a8-78f1-401b-afcd-a2faa16e6a75 req-d79e7d75-c717-4e75-b2f7-858abb8659d0 service nova] Acquiring lock "refresh_cache-db15ad45-8f28-4e0c-8d7e-7db75f33fe92" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:51:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-007e87a8-78f1-401b-afcd-a2faa16e6a75 req-d79e7d75-c717-4e75-b2f7-858abb8659d0 service nova] Acquired lock "refresh_cache-db15ad45-8f28-4e0c-8d7e-7db75f33fe92" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:51:03 user nova-compute[72239]: DEBUG nova.network.neutron [req-007e87a8-78f1-401b-afcd-a2faa16e6a75 req-d79e7d75-c717-4e75-b2f7-858abb8659d0 service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Refreshing network info cache for port 4a60ced2-5c35-4f83-9734-e812bce6fad2 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:51:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:04 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:51:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:04 user nova-compute[72239]: DEBUG nova.network.neutron [req-007e87a8-78f1-401b-afcd-a2faa16e6a75 req-d79e7d75-c717-4e75-b2f7-858abb8659d0 service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Updated VIF entry in instance network info cache for port 4a60ced2-5c35-4f83-9734-e812bce6fad2. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:51:04 user nova-compute[72239]: DEBUG nova.network.neutron [req-007e87a8-78f1-401b-afcd-a2faa16e6a75 req-d79e7d75-c717-4e75-b2f7-858abb8659d0 service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Updating instance_info_cache with network_info: [{"id": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "address": "fa:16:3e:55:1a:9a", "network": {"id": "50e01a2d-5e91-4aca-a74c-7687f91ed21e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-937098047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e5e2cd6854f0985aa161b1e8a6db7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a60ced2-5c", "ovs_interfaceid": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:51:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-007e87a8-78f1-401b-afcd-a2faa16e6a75 req-d79e7d75-c717-4e75-b2f7-858abb8659d0 service nova] Releasing lock "refresh_cache-db15ad45-8f28-4e0c-8d7e-7db75f33fe92" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:51:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e626a09-1282-4864-8336-6720c7caa0da/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e626a09-1282-4864-8336-6720c7caa0da/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e626a09-1282-4864-8336-6720c7caa0da/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1e626a09-1282-4864-8336-6720c7caa0da/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2393ac0e-4b6c-429e-a73e-a395e79031e0/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2393ac0e-4b6c-429e-a73e-a395e79031e0/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2393ac0e-4b6c-429e-a73e-a395e79031e0/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2393ac0e-4b6c-429e-a73e-a395e79031e0/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:06 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:06 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:51:06 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:51:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=7121MB free_disk=25.20767593383789GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 14:51:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:51:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:51:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 20abf743-de5b-4122-aad0-e2124c7804b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:51:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 7d81b881-b44e-4fb3-8245-9dea634bdec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:51:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 079a5ed7-ee25-495b-a2a4-924d830a670a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:51:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 97917500-bc78-433b-8d3d-181ed13667dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:51:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 82116af8-3702-401b-8d00-9291d4caeb03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:51:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 2f11022e-a007-4d4c-adc1-b54ea59b9e6a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:51:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance d3e3612b-c6b9-4308-a45a-1ff3805e18bb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:51:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance c10918e9-9731-48ea-860e-8a02cb6a0ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:51:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance db15ad45-8f28-4e0c-8d7e-7db75f33fe92 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:51:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 1e626a09-1282-4864-8336-6720c7caa0da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:51:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 2393ac0e-4b6c-429e-a73e-a395e79031e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:51:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 14:51:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 14:51:07 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:51:07 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:51:07 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 14:51:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.506s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:51:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:51:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:51:07 user nova-compute[72239]: DEBUG nova.objects.instance [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lazy-loading 'flavor' on Instance uuid db15ad45-8f28-4e0c-8d7e-7db75f33fe92 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:51:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:51:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:51:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:51:08 user nova-compute[72239]: INFO nova.compute.manager [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Attaching volume 96e3e2e1-1942-4ccc-ad2c-33aa63817e79 to /dev/vdb
Jul 31 14:51:08 user nova-compute[72239]: DEBUG os_brick.utils [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:51:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:08 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[145d438e-b115-48c4-abb9-d9ab0b107528]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:08 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a06bf8-f353-433d-82a8-8db6dcaad9b2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:08 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c0125f-7e94-429a-a760-48776807b1ea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:08 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[265723fa-9a72-42e7-80ca-5e04550eed53]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:51:08 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 14:51:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:51:08 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 14:51:08 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d44b47a-b75a-4603-81f8-d2a8a72cdcb5]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:08 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 14:51:08 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 14:51:08 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 14:51:08 user nova-compute[72239]: DEBUG os_brick.utils [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:51:08 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Updating existing volume attachment record: 8310b4a7-b965-40fb-9a7c-9b5a05218be0 {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 14:51:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:14 user nova-compute[72239]: DEBUG nova.compute.manager [req-a8b21ba8-393d-4daa-891a-adb42f058d4c req-d685662a-6003-4d2d-9d93-58fc4514a412 service nova] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Received event network-changed-ccc3c5f4-a0e1-4844-a193-b56945bf71a2 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:51:14 user nova-compute[72239]: DEBUG nova.compute.manager [req-a8b21ba8-393d-4daa-891a-adb42f058d4c req-d685662a-6003-4d2d-9d93-58fc4514a412 service nova] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Refreshing instance network info cache due to event network-changed-ccc3c5f4-a0e1-4844-a193-b56945bf71a2. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:51:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a8b21ba8-393d-4daa-891a-adb42f058d4c req-d685662a-6003-4d2d-9d93-58fc4514a412 service nova] Acquiring lock "refresh_cache-1e626a09-1282-4864-8336-6720c7caa0da" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:51:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a8b21ba8-393d-4daa-891a-adb42f058d4c req-d685662a-6003-4d2d-9d93-58fc4514a412 service nova] Acquired lock "refresh_cache-1e626a09-1282-4864-8336-6720c7caa0da" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:51:14 user nova-compute[72239]: DEBUG nova.network.neutron [req-a8b21ba8-393d-4daa-891a-adb42f058d4c req-d685662a-6003-4d2d-9d93-58fc4514a412 service nova] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Refreshing network info cache for port ccc3c5f4-a0e1-4844-a193-b56945bf71a2 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:51:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Acquiring lock "1e626a09-1282-4864-8336-6720c7caa0da" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:51:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "1e626a09-1282-4864-8336-6720c7caa0da" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:51:14 user nova-compute[72239]: DEBUG nova.objects.instance [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lazy-loading 'flavor' on Instance uuid 1e626a09-1282-4864-8336-6720c7caa0da {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:51:14 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Ignoring supplied device name: /dev/vdb
Jul 31 14:51:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "1e626a09-1282-4864-8336-6720c7caa0da" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:51:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Acquiring lock "1e626a09-1282-4864-8336-6720c7caa0da" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:51:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "1e626a09-1282-4864-8336-6720c7caa0da" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:51:14 user nova-compute[72239]: INFO nova.compute.manager [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Attaching volume 1481c0b0-8805-493e-8d9c-2ce632bc1339 to /dev/vdb
Jul 31 14:51:14 user nova-compute[72239]: DEBUG os_brick.utils [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:51:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[71026f49-3715-4ac4-9cc9-5ef6d814452d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:14 user nova-compute[72239]: DEBUG nova.network.neutron [req-a8b21ba8-393d-4daa-891a-adb42f058d4c req-d685662a-6003-4d2d-9d93-58fc4514a412 service nova] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Updated VIF entry in instance network info cache for port ccc3c5f4-a0e1-4844-a193-b56945bf71a2. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:51:14 user nova-compute[72239]: DEBUG nova.network.neutron [req-a8b21ba8-393d-4daa-891a-adb42f058d4c req-d685662a-6003-4d2d-9d93-58fc4514a412 service nova] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Updating instance_info_cache with network_info: [{"id": "ccc3c5f4-a0e1-4844-a193-b56945bf71a2", "address": "fa:16:3e:18:b6:8f", "network": {"id": "807530ad-b1c8-4426-9036-a796ba7dee91", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-277511856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d888450f903d41c5b6fde5de0b513a84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccc3c5f4-a0", "ovs_interfaceid": "ccc3c5f4-a0e1-4844-a193-b56945bf71a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:51:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f80e83-38ca-442c-b6ee-f47afab11e69]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a8b21ba8-393d-4daa-891a-adb42f058d4c req-d685662a-6003-4d2d-9d93-58fc4514a412 service nova] Releasing lock "refresh_cache-1e626a09-1282-4864-8336-6720c7caa0da" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:51:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9963f3-b2cd-4a99-8208-41249ae2223c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a1a49a-5c43-4621-b2bf-fc9c626df7f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:51:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 14:51:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:51:14 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 14:51:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3235b5ca-62b1-43c2-bdb2-f9a501ee2cb7]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 14:51:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 14:51:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 14:51:14 user nova-compute[72239]: DEBUG os_brick.utils [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:51:14 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Updating existing volume attachment record: db4df2d6-756c-4007-8219-c5f066a12fc1 {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYFEHIBJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:51:15 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:51:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:51:15 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:51:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:51:15 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 14:51:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ed8d19-e157-4bb7-a45b-eb32bb7a63e5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 14:51:15 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf0c027-070e-4330-af3e-d7903d455fb9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79] added
Jul 31 14:51:15 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c637286-7c64-4d21-aae2-d8bf7deea72e]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a682eb-6fde-4db6-950b-5eed20414ac0]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UYFEHIBJ {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UYFEHIBJ" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce92ed33-f74f-42a8-9d05-61fd5627ed6f]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UYFEHIBJ'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[89779361-3886-4794-9ab9-fde60950f351]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3181ed15-260f-4422-af34-a374dc476b51]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:51:15 user nova-compute[72239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:51:15 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:51:15 user nova-compute[72239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:51:15 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee08306-4aec-4288-af02-3b7d079bfa44]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79, portal: 172.16.0.220,3260]
Jul 31 14:51:15 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79, portal: 172.16.0.220,3260] successful.
Jul 31 14:51:15 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[585b7e02-05ea-47f9-998c-921632c0ad26]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12e9b5d-ff6a-451e-bce4-b8fad1d20e9d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:51:15 user nova-compute[72239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:51:15 user nova-compute[72239]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:51:15 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:51:15 user nova-compute[72239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:51:15 user nova-compute[72239]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:51:15 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[465e9334-e1d2-4137-a449-3324b648e7bb]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:51:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYFEHIBJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 14:51:16 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:51:16 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '26338313637336362', 'path': '/dev/sdc'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:51:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338313637336362', 'path': '/dev/sdc'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 14:51:16 user nova-compute[72239]: DEBUG nova.objects.instance [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lazy-loading 'flavor' on Instance uuid db15ad45-8f28-4e0c-8d7e-7db75f33fe92 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:51:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 14:51:16 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:51:16 user nova-compute[72239]:   <source dev="/dev/sdc"/>
Jul 31 14:51:16 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:51:16 user nova-compute[72239]:   <serial>96e3e2e1-1942-4ccc-ad2c-33aa63817e79</serial>
Jul 31 14:51:16 user nova-compute[72239]: </disk>
Jul 31 14:51:16 user nova-compute[72239]:  {{(pid=72239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 14:51:16 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:51:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:51:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] No VIF found with MAC fa:16:3e:55:1a:9a, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:51:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-051bcfca-9d8b-4de2-8fcc-4e5cad26a767 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.187s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:51:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-253b92c9-f9b9-472c-a0c3-8b185b619b2a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:51:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-253b92c9-f9b9-472c-a0c3-8b185b619b2a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:51:17 user nova-compute[72239]: DEBUG nova.compute.manager [None req-253b92c9-f9b9-472c-a0c3-8b185b619b2a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:51:17 user nova-compute[72239]: DEBUG nova.compute.manager [None req-253b92c9-f9b9-472c-a0c3-8b185b619b2a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72239) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Jul 31 14:51:17 user nova-compute[72239]: DEBUG nova.objects.instance [None req-253b92c9-f9b9-472c-a0c3-8b185b619b2a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lazy-loading 'flavor' on Instance uuid db15ad45-8f28-4e0c-8d7e-7db75f33fe92 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:51:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:18 user nova-compute[72239]: DEBUG nova.compute.manager [req-af20d680-c21c-420a-9078-5f473b12337d req-10c33ae4-c929-402c-a3b8-fe6f2c6aefb5 service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Received event network-vif-unplugged-4a60ced2-5c35-4f83-9734-e812bce6fad2 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:51:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-af20d680-c21c-420a-9078-5f473b12337d req-10c33ae4-c929-402c-a3b8-fe6f2c6aefb5 service nova] Acquiring lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:51:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-af20d680-c21c-420a-9078-5f473b12337d req-10c33ae4-c929-402c-a3b8-fe6f2c6aefb5 service nova] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:51:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-af20d680-c21c-420a-9078-5f473b12337d req-10c33ae4-c929-402c-a3b8-fe6f2c6aefb5 service nova] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:51:18 user nova-compute[72239]: DEBUG nova.compute.manager [req-af20d680-c21c-420a-9078-5f473b12337d req-10c33ae4-c929-402c-a3b8-fe6f2c6aefb5 service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] No waiting events found dispatching network-vif-unplugged-4a60ced2-5c35-4f83-9734-e812bce6fad2 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:51:18 user nova-compute[72239]: WARNING nova.compute.manager [req-af20d680-c21c-420a-9078-5f473b12337d req-10c33ae4-c929-402c-a3b8-fe6f2c6aefb5 service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Received unexpected event network-vif-unplugged-4a60ced2-5c35-4f83-9734-e812bce6fad2 for instance with vm_state active and task_state powering-off.
Jul 31 14:51:18 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Instance destroyed successfully.
Jul 31 14:51:18 user nova-compute[72239]: DEBUG nova.compute.manager [None req-253b92c9-f9b9-472c-a0c3-8b185b619b2a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:51:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-253b92c9-f9b9-472c-a0c3-8b185b619b2a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.905s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:51:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:20 user nova-compute[72239]: DEBUG nova.compute.manager [req-db8417e0-d363-42ee-afb8-456fa89cad3b req-66b356a9-a814-484c-9618-cb5e0bf8d5ae service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Received event network-vif-plugged-4a60ced2-5c35-4f83-9734-e812bce6fad2 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:51:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-db8417e0-d363-42ee-afb8-456fa89cad3b req-66b356a9-a814-484c-9618-cb5e0bf8d5ae service nova] Acquiring lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:51:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-db8417e0-d363-42ee-afb8-456fa89cad3b req-66b356a9-a814-484c-9618-cb5e0bf8d5ae service nova] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:51:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-db8417e0-d363-42ee-afb8-456fa89cad3b req-66b356a9-a814-484c-9618-cb5e0bf8d5ae service nova] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:51:20 user nova-compute[72239]: DEBUG nova.compute.manager [req-db8417e0-d363-42ee-afb8-456fa89cad3b req-66b356a9-a814-484c-9618-cb5e0bf8d5ae service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] No waiting events found dispatching network-vif-plugged-4a60ced2-5c35-4f83-9734-e812bce6fad2 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:51:20 user nova-compute[72239]: WARNING nova.compute.manager [req-db8417e0-d363-42ee-afb8-456fa89cad3b req-66b356a9-a814-484c-9618-cb5e0bf8d5ae service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Received unexpected event network-vif-plugged-4a60ced2-5c35-4f83-9734-e812bce6fad2 for instance with vm_state stopped and task_state None.
Jul 31 14:51:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Acquiring lock "82116af8-3702-401b-8d00-9291d4caeb03" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:51:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "82116af8-3702-401b-8d00-9291d4caeb03" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:51:20 user nova-compute[72239]: DEBUG nova.objects.instance [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lazy-loading 'flavor' on Instance uuid 82116af8-3702-401b-8d00-9291d4caeb03 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:51:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "82116af8-3702-401b-8d00-9291d4caeb03" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:51:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Acquiring lock "82116af8-3702-401b-8d00-9291d4caeb03" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:51:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "82116af8-3702-401b-8d00-9291d4caeb03" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:51:20 user nova-compute[72239]: INFO nova.compute.manager [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Attaching volume e6d10baf-cc41-48ed-893f-f2a7a8a626fd to /dev/vdb
Jul 31 14:51:20 user nova-compute[72239]: DEBUG os_brick.utils [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:51:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:20 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf074ca-1bb9-4d1b-b845-99b8204b7923]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:20 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[67778bbd-706f-45cb-a52e-55c21c06443f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:20 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3beef6df-e1d8-424d-b4b7-4ea087cff5e3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:20 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea903620-3144-43c8-9416-a2e16d5152ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:51:20 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 14:51:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:51:20 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 14:51:20 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8863f9-9b33-4be5-b35f-2f44bc14504d]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:20 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 14:51:20 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 14:51:20 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 14:51:20 user nova-compute[72239]: DEBUG os_brick.utils [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:51:20 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Updating existing volume attachment record: 0eee0e3a-ead1-4520-8b12-a55f100d40ba {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 14:51:21 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dHQUFkNE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:51:22 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:51:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:51:22 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:51:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:51:22 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 14:51:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339 -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80541e3-c43a-4d9b-92a7-597448e8b07a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 14:51:22 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339 -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6055c279-f59d-4cc7-9e72-f2edc192abe9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339] added
Jul 31 14:51:22 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb63cab-69d8-41ef-81d3-447f1c476a20]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[53852d33-8c65-4d40-8400-81cd29645b87]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dHQUFkNE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dHQUFkNE" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4d1869-8db5-4c25-bf2e-5519e7e4fb28]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dHQUFkNE'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e458d49-cff5-4389-8a07-ceab1399f0f4]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b21d5a73-73f7-4442-a54d-15fbeba3bc64]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:51:22 user nova-compute[72239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:51:22 user nova-compute[72239]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:51:22 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:51:22 user nova-compute[72239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:51:22 user nova-compute[72239]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:51:22 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339 -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8e0263-c093-41e5-824c-1bf303c4479c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339, portal: 172.16.0.220,3260]
Jul 31 14:51:22 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339, portal: 172.16.0.220,3260] successful.
Jul 31 14:51:22 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4aafd9d-430e-44b8-a547-05ce2a874e43]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2c66c2-31a2-47c9-bfee-f9d6f71a39d1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:51:22 user nova-compute[72239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:51:22 user nova-compute[72239]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:51:22 user nova-compute[72239]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339 (non-flash)
Jul 31 14:51:22 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:51:22 user nova-compute[72239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:51:22 user nova-compute[72239]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:51:22 user nova-compute[72239]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339 (non-flash)
Jul 31 14:51:22 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[83c09af5-f5f1-41f2-912e-1b9bf6ad4aa4]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:51:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dHQUFkNE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 14:51:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:51:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23034383361353135', 'path': '/dev/sdd'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:51:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034383361353135', 'path': '/dev/sdd'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 14:51:23 user nova-compute[72239]: DEBUG nova.objects.instance [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lazy-loading 'flavor' on Instance uuid 1e626a09-1282-4864-8336-6720c7caa0da {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:51:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 14:51:23 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:51:23 user nova-compute[72239]:   <source dev="/dev/sdd"/>
Jul 31 14:51:23 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:51:23 user nova-compute[72239]:   <serial>1481c0b0-8805-493e-8d9c-2ce632bc1339</serial>
Jul 31 14:51:23 user nova-compute[72239]: </disk>
Jul 31 14:51:23 user nova-compute[72239]:  {{(pid=72239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 14:51:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:51:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:51:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] No VIF found with MAC fa:16:3e:18:b6:8f, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:51:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2391e3e9-c16c-46ab-8de7-8f3ea7017bc0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "1e626a09-1282-4864-8336-6720c7caa0da" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.490s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:51:24 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IpyvUeSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:51:28 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:51:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:51:28 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:51:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:51:28 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 14:51:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7762d54a-2b99-4233-ba7f-b463173857d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 14:51:28 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[704a498b-8721-4a95-824c-9339f13b8232]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd] added
Jul 31 14:51:28 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[399618ce-70b8-4f93-b22c-d3672810cb32]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc75ff08-2b17-412a-bcb5-ca8347e3cc84]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IpyvUeSi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IpyvUeSi" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d88c1df-0861-4b54-8712-df16cee611eb]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IpyvUeSi'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9e3d78-9ac3-4815-a4d3-0a3819ba3fed]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdbd781-52c5-48dc-b07c-7145050cd095]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:51:28 user nova-compute[72239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:51:28 user nova-compute[72239]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:51:28 user nova-compute[72239]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339 (non-flash)
Jul 31 14:51:28 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:51:28 user nova-compute[72239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:51:28 user nova-compute[72239]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:51:28 user nova-compute[72239]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339 (non-flash)
Jul 31 14:51:28 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b03294-eb59-4e4e-afed-ad37a82aeb0b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd, portal: 172.16.0.220,3260]
Jul 31 14:51:28 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd, portal: 172.16.0.220,3260] successful.
Jul 31 14:51:28 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d59ef8-6406-4bac-bb15-92eda16e7ddd]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dbabf5c-3cf0-4988-a812-d7d6db6b3fb5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:51:28 user nova-compute[72239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:51:28 user nova-compute[72239]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:51:28 user nova-compute[72239]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339 (non-flash)
Jul 31 14:51:28 user nova-compute[72239]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd (non-flash)
Jul 31 14:51:28 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:51:28 user nova-compute[72239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:51:28 user nova-compute[72239]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:51:28 user nova-compute[72239]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339 (non-flash)
Jul 31 14:51:28 user nova-compute[72239]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd (non-flash)
Jul 31 14:51:28 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] HCTL ('36', '-', '-', 0) found on session 25 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[37217ef7-e705-4e75-9e55-2c5276db0ce9]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Searching for a device in session 25 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:51:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IpyvUeSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 14:51:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:29 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:51:29 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23038393065663162', 'path': '/dev/sde'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:51:29 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038393065663162', 'path': '/dev/sde'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 14:51:29 user nova-compute[72239]: DEBUG nova.objects.instance [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lazy-loading 'flavor' on Instance uuid 82116af8-3702-401b-8d00-9291d4caeb03 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:51:29 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 14:51:29 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:51:29 user nova-compute[72239]:   <source dev="/dev/sde"/>
Jul 31 14:51:29 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:51:29 user nova-compute[72239]:   <serial>e6d10baf-cc41-48ed-893f-f2a7a8a626fd</serial>
Jul 31 14:51:29 user nova-compute[72239]: </disk>
Jul 31 14:51:29 user nova-compute[72239]:  {{(pid=72239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 14:51:30 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:51:30 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:51:30 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] No VIF found with MAC fa:16:3e:2e:96:96, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:51:30 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4a70c622-6870-42d6-b502-f1b777a1e342 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "82116af8-3702-401b-8d00-9291d4caeb03" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.666s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:51:31 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-871999a6-9026-4d56-abc9-c3f13f664394 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Acquiring lock "82116af8-3702-401b-8d00-9291d4caeb03" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:51:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-871999a6-9026-4d56-abc9-c3f13f664394 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "82116af8-3702-401b-8d00-9291d4caeb03" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:51:32 user nova-compute[72239]: INFO nova.compute.manager [None req-871999a6-9026-4d56-abc9-c3f13f664394 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Detaching volume e6d10baf-cc41-48ed-893f-f2a7a8a626fd
Jul 31 14:51:33 user nova-compute[72239]: INFO nova.virt.block_device [None req-871999a6-9026-4d56-abc9-c3f13f664394 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Attempting to driver detach volume e6d10baf-cc41-48ed-893f-f2a7a8a626fd from mountpoint /dev/vdb
Jul 31 14:51:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-871999a6-9026-4d56-abc9-c3f13f664394 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Attempting to detach device vdb from instance 82116af8-3702-401b-8d00-9291d4caeb03 from the persistent domain config. {{(pid=72239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-871999a6-9026-4d56-abc9-c3f13f664394 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 14:51:33 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:51:33 user nova-compute[72239]:   <source dev="/dev/sde"/>
Jul 31 14:51:33 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:51:33 user nova-compute[72239]:   <serial>e6d10baf-cc41-48ed-893f-f2a7a8a626fd</serial>
Jul 31 14:51:33 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 14:51:33 user nova-compute[72239]: </disk>
Jul 31 14:51:33 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 14:51:33 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-871999a6-9026-4d56-abc9-c3f13f664394 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Successfully detached device vdb from instance 82116af8-3702-401b-8d00-9291d4caeb03 from the persistent domain config.
Jul 31 14:51:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-871999a6-9026-4d56-abc9-c3f13f664394 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 82116af8-3702-401b-8d00-9291d4caeb03 from the live domain config. {{(pid=72239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-871999a6-9026-4d56-abc9-c3f13f664394 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 14:51:33 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:51:33 user nova-compute[72239]:   <source dev="/dev/sde"/>
Jul 31 14:51:33 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:51:33 user nova-compute[72239]:   <serial>e6d10baf-cc41-48ed-893f-f2a7a8a626fd</serial>
Jul 31 14:51:33 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 14:51:33 user nova-compute[72239]: </disk>
Jul 31 14:51:33 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Received event <DeviceRemovedEvent: 1690815093.5300055, 82116af8-3702-401b-8d00-9291d4caeb03 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72239) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-871999a6-9026-4d56-abc9-c3f13f664394 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 82116af8-3702-401b-8d00-9291d4caeb03 {{(pid=72239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 14:51:33 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-871999a6-9026-4d56-abc9-c3f13f664394 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Successfully detached device vdb from instance 82116af8-3702-401b-8d00-9291d4caeb03 from the live domain config.
Jul 31 14:51:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-871999a6-9026-4d56-abc9-c3f13f664394 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-871999a6-9026-4d56-abc9-c3f13f664394 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IpyvUeSi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:51:33 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-871999a6-9026-4d56-abc9-c3f13f664394 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:51:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-871999a6-9026-4d56-abc9-c3f13f664394 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-871999a6-9026-4d56-abc9-c3f13f664394 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-871999a6-9026-4d56-abc9-c3f13f664394 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7bb20b-ee39-4dc5-a797-6eecf075b1c0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4930ae-efa7-49fa-890e-e8f003c683e7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-871999a6-9026-4d56-abc9-c3f13f664394 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:51:33 user nova-compute[72239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:51:33 user nova-compute[72239]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:51:33 user nova-compute[72239]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339 (non-flash)
Jul 31 14:51:33 user nova-compute[72239]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd (non-flash)
Jul 31 14:51:33 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-871999a6-9026-4d56-abc9-c3f13f664394 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:51:33 user nova-compute[72239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:51:33 user nova-compute[72239]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:51:33 user nova-compute[72239]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339 (non-flash)
Jul 31 14:51:33 user nova-compute[72239]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd (non-flash)
Jul 31 14:51:33 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-871999a6-9026-4d56-abc9-c3f13f664394 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4120385000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd'): ({'sde'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-871999a6-9026-4d56-abc9-c3f13f664394 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Removing single pathed devices sde {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5709c287-5008-48cf-9563-833e535095c5]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fd2099-d02e-4c54-98bc-e2f2457e4126]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-871999a6-9026-4d56-abc9-c3f13f664394 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Flushing IO for device /dev/sde {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0360955d-3ac6-4ea3-951d-ee5ef53d5ef2]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-871999a6-9026-4d56-abc9-c3f13f664394 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690815078.7121, db15ad45-8f28-4e0c-8d7e-7db75f33fe92 => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:51:33 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] VM Stopped (Lifecycle Event)
Jul 31 14:51:33 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad14113e-d1a1-463e-8214-8147154d2e4d]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-871999a6-9026-4d56-abc9-c3f13f664394 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-871999a6-9026-4d56-abc9-c3f13f664394 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] SCSI volumes sde have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-871999a6-9026-4d56-abc9-c3f13f664394 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG nova.compute.manager [None req-119a3487-9895-4d0d-9e5d-b93ae2ca89ca None None] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG nova.compute.manager [None req-119a3487-9895-4d0d-9e5d-b93ae2ca89ca None None] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c984fc2-9b17-4575-87ae-30e7040af29a]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-871999a6-9026-4d56-abc9-c3f13f664394 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eec0fdd-8ad6-40fc-b64b-e9765d8ba3b3]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-871999a6-9026-4d56-abc9-c3f13f664394 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd, portal: 172.16.0.220,3260]
Jul 31 14:51:33 user nova-compute[72239]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd, portal: 172.16.0.220,3260] successful.
Jul 31 14:51:33 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6d10baf-cc41-48ed-893f-f2a7a8a626fd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2186a1-9ce6-4a69-a1eb-0c2a1eadd640]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-871999a6-9026-4d56-abc9-c3f13f664394 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-871999a6-9026-4d56-abc9-c3f13f664394 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-871999a6-9026-4d56-abc9-c3f13f664394 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] <== disconnect_volume: return (318ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:51:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-871999a6-9026-4d56-abc9-c3f13f664394 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 14:51:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:34 user nova-compute[72239]: DEBUG nova.objects.instance [None req-871999a6-9026-4d56-abc9-c3f13f664394 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lazy-loading 'flavor' on Instance uuid 82116af8-3702-401b-8d00-9291d4caeb03 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:51:34 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-871999a6-9026-4d56-abc9-c3f13f664394 tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "82116af8-3702-401b-8d00-9291d4caeb03" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.708s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:51:36 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e9fcf72c-4b73-41df-b642-5f744598b436 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Acquiring lock "97917500-bc78-433b-8d3d-181ed13667dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:51:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e9fcf72c-4b73-41df-b642-5f744598b436 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lock "97917500-bc78-433b-8d3d-181ed13667dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:51:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e9fcf72c-4b73-41df-b642-5f744598b436 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Acquiring lock "97917500-bc78-433b-8d3d-181ed13667dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:51:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e9fcf72c-4b73-41df-b642-5f744598b436 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lock "97917500-bc78-433b-8d3d-181ed13667dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:51:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e9fcf72c-4b73-41df-b642-5f744598b436 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lock "97917500-bc78-433b-8d3d-181ed13667dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:51:39 user nova-compute[72239]: INFO nova.compute.manager [None req-e9fcf72c-4b73-41df-b642-5f744598b436 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Terminating instance
Jul 31 14:51:39 user nova-compute[72239]: DEBUG nova.compute.manager [None req-e9fcf72c-4b73-41df-b642-5f744598b436 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 14:51:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:40 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:40 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Instance destroyed successfully.
Jul 31 14:51:40 user nova-compute[72239]: DEBUG nova.objects.instance [None req-e9fcf72c-4b73-41df-b642-5f744598b436 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lazy-loading 'resources' on Instance uuid 97917500-bc78-433b-8d3d-181ed13667dc {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:51:40 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-e9fcf72c-4b73-41df-b642-5f744598b436 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:44:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1906962809',display_name='tempest-ServerStableDeviceRescueTest-server-1906962809',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1906962809',id=6,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMlFBmAzelYchMoAGUb60rbfIln3qCeD2o8psoYFowByLC00hIP+y8UpBp70Jkvkzzjmyn4APvd5SxUameMY9qeQ+2b0RFNmW42aqb81yJhfLBj22P9rK42XpxH37WRJIw==',key_name='tempest-keypair-2011346805',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:48:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48e59830ca9e40718341c3f2b0375af0',ramdisk_id='',reservation_id='r-3xscnqmk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1096111935',owner_user_name='tempest-ServerStableDeviceRescueTest-1096111935-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:50:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e1df7639d9db4005841b1b3812440f83',uuid=97917500-bc78-433b-8d3d-181ed13667dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60c1bdaa-524e-41da-96d7-56c77f959c71", "address": "fa:16:3e:a4:5f:0e", "network": {"id": "edecce7c-9fe9-4028-997d-b1ceef4e22bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1931054498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e59830ca9e40718341c3f2b0375af0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c1bdaa-52", "ovs_interfaceid": "60c1bdaa-524e-41da-96d7-56c77f959c71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:51:40 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-e9fcf72c-4b73-41df-b642-5f744598b436 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Converting VIF {"id": "60c1bdaa-524e-41da-96d7-56c77f959c71", "address": "fa:16:3e:a4:5f:0e", "network": {"id": "edecce7c-9fe9-4028-997d-b1ceef4e22bd", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1931054498-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e59830ca9e40718341c3f2b0375af0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60c1bdaa-52", "ovs_interfaceid": "60c1bdaa-524e-41da-96d7-56c77f959c71", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:51:40 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-e9fcf72c-4b73-41df-b642-5f744598b436 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:5f:0e,bridge_name='br-int',has_traffic_filtering=True,id=60c1bdaa-524e-41da-96d7-56c77f959c71,network=Network(edecce7c-9fe9-4028-997d-b1ceef4e22bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c1bdaa-52') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:51:40 user nova-compute[72239]: DEBUG os_vif [None req-e9fcf72c-4b73-41df-b642-5f744598b436 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:5f:0e,bridge_name='br-int',has_traffic_filtering=True,id=60c1bdaa-524e-41da-96d7-56c77f959c71,network=Network(edecce7c-9fe9-4028-997d-b1ceef4e22bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c1bdaa-52') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:51:40 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:40 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60c1bdaa-52, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:51:40 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:40 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:51:40 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:40 user nova-compute[72239]: INFO os_vif [None req-e9fcf72c-4b73-41df-b642-5f744598b436 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:5f:0e,bridge_name='br-int',has_traffic_filtering=True,id=60c1bdaa-524e-41da-96d7-56c77f959c71,network=Network(edecce7c-9fe9-4028-997d-b1ceef4e22bd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60c1bdaa-52')
Jul 31 14:51:40 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-e9fcf72c-4b73-41df-b642-5f744598b436 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Deleting instance files /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc_del
Jul 31 14:51:40 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-e9fcf72c-4b73-41df-b642-5f744598b436 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Deletion of /opt/stack/data/nova/instances/97917500-bc78-433b-8d3d-181ed13667dc_del complete
Jul 31 14:51:40 user nova-compute[72239]: INFO nova.compute.manager [None req-e9fcf72c-4b73-41df-b642-5f744598b436 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Took 0.96 seconds to destroy the instance on the hypervisor.
Jul 31 14:51:40 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-e9fcf72c-4b73-41df-b642-5f744598b436 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 14:51:40 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 14:51:40 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 14:51:40 user nova-compute[72239]: DEBUG nova.compute.manager [req-7548d0e7-546f-407f-9447-088c0135e7c0 req-2a0e3c4b-54ed-43b4-940b-d79530c0fe2a service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Received event network-vif-unplugged-60c1bdaa-524e-41da-96d7-56c77f959c71 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:51:40 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7548d0e7-546f-407f-9447-088c0135e7c0 req-2a0e3c4b-54ed-43b4-940b-d79530c0fe2a service nova] Acquiring lock "97917500-bc78-433b-8d3d-181ed13667dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:51:40 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7548d0e7-546f-407f-9447-088c0135e7c0 req-2a0e3c4b-54ed-43b4-940b-d79530c0fe2a service nova] Lock "97917500-bc78-433b-8d3d-181ed13667dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:51:40 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7548d0e7-546f-407f-9447-088c0135e7c0 req-2a0e3c4b-54ed-43b4-940b-d79530c0fe2a service nova] Lock "97917500-bc78-433b-8d3d-181ed13667dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:51:40 user nova-compute[72239]: DEBUG nova.compute.manager [req-7548d0e7-546f-407f-9447-088c0135e7c0 req-2a0e3c4b-54ed-43b4-940b-d79530c0fe2a service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] No waiting events found dispatching network-vif-unplugged-60c1bdaa-524e-41da-96d7-56c77f959c71 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:51:40 user nova-compute[72239]: DEBUG nova.compute.manager [req-7548d0e7-546f-407f-9447-088c0135e7c0 req-2a0e3c4b-54ed-43b4-940b-d79530c0fe2a service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Received event network-vif-unplugged-60c1bdaa-524e-41da-96d7-56c77f959c71 for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 14:51:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:42 user nova-compute[72239]: DEBUG nova.compute.manager [req-a5131fe1-08f2-4426-8624-d0843af7bc56 req-4a6a0679-8784-45a8-973d-1e182171740a service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Received event network-vif-plugged-60c1bdaa-524e-41da-96d7-56c77f959c71 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:51:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a5131fe1-08f2-4426-8624-d0843af7bc56 req-4a6a0679-8784-45a8-973d-1e182171740a service nova] Acquiring lock "97917500-bc78-433b-8d3d-181ed13667dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:51:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a5131fe1-08f2-4426-8624-d0843af7bc56 req-4a6a0679-8784-45a8-973d-1e182171740a service nova] Lock "97917500-bc78-433b-8d3d-181ed13667dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:51:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a5131fe1-08f2-4426-8624-d0843af7bc56 req-4a6a0679-8784-45a8-973d-1e182171740a service nova] Lock "97917500-bc78-433b-8d3d-181ed13667dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:51:42 user nova-compute[72239]: DEBUG nova.compute.manager [req-a5131fe1-08f2-4426-8624-d0843af7bc56 req-4a6a0679-8784-45a8-973d-1e182171740a service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] No waiting events found dispatching network-vif-plugged-60c1bdaa-524e-41da-96d7-56c77f959c71 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:51:42 user nova-compute[72239]: WARNING nova.compute.manager [req-a5131fe1-08f2-4426-8624-d0843af7bc56 req-4a6a0679-8784-45a8-973d-1e182171740a service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Received unexpected event network-vif-plugged-60c1bdaa-524e-41da-96d7-56c77f959c71 for instance with vm_state active and task_state deleting.
Jul 31 14:51:42 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:51:43 user nova-compute[72239]: DEBUG nova.compute.manager [req-1a5f4817-b12a-4e31-8739-ff22de9a7ef3 req-53e00fc6-5af7-43c0-96fd-5865b24b5554 service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Received event network-vif-deleted-60c1bdaa-524e-41da-96d7-56c77f959c71 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:51:43 user nova-compute[72239]: INFO nova.compute.manager [req-1a5f4817-b12a-4e31-8739-ff22de9a7ef3 req-53e00fc6-5af7-43c0-96fd-5865b24b5554 service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Neutron deleted interface 60c1bdaa-524e-41da-96d7-56c77f959c71; detaching it from the instance and deleting it from the info cache
Jul 31 14:51:43 user nova-compute[72239]: DEBUG nova.network.neutron [req-1a5f4817-b12a-4e31-8739-ff22de9a7ef3 req-53e00fc6-5af7-43c0-96fd-5865b24b5554 service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:51:43 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Took 2.27 seconds to deallocate network for instance.
Jul 31 14:51:43 user nova-compute[72239]: DEBUG nova.compute.manager [req-1a5f4817-b12a-4e31-8739-ff22de9a7ef3 req-53e00fc6-5af7-43c0-96fd-5865b24b5554 service nova] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Detach interface failed, port_id=60c1bdaa-524e-41da-96d7-56c77f959c71, reason: Instance 97917500-bc78-433b-8d3d-181ed13667dc could not be found. {{(pid=72239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 14:51:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e9fcf72c-4b73-41df-b642-5f744598b436 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:51:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e9fcf72c-4b73-41df-b642-5f744598b436 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:51:43 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-e9fcf72c-4b73-41df-b642-5f744598b436 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:51:43 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-e9fcf72c-4b73-41df-b642-5f744598b436 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:51:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e9fcf72c-4b73-41df-b642-5f744598b436 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.448s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:51:43 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-e9fcf72c-4b73-41df-b642-5f744598b436 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Deleted allocations for instance 97917500-bc78-433b-8d3d-181ed13667dc
Jul 31 14:51:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e9fcf72c-4b73-41df-b642-5f744598b436 tempest-ServerStableDeviceRescueTest-1096111935 tempest-ServerStableDeviceRescueTest-1096111935-project-member] Lock "97917500-bc78-433b-8d3d-181ed13667dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.897s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:51:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "14653984-6c32-4ddd-bc0b-203a670c2b4e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:51:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "14653984-6c32-4ddd-bc0b-203a670c2b4e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:51:46 user nova-compute[72239]: DEBUG nova.compute.manager [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 14:51:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:51:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:51:46 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 14:51:46 user nova-compute[72239]: INFO nova.compute.claims [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Claim successful on node user
Jul 31 14:51:46 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:51:46 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:51:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:51:46 user nova-compute[72239]: DEBUG nova.compute.manager [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 14:51:46 user nova-compute[72239]: DEBUG nova.compute.manager [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 14:51:46 user nova-compute[72239]: DEBUG nova.network.neutron [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 14:51:46 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 14:51:46 user nova-compute[72239]: DEBUG nova.compute.manager [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 14:51:46 user nova-compute[72239]: DEBUG nova.policy [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '70c6001a7ac5434fbc5ac7d003edd4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6715a7ff38401d844b620cb8d8769e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 14:51:46 user nova-compute[72239]: DEBUG nova.compute.manager [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 14:51:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 14:51:46 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Creating image(s)
Jul 31 14:51:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "/opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:51:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "/opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:51:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "/opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:51:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4ba21ca3-d093-4dcb-b70a-a2fdfdc8366d tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Acquiring lock "1e626a09-1282-4864-8336-6720c7caa0da" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:51:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4ba21ca3-d093-4dcb-b70a-a2fdfdc8366d tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "1e626a09-1282-4864-8336-6720c7caa0da" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:51:46 user nova-compute[72239]: INFO nova.compute.manager [None req-4ba21ca3-d093-4dcb-b70a-a2fdfdc8366d tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Detaching volume 1481c0b0-8805-493e-8d9c-2ce632bc1339
Jul 31 14:51:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f0d38a34-b6c0-4d3c-9ce6-1e0b898456f0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Acquiring lock "1e626a09-1282-4864-8336-6720c7caa0da" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:51:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.148s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "ca449065000c92aac3b7b9fa685f9a7710929444" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:51:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:51:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:46 user nova-compute[72239]: INFO nova.virt.block_device [None req-4ba21ca3-d093-4dcb-b70a-a2fdfdc8366d tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Attempting to driver detach volume 1481c0b0-8805-493e-8d9c-2ce632bc1339 from mountpoint /dev/vdb
Jul 31 14:51:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4ba21ca3-d093-4dcb-b70a-a2fdfdc8366d tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Attempting to detach device vdb from instance 1e626a09-1282-4864-8336-6720c7caa0da from the persistent domain config. {{(pid=72239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 14:51:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-4ba21ca3-d093-4dcb-b70a-a2fdfdc8366d tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 14:51:46 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:51:46 user nova-compute[72239]:   <source dev="/dev/sdd"/>
Jul 31 14:51:46 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:51:46 user nova-compute[72239]:   <serial>1481c0b0-8805-493e-8d9c-2ce632bc1339</serial>
Jul 31 14:51:46 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 14:51:46 user nova-compute[72239]: </disk>
Jul 31 14:51:46 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 14:51:46 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-4ba21ca3-d093-4dcb-b70a-a2fdfdc8366d tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Successfully detached device vdb from instance 1e626a09-1282-4864-8336-6720c7caa0da from the persistent domain config.
Jul 31 14:51:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4ba21ca3-d093-4dcb-b70a-a2fdfdc8366d tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1e626a09-1282-4864-8336-6720c7caa0da from the live domain config. {{(pid=72239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 14:51:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-4ba21ca3-d093-4dcb-b70a-a2fdfdc8366d tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 14:51:46 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:51:46 user nova-compute[72239]:   <source dev="/dev/sdd"/>
Jul 31 14:51:46 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:51:46 user nova-compute[72239]:   <serial>1481c0b0-8805-493e-8d9c-2ce632bc1339</serial>
Jul 31 14:51:46 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 14:51:46 user nova-compute[72239]: </disk>
Jul 31 14:51:46 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.136s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/disk 1073741824" returned: 0 in 0.048s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.131s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Checking if we can resize image /opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Cannot resize image /opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG nova.objects.instance [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lazy-loading 'migration_context' on Instance uuid 14653984-6c32-4ddd-bc0b-203a670c2b4e {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Ensure instance console log exists: /opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Received event <DeviceRemovedEvent: 1690815107.4170282, 1e626a09-1282-4864-8336-6720c7caa0da => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72239) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4ba21ca3-d093-4dcb-b70a-a2fdfdc8366d tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1e626a09-1282-4864-8336-6720c7caa0da {{(pid=72239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 14:51:47 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-4ba21ca3-d093-4dcb-b70a-a2fdfdc8366d tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Successfully detached device vdb from instance 1e626a09-1282-4864-8336-6720c7caa0da from the live domain config.
Jul 31 14:51:47 user nova-compute[72239]: DEBUG nova.network.neutron [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Successfully created port: b1b01e63-209d-4388-a81d-eb17afdf0db4 {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ba21ca3-d093-4dcb-b70a-a2fdfdc8366d tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba21ca3-d093-4dcb-b70a-a2fdfdc8366d tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dHQUFkNE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:51:47 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-4ba21ca3-d093-4dcb-b70a-a2fdfdc8366d tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:51:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-4ba21ca3-d093-4dcb-b70a-a2fdfdc8366d tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-4ba21ca3-d093-4dcb-b70a-a2fdfdc8366d tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba21ca3-d093-4dcb-b70a-a2fdfdc8366d tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[645471db-fcb6-4a8f-b417-aa2fcd1c5485]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3acf3aa-e4c9-4146-a1d7-929da6e4c1d4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba21ca3-d093-4dcb-b70a-a2fdfdc8366d tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:51:47 user nova-compute[72239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:51:47 user nova-compute[72239]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:51:47 user nova-compute[72239]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339 (non-flash)
Jul 31 14:51:47 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba21ca3-d093-4dcb-b70a-a2fdfdc8366d tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:51:47 user nova-compute[72239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:51:47 user nova-compute[72239]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:51:47 user nova-compute[72239]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339 (non-flash)
Jul 31 14:51:47 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba21ca3-d093-4dcb-b70a-a2fdfdc8366d tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4120405750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339'): ({'sdd'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-4ba21ca3-d093-4dcb-b70a-a2fdfdc8366d tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Removing single pathed devices sdd {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba3f394-7481-41ce-8ec4-e34aa8a01849]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c27c15-faa2-42cf-b652-3c92ff54d575]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-4ba21ca3-d093-4dcb-b70a-a2fdfdc8366d tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Flushing IO for device /dev/sdd {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad87a986-ad20-4db0-ad3a-5ba74a32fd5f]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-4ba21ca3-d093-4dcb-b70a-a2fdfdc8366d tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.038s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd4a2714-d638-4755-b18f-6af8a0e739ad]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-4ba21ca3-d093-4dcb-b70a-a2fdfdc8366d tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-4ba21ca3-d093-4dcb-b70a-a2fdfdc8366d tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] SCSI volumes sdd have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba21ca3-d093-4dcb-b70a-a2fdfdc8366d tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaac9b6a-a1b5-4837-91a8-332d11127537]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba21ca3-d093-4dcb-b70a-a2fdfdc8366d tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339 -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b03571-76c5-4f06-8ae4-245dd7b016c3]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba21ca3-d093-4dcb-b70a-a2fdfdc8366d tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339, portal: 172.16.0.220,3260]
Jul 31 14:51:47 user nova-compute[72239]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339, portal: 172.16.0.220,3260] successful.
Jul 31 14:51:47 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339 -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9967f9-f404-4b7f-8095-f3ece9854ee7]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba21ca3-d093-4dcb-b70a-a2fdfdc8366d tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-4ba21ca3-d093-4dcb-b70a-a2fdfdc8366d tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.267s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-4ba21ca3-d093-4dcb-b70a-a2fdfdc8366d tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] <== disconnect_volume: return (268ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:51:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4ba21ca3-d093-4dcb-b70a-a2fdfdc8366d tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.network.neutron [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Successfully updated port: b1b01e63-209d-4388-a81d-eb17afdf0db4 {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "refresh_cache-14653984-6c32-4ddd-bc0b-203a670c2b4e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquired lock "refresh_cache-14653984-6c32-4ddd-bc0b-203a670c2b4e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.network.neutron [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.compute.manager [req-a53d8bc8-6ac0-476f-864f-174de8d48cbe req-d9b86070-0352-48ec-badf-e9b70cfebbe3 service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Received event network-changed-b1b01e63-209d-4388-a81d-eb17afdf0db4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.compute.manager [req-a53d8bc8-6ac0-476f-864f-174de8d48cbe req-d9b86070-0352-48ec-badf-e9b70cfebbe3 service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Refreshing instance network info cache due to event network-changed-b1b01e63-209d-4388-a81d-eb17afdf0db4. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a53d8bc8-6ac0-476f-864f-174de8d48cbe req-d9b86070-0352-48ec-badf-e9b70cfebbe3 service nova] Acquiring lock "refresh_cache-14653984-6c32-4ddd-bc0b-203a670c2b4e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.network.neutron [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.objects.instance [None req-4ba21ca3-d093-4dcb-b70a-a2fdfdc8366d tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lazy-loading 'flavor' on Instance uuid 1e626a09-1282-4864-8336-6720c7caa0da {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4ba21ca3-d093-4dcb-b70a-a2fdfdc8366d tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "1e626a09-1282-4864-8336-6720c7caa0da" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.637s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.network.neutron [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Updating instance_info_cache with network_info: [{"id": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "address": "fa:16:3e:5e:e5:b2", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b01e63-20", "ovs_interfaceid": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f0d38a34-b6c0-4d3c-9ce6-1e0b898456f0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "1e626a09-1282-4864-8336-6720c7caa0da" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.571s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f0d38a34-b6c0-4d3c-9ce6-1e0b898456f0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Acquiring lock "1e626a09-1282-4864-8336-6720c7caa0da-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f0d38a34-b6c0-4d3c-9ce6-1e0b898456f0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "1e626a09-1282-4864-8336-6720c7caa0da-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f0d38a34-b6c0-4d3c-9ce6-1e0b898456f0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "1e626a09-1282-4864-8336-6720c7caa0da-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:51:48 user nova-compute[72239]: INFO nova.compute.manager [None req-f0d38a34-b6c0-4d3c-9ce6-1e0b898456f0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Terminating instance
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.compute.manager [None req-f0d38a34-b6c0-4d3c-9ce6-1e0b898456f0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Releasing lock "refresh_cache-14653984-6c32-4ddd-bc0b-203a670c2b4e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.compute.manager [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Instance network_info: |[{"id": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "address": "fa:16:3e:5e:e5:b2", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b01e63-20", "ovs_interfaceid": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a53d8bc8-6ac0-476f-864f-174de8d48cbe req-d9b86070-0352-48ec-badf-e9b70cfebbe3 service nova] Acquired lock "refresh_cache-14653984-6c32-4ddd-bc0b-203a670c2b4e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.network.neutron [req-a53d8bc8-6ac0-476f-864f-174de8d48cbe req-d9b86070-0352-48ec-badf-e9b70cfebbe3 service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Refreshing network info cache for port b1b01e63-209d-4388-a81d-eb17afdf0db4 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Start _get_guest_xml network_info=[{"id": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "address": "fa:16:3e:5e:e5:b2", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b01e63-20", "ovs_interfaceid": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:51:48 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:51:48 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:51:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-236697822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-236697822',id=20,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRPopS6NZ8SJLGIqXpCTuBDBqc4poSQIzgLPnpX8KBSKuZ0J23omJc+3/YxYJoxechHepUs7tMFC/G2hd/C8KcWH0ZiYO+ptZU4vZL8aClAs6bSSlr6XibY/Q6VYdulsg==',key_name='tempest-keypair-1016500460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a6715a7ff38401d844b620cb8d8769e',ramdisk_id='',reservation_id='r-m9hzvwfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-599528407',owner_user_name='tempest-AttachVolumeShelveTestJSON-599528407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:51:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70c6001a7ac5434fbc5ac7d003edd4eb',uuid=14653984-6c32-4ddd-bc0b-203a670c2b4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "address": "fa:16:3e:5e:e5:b2", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b01e63-20", "ovs_interfaceid": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Converting VIF {"id": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "address": "fa:16:3e:5e:e5:b2", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b01e63-20", "ovs_interfaceid": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:e5:b2,bridge_name='br-int',has_traffic_filtering=True,id=b1b01e63-209d-4388-a81d-eb17afdf0db4,network=Network(37a946a3-d20a-4694-8647-73e84d2b0cb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1b01e63-20') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.objects.instance [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lazy-loading 'pci_devices' on Instance uuid 14653984-6c32-4ddd-bc0b-203a670c2b4e {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:51:48 user nova-compute[72239]:   <uuid>14653984-6c32-4ddd-bc0b-203a670c2b4e</uuid>
Jul 31 14:51:48 user nova-compute[72239]:   <name>instance-00000014</name>
Jul 31 14:51:48 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:51:48 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:51:48 user nova-compute[72239]:   <metadata>
Jul 31 14:51:48 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:51:48 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:51:48 user nova-compute[72239]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-236697822</nova:name>
Jul 31 14:51:48 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:51:48</nova:creationTime>
Jul 31 14:51:48 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:51:48 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:51:48 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:51:48 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:51:48 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:51:48 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:51:48 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:51:48 user nova-compute[72239]:       <nova:owner>
Jul 31 14:51:48 user nova-compute[72239]:         <nova:user uuid="70c6001a7ac5434fbc5ac7d003edd4eb">tempest-AttachVolumeShelveTestJSON-599528407-project-member</nova:user>
Jul 31 14:51:48 user nova-compute[72239]:         <nova:project uuid="5a6715a7ff38401d844b620cb8d8769e">tempest-AttachVolumeShelveTestJSON-599528407</nova:project>
Jul 31 14:51:48 user nova-compute[72239]:       </nova:owner>
Jul 31 14:51:48 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:51:48 user nova-compute[72239]:       <nova:ports>
Jul 31 14:51:48 user nova-compute[72239]:         <nova:port uuid="b1b01e63-209d-4388-a81d-eb17afdf0db4">
Jul 31 14:51:48 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 31 14:51:48 user nova-compute[72239]:         </nova:port>
Jul 31 14:51:48 user nova-compute[72239]:       </nova:ports>
Jul 31 14:51:48 user nova-compute[72239]:     </nova:instance>
Jul 31 14:51:48 user nova-compute[72239]:   </metadata>
Jul 31 14:51:48 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:51:48 user nova-compute[72239]:     <system>
Jul 31 14:51:48 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:51:48 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:51:48 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:51:48 user nova-compute[72239]:       <entry name="serial">14653984-6c32-4ddd-bc0b-203a670c2b4e</entry>
Jul 31 14:51:48 user nova-compute[72239]:       <entry name="uuid">14653984-6c32-4ddd-bc0b-203a670c2b4e</entry>
Jul 31 14:51:48 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:51:48 user nova-compute[72239]:     </system>
Jul 31 14:51:48 user nova-compute[72239]:   </sysinfo>
Jul 31 14:51:48 user nova-compute[72239]:   <os>
Jul 31 14:51:48 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:51:48 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:51:48 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:51:48 user nova-compute[72239]:   </os>
Jul 31 14:51:48 user nova-compute[72239]:   <features>
Jul 31 14:51:48 user nova-compute[72239]:     <acpi/>
Jul 31 14:51:48 user nova-compute[72239]:     <apic/>
Jul 31 14:51:48 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:51:48 user nova-compute[72239]:   </features>
Jul 31 14:51:48 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:51:48 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:51:48 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:51:48 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:51:48 user nova-compute[72239]:   </clock>
Jul 31 14:51:48 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:51:48 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:51:48 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:51:48 user nova-compute[72239]:   </cpu>
Jul 31 14:51:48 user nova-compute[72239]:   <devices>
Jul 31 14:51:48 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:51:48 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:51:48 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/disk"/>
Jul 31 14:51:48 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:51:48 user nova-compute[72239]:     </disk>
Jul 31 14:51:48 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:51:48 user nova-compute[72239]:       <mac address="fa:16:3e:5e:e5:b2"/>
Jul 31 14:51:48 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:51:48 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:51:48 user nova-compute[72239]:       <target dev="tapb1b01e63-20"/>
Jul 31 14:51:48 user nova-compute[72239]:     </interface>
Jul 31 14:51:48 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:51:48 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/console.log" append="off"/>
Jul 31 14:51:48 user nova-compute[72239]:     </serial>
Jul 31 14:51:48 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:51:48 user nova-compute[72239]:     <video>
Jul 31 14:51:48 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:51:48 user nova-compute[72239]:     </video>
Jul 31 14:51:48 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:51:48 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:51:48 user nova-compute[72239]:     </rng>
Jul 31 14:51:48 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:51:48 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:51:48 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:51:48 user nova-compute[72239]:     </memballoon>
Jul 31 14:51:48 user nova-compute[72239]:   </devices>
Jul 31 14:51:48 user nova-compute[72239]: </domain>
Jul 31 14:51:48 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:51:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-236697822',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-236697822',id=20,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRPopS6NZ8SJLGIqXpCTuBDBqc4poSQIzgLPnpX8KBSKuZ0J23omJc+3/YxYJoxechHepUs7tMFC/G2hd/C8KcWH0ZiYO+ptZU4vZL8aClAs6bSSlr6XibY/Q6VYdulsg==',key_name='tempest-keypair-1016500460',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a6715a7ff38401d844b620cb8d8769e',ramdisk_id='',reservation_id='r-m9hzvwfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-599528407',owner_user_name='tempest-AttachVolumeShelveTestJSON-599528407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:51:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70c6001a7ac5434fbc5ac7d003edd4eb',uuid=14653984-6c32-4ddd-bc0b-203a670c2b4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "address": "fa:16:3e:5e:e5:b2", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b01e63-20", "ovs_interfaceid": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Converting VIF {"id": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "address": "fa:16:3e:5e:e5:b2", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b01e63-20", "ovs_interfaceid": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:e5:b2,bridge_name='br-int',has_traffic_filtering=True,id=b1b01e63-209d-4388-a81d-eb17afdf0db4,network=Network(37a946a3-d20a-4694-8647-73e84d2b0cb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1b01e63-20') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG os_vif [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:e5:b2,bridge_name='br-int',has_traffic_filtering=True,id=b1b01e63-209d-4388-a81d-eb17afdf0db4,network=Network(37a946a3-d20a-4694-8647-73e84d2b0cb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1b01e63-20') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1b01e63-20, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb1b01e63-20, col_values=(('external_ids', {'iface-id': 'b1b01e63-209d-4388-a81d-eb17afdf0db4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:e5:b2', 'vm-uuid': '14653984-6c32-4ddd-bc0b-203a670c2b4e'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:48 user nova-compute[72239]: INFO os_vif [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:e5:b2,bridge_name='br-int',has_traffic_filtering=True,id=b1b01e63-209d-4388-a81d-eb17afdf0db4,network=Network(37a946a3-d20a-4694-8647-73e84d2b0cb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1b01e63-20')
Jul 31 14:51:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] No VIF found with MAC fa:16:3e:5e:e5:b2, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.compute.manager [req-a9032a8c-a7fa-435e-90bb-b333eb9b2172 req-8ed2e314-7b3d-49d6-a7fb-3e72d09c2522 service nova] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Received event network-vif-unplugged-ccc3c5f4-a0e1-4844-a193-b56945bf71a2 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a9032a8c-a7fa-435e-90bb-b333eb9b2172 req-8ed2e314-7b3d-49d6-a7fb-3e72d09c2522 service nova] Acquiring lock "1e626a09-1282-4864-8336-6720c7caa0da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a9032a8c-a7fa-435e-90bb-b333eb9b2172 req-8ed2e314-7b3d-49d6-a7fb-3e72d09c2522 service nova] Lock "1e626a09-1282-4864-8336-6720c7caa0da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a9032a8c-a7fa-435e-90bb-b333eb9b2172 req-8ed2e314-7b3d-49d6-a7fb-3e72d09c2522 service nova] Lock "1e626a09-1282-4864-8336-6720c7caa0da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.compute.manager [req-a9032a8c-a7fa-435e-90bb-b333eb9b2172 req-8ed2e314-7b3d-49d6-a7fb-3e72d09c2522 service nova] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] No waiting events found dispatching network-vif-unplugged-ccc3c5f4-a0e1-4844-a193-b56945bf71a2 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.compute.manager [req-a9032a8c-a7fa-435e-90bb-b333eb9b2172 req-8ed2e314-7b3d-49d6-a7fb-3e72d09c2522 service nova] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Received event network-vif-unplugged-ccc3c5f4-a0e1-4844-a193-b56945bf71a2 for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.network.neutron [req-a53d8bc8-6ac0-476f-864f-174de8d48cbe req-d9b86070-0352-48ec-badf-e9b70cfebbe3 service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Updated VIF entry in instance network info cache for port b1b01e63-209d-4388-a81d-eb17afdf0db4. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG nova.network.neutron [req-a53d8bc8-6ac0-476f-864f-174de8d48cbe req-d9b86070-0352-48ec-badf-e9b70cfebbe3 service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Updating instance_info_cache with network_info: [{"id": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "address": "fa:16:3e:5e:e5:b2", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b01e63-20", "ovs_interfaceid": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:51:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a53d8bc8-6ac0-476f-864f-174de8d48cbe req-d9b86070-0352-48ec-badf-e9b70cfebbe3 service nova] Releasing lock "refresh_cache-14653984-6c32-4ddd-bc0b-203a670c2b4e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:51:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:49 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Instance destroyed successfully.
Jul 31 14:51:49 user nova-compute[72239]: DEBUG nova.objects.instance [None req-f0d38a34-b6c0-4d3c-9ce6-1e0b898456f0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lazy-loading 'resources' on Instance uuid 1e626a09-1282-4864-8336-6720c7caa0da {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:51:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-f0d38a34-b6c0-4d3c-9ce6-1e0b898456f0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:49:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1779041065',display_name='tempest-VolumesSnapshotTestJSON-instance-1779041065',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1779041065',id=18,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIrSoaNrdvepS2CVBLnx26vmHUJXTnOOByJ7ZgRP59n/aaMblKHXjI0w+QD690h1MduepNaDFnoNU5TAjAnoqinK+oMc1rtFqInABCwIsZG0taFHE8rv7UL+syU8S9hE9w==',key_name='tempest-keypair-2036772718',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:49:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d888450f903d41c5b6fde5de0b513a84',ramdisk_id='',reservation_id='r-vjn61cas',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2087706080',owner_user_name='tempest-VolumesSnapshotTestJSON-2087706080-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:49:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c842cf4052f4822948614bb63072812',uuid=1e626a09-1282-4864-8336-6720c7caa0da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ccc3c5f4-a0e1-4844-a193-b56945bf71a2", "address": "fa:16:3e:18:b6:8f", "network": {"id": "807530ad-b1c8-4426-9036-a796ba7dee91", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-277511856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d888450f903d41c5b6fde5de0b513a84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccc3c5f4-a0", "ovs_interfaceid": "ccc3c5f4-a0e1-4844-a193-b56945bf71a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:51:49 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-f0d38a34-b6c0-4d3c-9ce6-1e0b898456f0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Converting VIF {"id": "ccc3c5f4-a0e1-4844-a193-b56945bf71a2", "address": "fa:16:3e:18:b6:8f", "network": {"id": "807530ad-b1c8-4426-9036-a796ba7dee91", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-277511856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d888450f903d41c5b6fde5de0b513a84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapccc3c5f4-a0", "ovs_interfaceid": "ccc3c5f4-a0e1-4844-a193-b56945bf71a2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:51:49 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-f0d38a34-b6c0-4d3c-9ce6-1e0b898456f0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:b6:8f,bridge_name='br-int',has_traffic_filtering=True,id=ccc3c5f4-a0e1-4844-a193-b56945bf71a2,network=Network(807530ad-b1c8-4426-9036-a796ba7dee91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccc3c5f4-a0') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:51:49 user nova-compute[72239]: DEBUG os_vif [None req-f0d38a34-b6c0-4d3c-9ce6-1e0b898456f0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:b6:8f,bridge_name='br-int',has_traffic_filtering=True,id=ccc3c5f4-a0e1-4844-a193-b56945bf71a2,network=Network(807530ad-b1c8-4426-9036-a796ba7dee91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccc3c5f4-a0') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:51:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapccc3c5f4-a0, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:51:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:51:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:49 user nova-compute[72239]: INFO os_vif [None req-f0d38a34-b6c0-4d3c-9ce6-1e0b898456f0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:b6:8f,bridge_name='br-int',has_traffic_filtering=True,id=ccc3c5f4-a0e1-4844-a193-b56945bf71a2,network=Network(807530ad-b1c8-4426-9036-a796ba7dee91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapccc3c5f4-a0')
Jul 31 14:51:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0d38a34-b6c0-4d3c-9ce6-1e0b898456f0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 14:51:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d38a34-b6c0-4d3c-9ce6-1e0b898456f0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dHQUFkNE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:51:49 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-f0d38a34-b6c0-4d3c-9ce6-1e0b898456f0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:51:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-f0d38a34-b6c0-4d3c-9ce6-1e0b898456f0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:51:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-f0d38a34-b6c0-4d3c-9ce6-1e0b898456f0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:51:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d38a34-b6c0-4d3c-9ce6-1e0b898456f0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1481c0b0-8805-493e-8d9c-2ce632bc1339', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 14:51:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:49 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a6d2eb-b9c7-4f52-bab4-c47588fc433a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:51:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:51:49 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[766ded16-7176-44a1-abb2-125bd0d49101]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:51:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d38a34-b6c0-4d3c-9ce6-1e0b898456f0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:51:49 user nova-compute[72239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:51:49 user nova-compute[72239]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:51:49 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:51:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d38a34-b6c0-4d3c-9ce6-1e0b898456f0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:51:49 user nova-compute[72239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:51:49 user nova-compute[72239]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:51:49 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:51:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d38a34-b6c0-4d3c-9ce6-1e0b898456f0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41182144c0>, {}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 14:51:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d38a34-b6c0-4d3c-9ce6-1e0b898456f0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Disconnecting from: [] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 14:51:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-f0d38a34-b6c0-4d3c-9ce6-1e0b898456f0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.048s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:51:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0d38a34-b6c0-4d3c-9ce6-1e0b898456f0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] <== disconnect_volume: return (49ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:51:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0d38a34-b6c0-4d3c-9ce6-1e0b898456f0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 14:51:49 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-f0d38a34-b6c0-4d3c-9ce6-1e0b898456f0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Deleting instance files /opt/stack/data/nova/instances/1e626a09-1282-4864-8336-6720c7caa0da_del
Jul 31 14:51:49 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-f0d38a34-b6c0-4d3c-9ce6-1e0b898456f0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Deletion of /opt/stack/data/nova/instances/1e626a09-1282-4864-8336-6720c7caa0da_del complete
Jul 31 14:51:49 user nova-compute[72239]: INFO nova.compute.manager [None req-f0d38a34-b6c0-4d3c-9ce6-1e0b898456f0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Took 1.31 seconds to destroy the instance on the hypervisor.
Jul 31 14:51:49 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-f0d38a34-b6c0-4d3c-9ce6-1e0b898456f0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 14:51:49 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 14:51:49 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 14:51:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:50 user nova-compute[72239]: DEBUG nova.compute.manager [req-54511126-1c10-4ea9-acc0-99978116584d req-9870d0ab-0d3a-4298-9cde-27fa7f37e8e0 service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Received event network-vif-plugged-b1b01e63-209d-4388-a81d-eb17afdf0db4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:51:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-54511126-1c10-4ea9-acc0-99978116584d req-9870d0ab-0d3a-4298-9cde-27fa7f37e8e0 service nova] Acquiring lock "14653984-6c32-4ddd-bc0b-203a670c2b4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:51:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-54511126-1c10-4ea9-acc0-99978116584d req-9870d0ab-0d3a-4298-9cde-27fa7f37e8e0 service nova] Lock "14653984-6c32-4ddd-bc0b-203a670c2b4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:51:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-54511126-1c10-4ea9-acc0-99978116584d req-9870d0ab-0d3a-4298-9cde-27fa7f37e8e0 service nova] Lock "14653984-6c32-4ddd-bc0b-203a670c2b4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:51:50 user nova-compute[72239]: DEBUG nova.compute.manager [req-54511126-1c10-4ea9-acc0-99978116584d req-9870d0ab-0d3a-4298-9cde-27fa7f37e8e0 service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] No waiting events found dispatching network-vif-plugged-b1b01e63-209d-4388-a81d-eb17afdf0db4 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:51:50 user nova-compute[72239]: WARNING nova.compute.manager [req-54511126-1c10-4ea9-acc0-99978116584d req-9870d0ab-0d3a-4298-9cde-27fa7f37e8e0 service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Received unexpected event network-vif-plugged-b1b01e63-209d-4388-a81d-eb17afdf0db4 for instance with vm_state building and task_state spawning.
Jul 31 14:51:50 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:51:50 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Took 0.97 seconds to deallocate network for instance.
Jul 31 14:51:50 user nova-compute[72239]: DEBUG nova.compute.manager [req-4e51c8e5-699c-4427-83fc-88f9fe6dc1e2 req-6d1b7dfe-f627-4a7f-b22f-9d49a9350395 service nova] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Received event network-vif-deleted-ccc3c5f4-a0e1-4844-a193-b56945bf71a2 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:51:50 user nova-compute[72239]: WARNING nova.volume.cinder [None req-f0d38a34-b6c0-4d3c-9ce6-1e0b898456f0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Attachment db4df2d6-756c-4007-8219-c5f066a12fc1 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = db4df2d6-756c-4007-8219-c5f066a12fc1. (HTTP 404) (Request-ID: req-a962cf04-717b-4d07-a658-24dd5bb28b72)
Jul 31 14:51:50 user nova-compute[72239]: INFO nova.compute.manager [None req-f0d38a34-b6c0-4d3c-9ce6-1e0b898456f0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Took 0.03 seconds to detach 1 volumes for instance.
Jul 31 14:51:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f0d38a34-b6c0-4d3c-9ce6-1e0b898456f0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:51:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f0d38a34-b6c0-4d3c-9ce6-1e0b898456f0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:51:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:50 user nova-compute[72239]: DEBUG nova.compute.manager [req-5104f2f3-09dc-477c-82bd-2507f8c5f3f4 req-b9d50c16-5b30-4c87-81dd-09a7f986dad8 service nova] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Received event network-vif-plugged-ccc3c5f4-a0e1-4844-a193-b56945bf71a2 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:51:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5104f2f3-09dc-477c-82bd-2507f8c5f3f4 req-b9d50c16-5b30-4c87-81dd-09a7f986dad8 service nova] Acquiring lock "1e626a09-1282-4864-8336-6720c7caa0da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:51:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5104f2f3-09dc-477c-82bd-2507f8c5f3f4 req-b9d50c16-5b30-4c87-81dd-09a7f986dad8 service nova] Lock "1e626a09-1282-4864-8336-6720c7caa0da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:51:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5104f2f3-09dc-477c-82bd-2507f8c5f3f4 req-b9d50c16-5b30-4c87-81dd-09a7f986dad8 service nova] Lock "1e626a09-1282-4864-8336-6720c7caa0da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:51:50 user nova-compute[72239]: DEBUG nova.compute.manager [req-5104f2f3-09dc-477c-82bd-2507f8c5f3f4 req-b9d50c16-5b30-4c87-81dd-09a7f986dad8 service nova] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] No waiting events found dispatching network-vif-plugged-ccc3c5f4-a0e1-4844-a193-b56945bf71a2 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:51:50 user nova-compute[72239]: WARNING nova.compute.manager [req-5104f2f3-09dc-477c-82bd-2507f8c5f3f4 req-b9d50c16-5b30-4c87-81dd-09a7f986dad8 service nova] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Received unexpected event network-vif-plugged-ccc3c5f4-a0e1-4844-a193-b56945bf71a2 for instance with vm_state deleted and task_state None.
Jul 31 14:51:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:51 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-f0d38a34-b6c0-4d3c-9ce6-1e0b898456f0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:51:51 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-f0d38a34-b6c0-4d3c-9ce6-1e0b898456f0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:51:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f0d38a34-b6c0-4d3c-9ce6-1e0b898456f0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.383s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:51:51 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-f0d38a34-b6c0-4d3c-9ce6-1e0b898456f0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Deleted allocations for instance 1e626a09-1282-4864-8336-6720c7caa0da
Jul 31 14:51:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f0d38a34-b6c0-4d3c-9ce6-1e0b898456f0 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "1e626a09-1282-4864-8336-6720c7caa0da" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.871s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:51:52 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815112.4251502, 14653984-6c32-4ddd-bc0b-203a670c2b4e => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:51:52 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] VM Resumed (Lifecycle Event)
Jul 31 14:51:52 user nova-compute[72239]: DEBUG nova.compute.manager [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:51:52 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 14:51:52 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Instance spawned successfully.
Jul 31 14:51:52 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 14:51:52 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:51:52 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:51:52 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:51:52 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:51:52 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:51:52 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:51:52 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:51:52 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:51:52 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:51:52 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815112.428501, 14653984-6c32-4ddd-bc0b-203a670c2b4e => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:51:52 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] VM Started (Lifecycle Event)
Jul 31 14:51:52 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:51:52 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:51:52 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:51:52 user nova-compute[72239]: INFO nova.compute.manager [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Took 5.77 seconds to spawn the instance on the hypervisor.
Jul 31 14:51:52 user nova-compute[72239]: DEBUG nova.compute.manager [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:51:52 user nova-compute[72239]: DEBUG nova.compute.manager [req-6b1b7ed6-41d8-49ad-bf47-858bae7e3852 req-3c8664a8-6238-4865-8db8-abd2fa3fdd11 service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Received event network-vif-plugged-b1b01e63-209d-4388-a81d-eb17afdf0db4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:51:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-6b1b7ed6-41d8-49ad-bf47-858bae7e3852 req-3c8664a8-6238-4865-8db8-abd2fa3fdd11 service nova] Acquiring lock "14653984-6c32-4ddd-bc0b-203a670c2b4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:51:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-6b1b7ed6-41d8-49ad-bf47-858bae7e3852 req-3c8664a8-6238-4865-8db8-abd2fa3fdd11 service nova] Lock "14653984-6c32-4ddd-bc0b-203a670c2b4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:51:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-6b1b7ed6-41d8-49ad-bf47-858bae7e3852 req-3c8664a8-6238-4865-8db8-abd2fa3fdd11 service nova] Lock "14653984-6c32-4ddd-bc0b-203a670c2b4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:51:52 user nova-compute[72239]: DEBUG nova.compute.manager [req-6b1b7ed6-41d8-49ad-bf47-858bae7e3852 req-3c8664a8-6238-4865-8db8-abd2fa3fdd11 service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] No waiting events found dispatching network-vif-plugged-b1b01e63-209d-4388-a81d-eb17afdf0db4 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:51:52 user nova-compute[72239]: WARNING nova.compute.manager [req-6b1b7ed6-41d8-49ad-bf47-858bae7e3852 req-3c8664a8-6238-4865-8db8-abd2fa3fdd11 service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Received unexpected event network-vif-plugged-b1b01e63-209d-4388-a81d-eb17afdf0db4 for instance with vm_state building and task_state spawning.
Jul 31 14:51:52 user nova-compute[72239]: INFO nova.compute.manager [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Took 6.53 seconds to build instance.
Jul 31 14:51:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f94eb664-3000-4e1f-8da4-1c6d069cac6d tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "14653984-6c32-4ddd-bc0b-203a670c2b4e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.653s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:51:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:55 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690815100.6009033, 97917500-bc78-433b-8d3d-181ed13667dc => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:51:55 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] VM Stopped (Lifecycle Event)
Jul 31 14:51:55 user nova-compute[72239]: DEBUG nova.compute.manager [None req-befab4da-7618-4a77-a0b3-c90ef078b324 None None] [instance: 97917500-bc78-433b-8d3d-181ed13667dc] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:51:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:51:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:00 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:52:00 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:52:00 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:52:00 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:52:02 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:52:02 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 14:52:02 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Rebuilding the list of instances to heal {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 14:52:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-20abf743-de5b-4122-aad0-e2124c7804b7" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:52:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-20abf743-de5b-4122-aad0-e2124c7804b7" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:52:02 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 14:52:02 user nova-compute[72239]: DEBUG nova.objects.instance [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lazy-loading 'info_cache' on Instance uuid 20abf743-de5b-4122-aad0-e2124c7804b7 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:52:02 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Updating instance_info_cache with network_info: [{"id": "025cadd3-7b0b-4a32-a973-d48a5ce7cfb4", "address": "fa:16:3e:5e:74:46", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap025cadd3-7b", "ovs_interfaceid": "025cadd3-7b0b-4a32-a973-d48a5ce7cfb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:52:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-20abf743-de5b-4122-aad0-e2124c7804b7" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:52:02 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 14:52:02 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:52:02 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:52:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:52:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:52:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:52:03 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 14:52:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:03 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:52:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:04 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690815109.6321738, 1e626a09-1282-4864-8336-6720c7caa0da => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:52:04 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] VM Stopped (Lifecycle Event)
Jul 31 14:52:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:04 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:52:04 user nova-compute[72239]: DEBUG nova.compute.manager [None req-47c70862-693b-4d02-bb93-01d5fda1f1bb None None] [instance: 1e626a09-1282-4864-8336-6720c7caa0da] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:52:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:04 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:52:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2393ac0e-4b6c-429e-a73e-a395e79031e0/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2393ac0e-4b6c-429e-a73e-a395e79031e0/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2393ac0e-4b6c-429e-a73e-a395e79031e0/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2393ac0e-4b6c-429e-a73e-a395e79031e0/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:06 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:52:06 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:52:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=7455MB free_disk=25.347606658935547GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 14:52:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:52:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:52:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 20abf743-de5b-4122-aad0-e2124c7804b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:52:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 7d81b881-b44e-4fb3-8245-9dea634bdec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:52:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 079a5ed7-ee25-495b-a2a4-924d830a670a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:52:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 82116af8-3702-401b-8d00-9291d4caeb03 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:52:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 2f11022e-a007-4d4c-adc1-b54ea59b9e6a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:52:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance d3e3612b-c6b9-4308-a45a-1ff3805e18bb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:52:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance c10918e9-9731-48ea-860e-8a02cb6a0ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:52:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance db15ad45-8f28-4e0c-8d7e-7db75f33fe92 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:52:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 2393ac0e-4b6c-429e-a73e-a395e79031e0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:52:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 14653984-6c32-4ddd-bc0b-203a670c2b4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:52:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 14:52:06 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 14:52:06 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:52:06 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:52:07 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 14:52:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.462s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:52:07 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:52:07 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:52:07 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:52:07 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 14:52:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6074a59e-7cb9-4b56-97c7-dc709f5d2503 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Acquiring lock "2393ac0e-4b6c-429e-a73e-a395e79031e0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:52:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6074a59e-7cb9-4b56-97c7-dc709f5d2503 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Lock "2393ac0e-4b6c-429e-a73e-a395e79031e0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:52:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6074a59e-7cb9-4b56-97c7-dc709f5d2503 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Acquiring lock "2393ac0e-4b6c-429e-a73e-a395e79031e0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:52:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6074a59e-7cb9-4b56-97c7-dc709f5d2503 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Lock "2393ac0e-4b6c-429e-a73e-a395e79031e0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:52:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6074a59e-7cb9-4b56-97c7-dc709f5d2503 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Lock "2393ac0e-4b6c-429e-a73e-a395e79031e0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:52:19 user nova-compute[72239]: INFO nova.compute.manager [None req-6074a59e-7cb9-4b56-97c7-dc709f5d2503 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Terminating instance
Jul 31 14:52:19 user nova-compute[72239]: DEBUG nova.compute.manager [None req-6074a59e-7cb9-4b56-97c7-dc709f5d2503 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 14:52:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-b0bcc7e6-9f34-4e57-9dfe-27bae896dd96 req-38e6df71-2773-42d1-82d6-71e1e5c96a6a service nova] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Received event network-vif-unplugged-db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:52:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b0bcc7e6-9f34-4e57-9dfe-27bae896dd96 req-38e6df71-2773-42d1-82d6-71e1e5c96a6a service nova] Acquiring lock "2393ac0e-4b6c-429e-a73e-a395e79031e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:52:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b0bcc7e6-9f34-4e57-9dfe-27bae896dd96 req-38e6df71-2773-42d1-82d6-71e1e5c96a6a service nova] Lock "2393ac0e-4b6c-429e-a73e-a395e79031e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:52:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b0bcc7e6-9f34-4e57-9dfe-27bae896dd96 req-38e6df71-2773-42d1-82d6-71e1e5c96a6a service nova] Lock "2393ac0e-4b6c-429e-a73e-a395e79031e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:52:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-b0bcc7e6-9f34-4e57-9dfe-27bae896dd96 req-38e6df71-2773-42d1-82d6-71e1e5c96a6a service nova] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] No waiting events found dispatching network-vif-unplugged-db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:52:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-b0bcc7e6-9f34-4e57-9dfe-27bae896dd96 req-38e6df71-2773-42d1-82d6-71e1e5c96a6a service nova] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Received event network-vif-unplugged-db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 14:52:19 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Instance destroyed successfully.
Jul 31 14:52:19 user nova-compute[72239]: DEBUG nova.objects.instance [None req-6074a59e-7cb9-4b56-97c7-dc709f5d2503 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Lazy-loading 'resources' on Instance uuid 2393ac0e-4b6c-429e-a73e-a395e79031e0 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:52:19 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-6074a59e-7cb9-4b56-97c7-dc709f5d2503 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:50:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1861214242',display_name='tempest-VolumesActionsTest-instance-1861214242',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1861214242',id=19,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:50:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a74501c9a7e4063b3f84e4bf0f15559',ramdisk_id='',reservation_id='r-jgw0i7tx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-200342881',owner_user_name='tempest-VolumesActionsTest-200342881-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:50:36Z,user_data=None,user_id='fb45b0c1b7404ad2835ebab1ca3b4ff6',uuid=2393ac0e-4b6c-429e-a73e-a395e79031e0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c", "address": "fa:16:3e:0d:4d:56", "network": {"id": "bcfa9b25-4156-49df-8aa7-70f499ea3479", "bridge": "br-int", "label": "tempest-VolumesActionsTest-203290973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a74501c9a7e4063b3f84e4bf0f15559", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7aebe9-bd", "ovs_interfaceid": "db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:52:19 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-6074a59e-7cb9-4b56-97c7-dc709f5d2503 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Converting VIF {"id": "db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c", "address": "fa:16:3e:0d:4d:56", "network": {"id": "bcfa9b25-4156-49df-8aa7-70f499ea3479", "bridge": "br-int", "label": "tempest-VolumesActionsTest-203290973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a74501c9a7e4063b3f84e4bf0f15559", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb7aebe9-bd", "ovs_interfaceid": "db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:52:19 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-6074a59e-7cb9-4b56-97c7-dc709f5d2503 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:4d:56,bridge_name='br-int',has_traffic_filtering=True,id=db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c,network=Network(bcfa9b25-4156-49df-8aa7-70f499ea3479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb7aebe9-bd') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:52:19 user nova-compute[72239]: DEBUG os_vif [None req-6074a59e-7cb9-4b56-97c7-dc709f5d2503 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:4d:56,bridge_name='br-int',has_traffic_filtering=True,id=db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c,network=Network(bcfa9b25-4156-49df-8aa7-70f499ea3479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb7aebe9-bd') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:52:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb7aebe9-bd, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:52:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:52:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:19 user nova-compute[72239]: INFO os_vif [None req-6074a59e-7cb9-4b56-97c7-dc709f5d2503 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:4d:56,bridge_name='br-int',has_traffic_filtering=True,id=db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c,network=Network(bcfa9b25-4156-49df-8aa7-70f499ea3479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb7aebe9-bd')
Jul 31 14:52:19 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-6074a59e-7cb9-4b56-97c7-dc709f5d2503 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Deleting instance files /opt/stack/data/nova/instances/2393ac0e-4b6c-429e-a73e-a395e79031e0_del
Jul 31 14:52:19 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-6074a59e-7cb9-4b56-97c7-dc709f5d2503 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Deletion of /opt/stack/data/nova/instances/2393ac0e-4b6c-429e-a73e-a395e79031e0_del complete
Jul 31 14:52:20 user nova-compute[72239]: INFO nova.compute.manager [None req-6074a59e-7cb9-4b56-97c7-dc709f5d2503 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Took 0.66 seconds to destroy the instance on the hypervisor.
Jul 31 14:52:20 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-6074a59e-7cb9-4b56-97c7-dc709f5d2503 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 14:52:20 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 14:52:20 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 14:52:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:20 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:52:20 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Took 0.57 seconds to deallocate network for instance.
Jul 31 14:52:20 user nova-compute[72239]: DEBUG nova.compute.manager [req-f9c08457-e4db-46a0-a3e7-1f4b169774fb req-9591926e-4947-4d77-a7a3-dfc44db0a7a8 service nova] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Received event network-vif-deleted-db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:52:20 user nova-compute[72239]: INFO nova.compute.manager [req-f9c08457-e4db-46a0-a3e7-1f4b169774fb req-9591926e-4947-4d77-a7a3-dfc44db0a7a8 service nova] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Neutron deleted interface db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c; detaching it from the instance and deleting it from the info cache
Jul 31 14:52:20 user nova-compute[72239]: DEBUG nova.network.neutron [req-f9c08457-e4db-46a0-a3e7-1f4b169774fb req-9591926e-4947-4d77-a7a3-dfc44db0a7a8 service nova] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:52:20 user nova-compute[72239]: DEBUG nova.compute.manager [req-f9c08457-e4db-46a0-a3e7-1f4b169774fb req-9591926e-4947-4d77-a7a3-dfc44db0a7a8 service nova] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Detach interface failed, port_id=db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c, reason: Instance 2393ac0e-4b6c-429e-a73e-a395e79031e0 could not be found. {{(pid=72239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 14:52:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6074a59e-7cb9-4b56-97c7-dc709f5d2503 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:52:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6074a59e-7cb9-4b56-97c7-dc709f5d2503 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:52:20 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-6074a59e-7cb9-4b56-97c7-dc709f5d2503 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:52:20 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-6074a59e-7cb9-4b56-97c7-dc709f5d2503 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:52:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6074a59e-7cb9-4b56-97c7-dc709f5d2503 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.295s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:52:20 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-6074a59e-7cb9-4b56-97c7-dc709f5d2503 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Deleted allocations for instance 2393ac0e-4b6c-429e-a73e-a395e79031e0
Jul 31 14:52:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6074a59e-7cb9-4b56-97c7-dc709f5d2503 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Lock "2393ac0e-4b6c-429e-a73e-a395e79031e0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.690s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:52:22 user nova-compute[72239]: DEBUG nova.compute.manager [req-436750d2-8337-4704-89c2-37aad9524961 req-4dbff298-ad8b-452a-8a71-ed027a5de090 service nova] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Received event network-vif-plugged-db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:52:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-436750d2-8337-4704-89c2-37aad9524961 req-4dbff298-ad8b-452a-8a71-ed027a5de090 service nova] Acquiring lock "2393ac0e-4b6c-429e-a73e-a395e79031e0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:52:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-436750d2-8337-4704-89c2-37aad9524961 req-4dbff298-ad8b-452a-8a71-ed027a5de090 service nova] Lock "2393ac0e-4b6c-429e-a73e-a395e79031e0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:52:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-436750d2-8337-4704-89c2-37aad9524961 req-4dbff298-ad8b-452a-8a71-ed027a5de090 service nova] Lock "2393ac0e-4b6c-429e-a73e-a395e79031e0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:52:22 user nova-compute[72239]: DEBUG nova.compute.manager [req-436750d2-8337-4704-89c2-37aad9524961 req-4dbff298-ad8b-452a-8a71-ed027a5de090 service nova] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] No waiting events found dispatching network-vif-plugged-db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:52:22 user nova-compute[72239]: WARNING nova.compute.manager [req-436750d2-8337-4704-89c2-37aad9524961 req-4dbff298-ad8b-452a-8a71-ed027a5de090 service nova] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Received unexpected event network-vif-plugged-db7aebe9-bde8-4f67-b9de-f47c8c7a6d6c for instance with vm_state deleted and task_state None.
Jul 31 14:52:24 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:24 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "c2b3c85b-e939-41d0-8bf0-3a7f650177b2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:52:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "c2b3c85b-e939-41d0-8bf0-3a7f650177b2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:52:30 user nova-compute[72239]: DEBUG nova.compute.manager [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 14:52:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:52:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:52:30 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 14:52:30 user nova-compute[72239]: INFO nova.compute.claims [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Claim successful on node user
Jul 31 14:52:30 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:52:30 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:52:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.424s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:52:30 user nova-compute[72239]: DEBUG nova.compute.manager [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 14:52:31 user nova-compute[72239]: DEBUG nova.compute.manager [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 14:52:31 user nova-compute[72239]: DEBUG nova.network.neutron [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 14:52:31 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 14:52:31 user nova-compute[72239]: DEBUG nova.compute.manager [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 14:52:31 user nova-compute[72239]: DEBUG nova.policy [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '94ab9298205143d489f678b28be5b085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8281237f9c417a9685e55826911e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 14:52:31 user nova-compute[72239]: DEBUG nova.compute.manager [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 14:52:31 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 14:52:31 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Creating image(s)
Jul 31 14:52:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "/opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:52:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "/opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:52:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "/opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:52:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.134s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "ca449065000c92aac3b7b9fa685f9a7710929444" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:52:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:52:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.134s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk 1073741824" returned: 0 in 0.052s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.192s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:52:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.137s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:31 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 14:52:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:31 user nova-compute[72239]: DEBUG nova.network.neutron [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Successfully created port: 59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00 {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:52:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:31 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Cannot resize image /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 14:52:31 user nova-compute[72239]: DEBUG nova.objects.instance [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lazy-loading 'migration_context' on Instance uuid c2b3c85b-e939-41d0-8bf0-3a7f650177b2 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:52:31 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 14:52:31 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Ensure instance console log exists: /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 14:52:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:52:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:52:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:52:32 user nova-compute[72239]: DEBUG nova.network.neutron [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Successfully updated port: 59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00 {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:52:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "refresh_cache-c2b3c85b-e939-41d0-8bf0-3a7f650177b2" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:52:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquired lock "refresh_cache-c2b3c85b-e939-41d0-8bf0-3a7f650177b2" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:52:32 user nova-compute[72239]: DEBUG nova.network.neutron [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:52:32 user nova-compute[72239]: DEBUG nova.compute.manager [req-a95ded61-1a88-4c0a-bf72-489e166264c0 req-a3f635bf-5857-46ae-9e0e-675f1228749b service nova] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Received event network-changed-59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:52:32 user nova-compute[72239]: DEBUG nova.compute.manager [req-a95ded61-1a88-4c0a-bf72-489e166264c0 req-a3f635bf-5857-46ae-9e0e-675f1228749b service nova] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Refreshing instance network info cache due to event network-changed-59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:52:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a95ded61-1a88-4c0a-bf72-489e166264c0 req-a3f635bf-5857-46ae-9e0e-675f1228749b service nova] Acquiring lock "refresh_cache-c2b3c85b-e939-41d0-8bf0-3a7f650177b2" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:52:32 user nova-compute[72239]: DEBUG nova.network.neutron [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG nova.network.neutron [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Updating instance_info_cache with network_info: [{"id": "59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00", "address": "fa:16:3e:d6:c0:2b", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59b0c9f3-1d", "ovs_interfaceid": "59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Releasing lock "refresh_cache-c2b3c85b-e939-41d0-8bf0-3a7f650177b2" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG nova.compute.manager [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Instance network_info: |[{"id": "59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00", "address": "fa:16:3e:d6:c0:2b", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59b0c9f3-1d", "ovs_interfaceid": "59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a95ded61-1a88-4c0a-bf72-489e166264c0 req-a3f635bf-5857-46ae-9e0e-675f1228749b service nova] Acquired lock "refresh_cache-c2b3c85b-e939-41d0-8bf0-3a7f650177b2" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG nova.network.neutron [req-a95ded61-1a88-4c0a-bf72-489e166264c0 req-a3f635bf-5857-46ae-9e0e-675f1228749b service nova] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Refreshing network info cache for port 59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Start _get_guest_xml network_info=[{"id": "59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00", "address": "fa:16:3e:d6:c0:2b", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59b0c9f3-1d", "ovs_interfaceid": "59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:52:33 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:52:33 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:52:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:52:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2037494155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2037494155',id=21,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d8281237f9c417a9685e55826911e1b',ramdisk_id='',reservation_id='r-o0d96zhs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-148379254',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:52:31Z,user_data=None,user_id='94ab9298205143d489f678b28be5b085',uuid=c2b3c85b-e939-41d0-8bf0-3a7f650177b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00", "address": "fa:16:3e:d6:c0:2b", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59b0c9f3-1d", "ovs_interfaceid": "59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Converting VIF {"id": "59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00", "address": "fa:16:3e:d6:c0:2b", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59b0c9f3-1d", "ovs_interfaceid": "59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:c0:2b,bridge_name='br-int',has_traffic_filtering=True,id=59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00,network=Network(172fb80f-4bbe-4706-91cf-60540fbceb2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59b0c9f3-1d') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG nova.objects.instance [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lazy-loading 'pci_devices' on Instance uuid c2b3c85b-e939-41d0-8bf0-3a7f650177b2 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:52:33 user nova-compute[72239]:   <uuid>c2b3c85b-e939-41d0-8bf0-3a7f650177b2</uuid>
Jul 31 14:52:33 user nova-compute[72239]:   <name>instance-00000015</name>
Jul 31 14:52:33 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:52:33 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:52:33 user nova-compute[72239]:   <metadata>
Jul 31 14:52:33 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:52:33 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:52:33 user nova-compute[72239]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2037494155</nova:name>
Jul 31 14:52:33 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:52:33</nova:creationTime>
Jul 31 14:52:33 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:52:33 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:52:33 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:52:33 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:52:33 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:52:33 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:52:33 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:52:33 user nova-compute[72239]:       <nova:owner>
Jul 31 14:52:33 user nova-compute[72239]:         <nova:user uuid="94ab9298205143d489f678b28be5b085">tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member</nova:user>
Jul 31 14:52:33 user nova-compute[72239]:         <nova:project uuid="1d8281237f9c417a9685e55826911e1b">tempest-ServerBootFromVolumeStableRescueTest-148379254</nova:project>
Jul 31 14:52:33 user nova-compute[72239]:       </nova:owner>
Jul 31 14:52:33 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:52:33 user nova-compute[72239]:       <nova:ports>
Jul 31 14:52:33 user nova-compute[72239]:         <nova:port uuid="59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00">
Jul 31 14:52:33 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 31 14:52:33 user nova-compute[72239]:         </nova:port>
Jul 31 14:52:33 user nova-compute[72239]:       </nova:ports>
Jul 31 14:52:33 user nova-compute[72239]:     </nova:instance>
Jul 31 14:52:33 user nova-compute[72239]:   </metadata>
Jul 31 14:52:33 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:52:33 user nova-compute[72239]:     <system>
Jul 31 14:52:33 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:52:33 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:52:33 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:52:33 user nova-compute[72239]:       <entry name="serial">c2b3c85b-e939-41d0-8bf0-3a7f650177b2</entry>
Jul 31 14:52:33 user nova-compute[72239]:       <entry name="uuid">c2b3c85b-e939-41d0-8bf0-3a7f650177b2</entry>
Jul 31 14:52:33 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:52:33 user nova-compute[72239]:     </system>
Jul 31 14:52:33 user nova-compute[72239]:   </sysinfo>
Jul 31 14:52:33 user nova-compute[72239]:   <os>
Jul 31 14:52:33 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:52:33 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:52:33 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:52:33 user nova-compute[72239]:   </os>
Jul 31 14:52:33 user nova-compute[72239]:   <features>
Jul 31 14:52:33 user nova-compute[72239]:     <acpi/>
Jul 31 14:52:33 user nova-compute[72239]:     <apic/>
Jul 31 14:52:33 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:52:33 user nova-compute[72239]:   </features>
Jul 31 14:52:33 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:52:33 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:52:33 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:52:33 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:52:33 user nova-compute[72239]:   </clock>
Jul 31 14:52:33 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:52:33 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:52:33 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:52:33 user nova-compute[72239]:   </cpu>
Jul 31 14:52:33 user nova-compute[72239]:   <devices>
Jul 31 14:52:33 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:52:33 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:52:33 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk"/>
Jul 31 14:52:33 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:52:33 user nova-compute[72239]:     </disk>
Jul 31 14:52:33 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:52:33 user nova-compute[72239]:       <mac address="fa:16:3e:d6:c0:2b"/>
Jul 31 14:52:33 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:52:33 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:52:33 user nova-compute[72239]:       <target dev="tap59b0c9f3-1d"/>
Jul 31 14:52:33 user nova-compute[72239]:     </interface>
Jul 31 14:52:33 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:52:33 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/console.log" append="off"/>
Jul 31 14:52:33 user nova-compute[72239]:     </serial>
Jul 31 14:52:33 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:52:33 user nova-compute[72239]:     <video>
Jul 31 14:52:33 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:52:33 user nova-compute[72239]:     </video>
Jul 31 14:52:33 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:52:33 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:52:33 user nova-compute[72239]:     </rng>
Jul 31 14:52:33 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:52:33 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:52:33 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:52:33 user nova-compute[72239]:     </memballoon>
Jul 31 14:52:33 user nova-compute[72239]:   </devices>
Jul 31 14:52:33 user nova-compute[72239]: </domain>
Jul 31 14:52:33 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:52:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2037494155',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2037494155',id=21,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d8281237f9c417a9685e55826911e1b',ramdisk_id='',reservation_id='r-o0d96zhs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-148379254',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:52:31Z,user_data=None,user_id='94ab9298205143d489f678b28be5b085',uuid=c2b3c85b-e939-41d0-8bf0-3a7f650177b2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00", "address": "fa:16:3e:d6:c0:2b", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59b0c9f3-1d", "ovs_interfaceid": "59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Converting VIF {"id": "59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00", "address": "fa:16:3e:d6:c0:2b", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59b0c9f3-1d", "ovs_interfaceid": "59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:c0:2b,bridge_name='br-int',has_traffic_filtering=True,id=59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00,network=Network(172fb80f-4bbe-4706-91cf-60540fbceb2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59b0c9f3-1d') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG os_vif [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:c0:2b,bridge_name='br-int',has_traffic_filtering=True,id=59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00,network=Network(172fb80f-4bbe-4706-91cf-60540fbceb2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59b0c9f3-1d') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap59b0c9f3-1d, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap59b0c9f3-1d, col_values=(('external_ids', {'iface-id': '59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:c0:2b', 'vm-uuid': 'c2b3c85b-e939-41d0-8bf0-3a7f650177b2'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:33 user nova-compute[72239]: INFO os_vif [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:c0:2b,bridge_name='br-int',has_traffic_filtering=True,id=59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00,network=Network(172fb80f-4bbe-4706-91cf-60540fbceb2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59b0c9f3-1d')
Jul 31 14:52:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] No VIF found with MAC fa:16:3e:d6:c0:2b, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG nova.network.neutron [req-a95ded61-1a88-4c0a-bf72-489e166264c0 req-a3f635bf-5857-46ae-9e0e-675f1228749b service nova] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Updated VIF entry in instance network info cache for port 59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG nova.network.neutron [req-a95ded61-1a88-4c0a-bf72-489e166264c0 req-a3f635bf-5857-46ae-9e0e-675f1228749b service nova] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Updating instance_info_cache with network_info: [{"id": "59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00", "address": "fa:16:3e:d6:c0:2b", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59b0c9f3-1d", "ovs_interfaceid": "59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:52:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a95ded61-1a88-4c0a-bf72-489e166264c0 req-a3f635bf-5857-46ae-9e0e-675f1228749b service nova] Releasing lock "refresh_cache-c2b3c85b-e939-41d0-8bf0-3a7f650177b2" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:52:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:34 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690815139.9076264, 2393ac0e-4b6c-429e-a73e-a395e79031e0 => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:52:34 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] VM Stopped (Lifecycle Event)
Jul 31 14:52:34 user nova-compute[72239]: DEBUG nova.compute.manager [None req-8e16f229-c639-4477-9a50-4f93171d2527 None None] [instance: 2393ac0e-4b6c-429e-a73e-a395e79031e0] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:52:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:35 user nova-compute[72239]: DEBUG nova.compute.manager [req-d1b977e1-a13c-485c-b241-e84d9f0e240e req-fd210bb2-895e-4342-ba6f-13d8c921fd94 service nova] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Received event network-vif-plugged-59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:52:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d1b977e1-a13c-485c-b241-e84d9f0e240e req-fd210bb2-895e-4342-ba6f-13d8c921fd94 service nova] Acquiring lock "c2b3c85b-e939-41d0-8bf0-3a7f650177b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:52:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d1b977e1-a13c-485c-b241-e84d9f0e240e req-fd210bb2-895e-4342-ba6f-13d8c921fd94 service nova] Lock "c2b3c85b-e939-41d0-8bf0-3a7f650177b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:52:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d1b977e1-a13c-485c-b241-e84d9f0e240e req-fd210bb2-895e-4342-ba6f-13d8c921fd94 service nova] Lock "c2b3c85b-e939-41d0-8bf0-3a7f650177b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:52:35 user nova-compute[72239]: DEBUG nova.compute.manager [req-d1b977e1-a13c-485c-b241-e84d9f0e240e req-fd210bb2-895e-4342-ba6f-13d8c921fd94 service nova] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] No waiting events found dispatching network-vif-plugged-59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:52:35 user nova-compute[72239]: WARNING nova.compute.manager [req-d1b977e1-a13c-485c-b241-e84d9f0e240e req-fd210bb2-895e-4342-ba6f-13d8c921fd94 service nova] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Received unexpected event network-vif-plugged-59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00 for instance with vm_state building and task_state spawning.
Jul 31 14:52:36 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815156.9327266, c2b3c85b-e939-41d0-8bf0-3a7f650177b2 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:52:36 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] VM Resumed (Lifecycle Event)
Jul 31 14:52:36 user nova-compute[72239]: DEBUG nova.compute.manager [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:52:36 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 14:52:36 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Instance spawned successfully.
Jul 31 14:52:36 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 14:52:36 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:52:36 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:52:36 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:52:36 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:52:36 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:52:36 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:52:36 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:52:36 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:52:36 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:52:36 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815156.9340773, c2b3c85b-e939-41d0-8bf0-3a7f650177b2 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:52:36 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] VM Started (Lifecycle Event)
Jul 31 14:52:37 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:52:37 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:52:37 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:52:37 user nova-compute[72239]: INFO nova.compute.manager [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Took 5.87 seconds to spawn the instance on the hypervisor.
Jul 31 14:52:37 user nova-compute[72239]: DEBUG nova.compute.manager [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:52:37 user nova-compute[72239]: DEBUG nova.compute.manager [req-15bf240d-5c8f-4a38-99b4-d0ffcb552463 req-1fb2af96-05d8-464a-8858-d94166852972 service nova] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Received event network-vif-plugged-59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:52:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-15bf240d-5c8f-4a38-99b4-d0ffcb552463 req-1fb2af96-05d8-464a-8858-d94166852972 service nova] Acquiring lock "c2b3c85b-e939-41d0-8bf0-3a7f650177b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:52:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-15bf240d-5c8f-4a38-99b4-d0ffcb552463 req-1fb2af96-05d8-464a-8858-d94166852972 service nova] Lock "c2b3c85b-e939-41d0-8bf0-3a7f650177b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:52:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-15bf240d-5c8f-4a38-99b4-d0ffcb552463 req-1fb2af96-05d8-464a-8858-d94166852972 service nova] Lock "c2b3c85b-e939-41d0-8bf0-3a7f650177b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:52:37 user nova-compute[72239]: DEBUG nova.compute.manager [req-15bf240d-5c8f-4a38-99b4-d0ffcb552463 req-1fb2af96-05d8-464a-8858-d94166852972 service nova] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] No waiting events found dispatching network-vif-plugged-59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:52:37 user nova-compute[72239]: WARNING nova.compute.manager [req-15bf240d-5c8f-4a38-99b4-d0ffcb552463 req-1fb2af96-05d8-464a-8858-d94166852972 service nova] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Received unexpected event network-vif-plugged-59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00 for instance with vm_state building and task_state spawning.
Jul 31 14:52:37 user nova-compute[72239]: INFO nova.compute.manager [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Took 6.67 seconds to build instance.
Jul 31 14:52:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-45b839cb-5af5-40e0-8213-3ca17ec432d1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "c2b3c85b-e939-41d0-8bf0-3a7f650177b2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.793s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:52:38 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "3559f541-ed61-41b2-9a9d-8b10e18f7375" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:52:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "3559f541-ed61-41b2-9a9d-8b10e18f7375" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:52:42 user nova-compute[72239]: DEBUG nova.compute.manager [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 14:52:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:52:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:52:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 14:52:42 user nova-compute[72239]: INFO nova.compute.claims [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Claim successful on node user
Jul 31 14:52:42 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:52:42 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:52:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.511s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:52:42 user nova-compute[72239]: DEBUG nova.compute.manager [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 14:52:42 user nova-compute[72239]: DEBUG nova.compute.manager [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 14:52:42 user nova-compute[72239]: DEBUG nova.network.neutron [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 14:52:42 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 14:52:42 user nova-compute[72239]: DEBUG nova.compute.manager [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 14:52:43 user nova-compute[72239]: DEBUG nova.policy [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f10fd7b9c1d34ca5b37150f34ea09ffa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '959107d575f04ba2b0ac800ed2ef61fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 14:52:43 user nova-compute[72239]: DEBUG nova.compute.manager [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 14:52:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 14:52:43 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Creating image(s)
Jul 31 14:52:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "/opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:52:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "/opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:52:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "/opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:52:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.169s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "ca449065000c92aac3b7b9fa685f9a7710929444" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:52:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:52:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.166s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk 1073741824" returned: 0 in 0.055s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:52:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.172s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:43 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 14:52:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:43 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Cannot resize image /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 14:52:43 user nova-compute[72239]: DEBUG nova.objects.instance [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lazy-loading 'migration_context' on Instance uuid 3559f541-ed61-41b2-9a9d-8b10e18f7375 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:52:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 14:52:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Ensure instance console log exists: /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 14:52:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:52:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:52:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:52:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:44 user nova-compute[72239]: DEBUG nova.network.neutron [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Successfully created port: a7009a29-6a23-4d7d-a2ff-046c040e5b73 {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:52:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG nova.network.neutron [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Successfully updated port: a7009a29-6a23-4d7d-a2ff-046c040e5b73 {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "refresh_cache-3559f541-ed61-41b2-9a9d-8b10e18f7375" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquired lock "refresh_cache-3559f541-ed61-41b2-9a9d-8b10e18f7375" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG nova.network.neutron [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG nova.compute.manager [req-3358d2ce-7ad6-44f8-96ce-afbd90ece753 req-fa671a05-94fe-43ad-a029-6e8588a0f882 service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Received event network-changed-a7009a29-6a23-4d7d-a2ff-046c040e5b73 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG nova.compute.manager [req-3358d2ce-7ad6-44f8-96ce-afbd90ece753 req-fa671a05-94fe-43ad-a029-6e8588a0f882 service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Refreshing instance network info cache due to event network-changed-a7009a29-6a23-4d7d-a2ff-046c040e5b73. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-3358d2ce-7ad6-44f8-96ce-afbd90ece753 req-fa671a05-94fe-43ad-a029-6e8588a0f882 service nova] Acquiring lock "refresh_cache-3559f541-ed61-41b2-9a9d-8b10e18f7375" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG nova.network.neutron [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG nova.network.neutron [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Updating instance_info_cache with network_info: [{"id": "a7009a29-6a23-4d7d-a2ff-046c040e5b73", "address": "fa:16:3e:f5:e4:b4", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7009a29-6a", "ovs_interfaceid": "a7009a29-6a23-4d7d-a2ff-046c040e5b73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Releasing lock "refresh_cache-3559f541-ed61-41b2-9a9d-8b10e18f7375" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG nova.compute.manager [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Instance network_info: |[{"id": "a7009a29-6a23-4d7d-a2ff-046c040e5b73", "address": "fa:16:3e:f5:e4:b4", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7009a29-6a", "ovs_interfaceid": "a7009a29-6a23-4d7d-a2ff-046c040e5b73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-3358d2ce-7ad6-44f8-96ce-afbd90ece753 req-fa671a05-94fe-43ad-a029-6e8588a0f882 service nova] Acquired lock "refresh_cache-3559f541-ed61-41b2-9a9d-8b10e18f7375" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG nova.network.neutron [req-3358d2ce-7ad6-44f8-96ce-afbd90ece753 req-fa671a05-94fe-43ad-a029-6e8588a0f882 service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Refreshing network info cache for port a7009a29-6a23-4d7d-a2ff-046c040e5b73 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Start _get_guest_xml network_info=[{"id": "a7009a29-6a23-4d7d-a2ff-046c040e5b73", "address": "fa:16:3e:f5:e4:b4", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7009a29-6a", "ovs_interfaceid": "a7009a29-6a23-4d7d-a2ff-046c040e5b73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:52:46 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:52:46 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:52:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:52:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1636003015',display_name='tempest-ServerRescueNegativeTestJSON-server-1636003015',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1636003015',id=22,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK59e+d5JqumngaIMi1TV1wAIjY4qlZDueF8eTW9V/NagCSHh+6Q46Dd9TNXG9DTJ1/F9v1GrrnmsbG+Dt2W4Pc1Zib0fWf7ng2HzCNCWTnfv8Bn1MhOYVcWKw+442VpYA==',key_name='tempest-keypair-2040187038',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='959107d575f04ba2b0ac800ed2ef61fa',ramdisk_id='',reservation_id='r-jcl47agl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1296361049',owner_user_name='tempest-ServerRescueNegativeTestJSON-1296361049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:52:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f10fd7b9c1d34ca5b37150f34ea09ffa',uuid=3559f541-ed61-41b2-9a9d-8b10e18f7375,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7009a29-6a23-4d7d-a2ff-046c040e5b73", "address": "fa:16:3e:f5:e4:b4", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7009a29-6a", "ovs_interfaceid": "a7009a29-6a23-4d7d-a2ff-046c040e5b73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Converting VIF {"id": "a7009a29-6a23-4d7d-a2ff-046c040e5b73", "address": "fa:16:3e:f5:e4:b4", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7009a29-6a", "ovs_interfaceid": "a7009a29-6a23-4d7d-a2ff-046c040e5b73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:e4:b4,bridge_name='br-int',has_traffic_filtering=True,id=a7009a29-6a23-4d7d-a2ff-046c040e5b73,network=Network(02dfd673-dd23-4768-9c30-291cdbecbb64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7009a29-6a') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG nova.objects.instance [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lazy-loading 'pci_devices' on Instance uuid 3559f541-ed61-41b2-9a9d-8b10e18f7375 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:52:46 user nova-compute[72239]:   <uuid>3559f541-ed61-41b2-9a9d-8b10e18f7375</uuid>
Jul 31 14:52:46 user nova-compute[72239]:   <name>instance-00000016</name>
Jul 31 14:52:46 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:52:46 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:52:46 user nova-compute[72239]:   <metadata>
Jul 31 14:52:46 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:52:46 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:52:46 user nova-compute[72239]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1636003015</nova:name>
Jul 31 14:52:46 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:52:46</nova:creationTime>
Jul 31 14:52:46 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:52:46 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:52:46 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:52:46 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:52:46 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:52:46 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:52:46 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:52:46 user nova-compute[72239]:       <nova:owner>
Jul 31 14:52:46 user nova-compute[72239]:         <nova:user uuid="f10fd7b9c1d34ca5b37150f34ea09ffa">tempest-ServerRescueNegativeTestJSON-1296361049-project-member</nova:user>
Jul 31 14:52:46 user nova-compute[72239]:         <nova:project uuid="959107d575f04ba2b0ac800ed2ef61fa">tempest-ServerRescueNegativeTestJSON-1296361049</nova:project>
Jul 31 14:52:46 user nova-compute[72239]:       </nova:owner>
Jul 31 14:52:46 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:52:46 user nova-compute[72239]:       <nova:ports>
Jul 31 14:52:46 user nova-compute[72239]:         <nova:port uuid="a7009a29-6a23-4d7d-a2ff-046c040e5b73">
Jul 31 14:52:46 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 31 14:52:46 user nova-compute[72239]:         </nova:port>
Jul 31 14:52:46 user nova-compute[72239]:       </nova:ports>
Jul 31 14:52:46 user nova-compute[72239]:     </nova:instance>
Jul 31 14:52:46 user nova-compute[72239]:   </metadata>
Jul 31 14:52:46 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:52:46 user nova-compute[72239]:     <system>
Jul 31 14:52:46 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:52:46 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:52:46 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:52:46 user nova-compute[72239]:       <entry name="serial">3559f541-ed61-41b2-9a9d-8b10e18f7375</entry>
Jul 31 14:52:46 user nova-compute[72239]:       <entry name="uuid">3559f541-ed61-41b2-9a9d-8b10e18f7375</entry>
Jul 31 14:52:46 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:52:46 user nova-compute[72239]:     </system>
Jul 31 14:52:46 user nova-compute[72239]:   </sysinfo>
Jul 31 14:52:46 user nova-compute[72239]:   <os>
Jul 31 14:52:46 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:52:46 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:52:46 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:52:46 user nova-compute[72239]:   </os>
Jul 31 14:52:46 user nova-compute[72239]:   <features>
Jul 31 14:52:46 user nova-compute[72239]:     <acpi/>
Jul 31 14:52:46 user nova-compute[72239]:     <apic/>
Jul 31 14:52:46 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:52:46 user nova-compute[72239]:   </features>
Jul 31 14:52:46 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:52:46 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:52:46 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:52:46 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:52:46 user nova-compute[72239]:   </clock>
Jul 31 14:52:46 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:52:46 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:52:46 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:52:46 user nova-compute[72239]:   </cpu>
Jul 31 14:52:46 user nova-compute[72239]:   <devices>
Jul 31 14:52:46 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:52:46 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:52:46 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk"/>
Jul 31 14:52:46 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:52:46 user nova-compute[72239]:     </disk>
Jul 31 14:52:46 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:52:46 user nova-compute[72239]:       <mac address="fa:16:3e:f5:e4:b4"/>
Jul 31 14:52:46 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:52:46 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:52:46 user nova-compute[72239]:       <target dev="tapa7009a29-6a"/>
Jul 31 14:52:46 user nova-compute[72239]:     </interface>
Jul 31 14:52:46 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:52:46 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/console.log" append="off"/>
Jul 31 14:52:46 user nova-compute[72239]:     </serial>
Jul 31 14:52:46 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:52:46 user nova-compute[72239]:     <video>
Jul 31 14:52:46 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:52:46 user nova-compute[72239]:     </video>
Jul 31 14:52:46 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:52:46 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:52:46 user nova-compute[72239]:     </rng>
Jul 31 14:52:46 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:52:46 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:52:46 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:52:46 user nova-compute[72239]:     </memballoon>
Jul 31 14:52:46 user nova-compute[72239]:   </devices>
Jul 31 14:52:46 user nova-compute[72239]: </domain>
Jul 31 14:52:46 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:52:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1636003015',display_name='tempest-ServerRescueNegativeTestJSON-server-1636003015',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1636003015',id=22,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK59e+d5JqumngaIMi1TV1wAIjY4qlZDueF8eTW9V/NagCSHh+6Q46Dd9TNXG9DTJ1/F9v1GrrnmsbG+Dt2W4Pc1Zib0fWf7ng2HzCNCWTnfv8Bn1MhOYVcWKw+442VpYA==',key_name='tempest-keypair-2040187038',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='959107d575f04ba2b0ac800ed2ef61fa',ramdisk_id='',reservation_id='r-jcl47agl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1296361049',owner_user_name='tempest-ServerRescueNegativeTestJSON-1296361049-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:52:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f10fd7b9c1d34ca5b37150f34ea09ffa',uuid=3559f541-ed61-41b2-9a9d-8b10e18f7375,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a7009a29-6a23-4d7d-a2ff-046c040e5b73", "address": "fa:16:3e:f5:e4:b4", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7009a29-6a", "ovs_interfaceid": "a7009a29-6a23-4d7d-a2ff-046c040e5b73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Converting VIF {"id": "a7009a29-6a23-4d7d-a2ff-046c040e5b73", "address": "fa:16:3e:f5:e4:b4", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7009a29-6a", "ovs_interfaceid": "a7009a29-6a23-4d7d-a2ff-046c040e5b73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:e4:b4,bridge_name='br-int',has_traffic_filtering=True,id=a7009a29-6a23-4d7d-a2ff-046c040e5b73,network=Network(02dfd673-dd23-4768-9c30-291cdbecbb64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7009a29-6a') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG os_vif [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:e4:b4,bridge_name='br-int',has_traffic_filtering=True,id=a7009a29-6a23-4d7d-a2ff-046c040e5b73,network=Network(02dfd673-dd23-4768-9c30-291cdbecbb64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7009a29-6a') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa7009a29-6a, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa7009a29-6a, col_values=(('external_ids', {'iface-id': 'a7009a29-6a23-4d7d-a2ff-046c040e5b73', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:e4:b4', 'vm-uuid': '3559f541-ed61-41b2-9a9d-8b10e18f7375'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:52:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:46 user nova-compute[72239]: INFO os_vif [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:e4:b4,bridge_name='br-int',has_traffic_filtering=True,id=a7009a29-6a23-4d7d-a2ff-046c040e5b73,network=Network(02dfd673-dd23-4768-9c30-291cdbecbb64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7009a29-6a')
Jul 31 14:52:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:52:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] No VIF found with MAC fa:16:3e:f5:e4:b4, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:52:47 user nova-compute[72239]: DEBUG nova.network.neutron [req-3358d2ce-7ad6-44f8-96ce-afbd90ece753 req-fa671a05-94fe-43ad-a029-6e8588a0f882 service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Updated VIF entry in instance network info cache for port a7009a29-6a23-4d7d-a2ff-046c040e5b73. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:52:47 user nova-compute[72239]: DEBUG nova.network.neutron [req-3358d2ce-7ad6-44f8-96ce-afbd90ece753 req-fa671a05-94fe-43ad-a029-6e8588a0f882 service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Updating instance_info_cache with network_info: [{"id": "a7009a29-6a23-4d7d-a2ff-046c040e5b73", "address": "fa:16:3e:f5:e4:b4", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7009a29-6a", "ovs_interfaceid": "a7009a29-6a23-4d7d-a2ff-046c040e5b73", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:52:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-3358d2ce-7ad6-44f8-96ce-afbd90ece753 req-fa671a05-94fe-43ad-a029-6e8588a0f882 service nova] Releasing lock "refresh_cache-3559f541-ed61-41b2-9a9d-8b10e18f7375" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:52:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "87dd3b4b-c511-4784-acf9-ad21534c8337" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:52:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "87dd3b4b-c511-4784-acf9-ad21534c8337" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:52:48 user nova-compute[72239]: DEBUG nova.compute.manager [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 14:52:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:52:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:52:48 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 14:52:48 user nova-compute[72239]: INFO nova.compute.claims [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Claim successful on node user
Jul 31 14:52:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:48 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:52:48 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:52:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:52:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:52:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:48 user nova-compute[72239]: DEBUG nova.compute.manager [req-dd0558eb-d2ed-43c2-9a7c-fd03544c24d9 req-b43a0b85-a584-46b4-afa4-07d2552a0b85 service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Received event network-vif-plugged-a7009a29-6a23-4d7d-a2ff-046c040e5b73 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:52:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-dd0558eb-d2ed-43c2-9a7c-fd03544c24d9 req-b43a0b85-a584-46b4-afa4-07d2552a0b85 service nova] Acquiring lock "3559f541-ed61-41b2-9a9d-8b10e18f7375-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:52:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-dd0558eb-d2ed-43c2-9a7c-fd03544c24d9 req-b43a0b85-a584-46b4-afa4-07d2552a0b85 service nova] Lock "3559f541-ed61-41b2-9a9d-8b10e18f7375-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:52:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-dd0558eb-d2ed-43c2-9a7c-fd03544c24d9 req-b43a0b85-a584-46b4-afa4-07d2552a0b85 service nova] Lock "3559f541-ed61-41b2-9a9d-8b10e18f7375-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:52:48 user nova-compute[72239]: DEBUG nova.compute.manager [req-dd0558eb-d2ed-43c2-9a7c-fd03544c24d9 req-b43a0b85-a584-46b4-afa4-07d2552a0b85 service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] No waiting events found dispatching network-vif-plugged-a7009a29-6a23-4d7d-a2ff-046c040e5b73 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:52:48 user nova-compute[72239]: WARNING nova.compute.manager [req-dd0558eb-d2ed-43c2-9a7c-fd03544c24d9 req-b43a0b85-a584-46b4-afa4-07d2552a0b85 service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Received unexpected event network-vif-plugged-a7009a29-6a23-4d7d-a2ff-046c040e5b73 for instance with vm_state building and task_state spawning.
Jul 31 14:52:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:48 user nova-compute[72239]: DEBUG nova.objects.instance [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lazy-loading 'flavor' on Instance uuid c10918e9-9731-48ea-860e-8a02cb6a0ad9 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:52:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.554s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:52:48 user nova-compute[72239]: DEBUG nova.compute.manager [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 14:52:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.084s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:52:48 user nova-compute[72239]: DEBUG nova.compute.manager [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 14:52:48 user nova-compute[72239]: DEBUG nova.network.neutron [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 14:52:48 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 14:52:48 user nova-compute[72239]: DEBUG nova.compute.manager [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG nova.policy [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99f609389e884d5490ba160d9fff28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e4fe9e81724b9cb6b9d73748f9bdee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.004s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:52:49 user nova-compute[72239]: INFO nova.compute.manager [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Attaching volume dc2112e3-a3ce-416f-ab29-be87255daa36 to /dev/vdb
Jul 31 14:52:49 user nova-compute[72239]: DEBUG nova.compute.manager [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 14:52:49 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Creating image(s)
Jul 31 14:52:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "/opt/stack/data/nova/instances/87dd3b4b-c511-4784-acf9-ad21534c8337/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "/opt/stack/data/nova/instances/87dd3b4b-c511-4784-acf9-ad21534c8337/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "/opt/stack/data/nova/instances/87dd3b4b-c511-4784-acf9-ad21534c8337/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG os_brick.utils [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[247b1a84-0d34-4d2c-abd3-abc5c6cce5bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.032s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88246f5-971a-4ce7-89bc-cc4d5d474741]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff388a3d-8205-46bb-a9f1-7d337277096f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba00248-acc7-4ee2-9edc-fdd645d0fdc5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.206s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "ca449065000c92aac3b7b9fa685f9a7710929444" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:52:49 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 14:52:49 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d35522c-7d06-4b0e-b832-cb9785bec16b]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG os_brick.utils [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] <== get_connector_properties: return (211ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Updating existing volume attachment record: 12661d3d-72ce-4020-a302-b19d6b2919db {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.148s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/87dd3b4b-c511-4784-acf9-ad21534c8337/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/87dd3b4b-c511-4784-acf9-ad21534c8337/disk 1073741824" returned: 0 in 0.055s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.212s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.158s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Checking if we can resize image /opt/stack/data/nova/instances/87dd3b4b-c511-4784-acf9-ad21534c8337/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87dd3b4b-c511-4784-acf9-ad21534c8337/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87dd3b4b-c511-4784-acf9-ad21534c8337/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Cannot resize image /opt/stack/data/nova/instances/87dd3b4b-c511-4784-acf9-ad21534c8337/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG nova.objects.instance [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lazy-loading 'migration_context' on Instance uuid 87dd3b4b-c511-4784-acf9-ad21534c8337 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Ensure instance console log exists: /opt/stack/data/nova/instances/87dd3b4b-c511-4784-acf9-ad21534c8337/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:52:49 user nova-compute[72239]: DEBUG nova.network.neutron [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Successfully created port: b3ad3fcc-4893-4a8d-b571-56531232aa38 {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:52:50 user nova-compute[72239]: DEBUG nova.network.neutron [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Successfully updated port: b3ad3fcc-4893-4a8d-b571-56531232aa38 {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:52:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "refresh_cache-87dd3b4b-c511-4784-acf9-ad21534c8337" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:52:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquired lock "refresh_cache-87dd3b4b-c511-4784-acf9-ad21534c8337" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:52:50 user nova-compute[72239]: DEBUG nova.network.neutron [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:52:50 user nova-compute[72239]: DEBUG nova.compute.manager [req-8f4b5089-ad7d-432b-8da1-5314e80b2ab3 req-38c7f440-4c5f-49be-bf00-c0e920c22214 service nova] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Received event network-changed-b3ad3fcc-4893-4a8d-b571-56531232aa38 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:52:50 user nova-compute[72239]: DEBUG nova.compute.manager [req-8f4b5089-ad7d-432b-8da1-5314e80b2ab3 req-38c7f440-4c5f-49be-bf00-c0e920c22214 service nova] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Refreshing instance network info cache due to event network-changed-b3ad3fcc-4893-4a8d-b571-56531232aa38. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:52:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-8f4b5089-ad7d-432b-8da1-5314e80b2ab3 req-38c7f440-4c5f-49be-bf00-c0e920c22214 service nova] Acquiring lock "refresh_cache-87dd3b4b-c511-4784-acf9-ad21534c8337" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:52:50 user nova-compute[72239]: DEBUG nova.network.neutron [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:52:50 user nova-compute[72239]: DEBUG nova.compute.manager [req-8699b906-9dca-4c69-80c0-56f2384cac02 req-c2881385-226e-43ef-9c5f-751132301748 service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Received event network-vif-plugged-a7009a29-6a23-4d7d-a2ff-046c040e5b73 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:52:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-8699b906-9dca-4c69-80c0-56f2384cac02 req-c2881385-226e-43ef-9c5f-751132301748 service nova] Acquiring lock "3559f541-ed61-41b2-9a9d-8b10e18f7375-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:52:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-8699b906-9dca-4c69-80c0-56f2384cac02 req-c2881385-226e-43ef-9c5f-751132301748 service nova] Lock "3559f541-ed61-41b2-9a9d-8b10e18f7375-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:52:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-8699b906-9dca-4c69-80c0-56f2384cac02 req-c2881385-226e-43ef-9c5f-751132301748 service nova] Lock "3559f541-ed61-41b2-9a9d-8b10e18f7375-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:52:50 user nova-compute[72239]: DEBUG nova.compute.manager [req-8699b906-9dca-4c69-80c0-56f2384cac02 req-c2881385-226e-43ef-9c5f-751132301748 service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] No waiting events found dispatching network-vif-plugged-a7009a29-6a23-4d7d-a2ff-046c040e5b73 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:52:50 user nova-compute[72239]: WARNING nova.compute.manager [req-8699b906-9dca-4c69-80c0-56f2384cac02 req-c2881385-226e-43ef-9c5f-751132301748 service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Received unexpected event network-vif-plugged-a7009a29-6a23-4d7d-a2ff-046c040e5b73 for instance with vm_state building and task_state spawning.
Jul 31 14:52:50 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815170.8631885, 3559f541-ed61-41b2-9a9d-8b10e18f7375 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:52:50 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] VM Resumed (Lifecycle Event)
Jul 31 14:52:50 user nova-compute[72239]: DEBUG nova.compute.manager [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:52:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 14:52:50 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Instance spawned successfully.
Jul 31 14:52:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 14:52:50 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:52:50 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:52:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:52:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:52:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:52:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:52:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:52:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:52:50 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:52:50 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815170.8697646, 3559f541-ed61-41b2-9a9d-8b10e18f7375 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:52:50 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] VM Started (Lifecycle Event)
Jul 31 14:52:50 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:52:50 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:52:51 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:52:51 user nova-compute[72239]: INFO nova.compute.manager [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Took 7.96 seconds to spawn the instance on the hypervisor.
Jul 31 14:52:51 user nova-compute[72239]: DEBUG nova.compute.manager [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:52:51 user nova-compute[72239]: INFO nova.compute.manager [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Took 8.95 seconds to build instance.
Jul 31 14:52:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-4a606576-50a5-44dc-839f-213179e340ba tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "3559f541-ed61-41b2-9a9d-8b10e18f7375" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.058s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG nova.network.neutron [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Updating instance_info_cache with network_info: [{"id": "b3ad3fcc-4893-4a8d-b571-56531232aa38", "address": "fa:16:3e:a6:c6:59", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ad3fcc-48", "ovs_interfaceid": "b3ad3fcc-4893-4a8d-b571-56531232aa38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Releasing lock "refresh_cache-87dd3b4b-c511-4784-acf9-ad21534c8337" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG nova.compute.manager [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Instance network_info: |[{"id": "b3ad3fcc-4893-4a8d-b571-56531232aa38", "address": "fa:16:3e:a6:c6:59", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ad3fcc-48", "ovs_interfaceid": "b3ad3fcc-4893-4a8d-b571-56531232aa38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-8f4b5089-ad7d-432b-8da1-5314e80b2ab3 req-38c7f440-4c5f-49be-bf00-c0e920c22214 service nova] Acquired lock "refresh_cache-87dd3b4b-c511-4784-acf9-ad21534c8337" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG nova.network.neutron [req-8f4b5089-ad7d-432b-8da1-5314e80b2ab3 req-38c7f440-4c5f-49be-bf00-c0e920c22214 service nova] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Refreshing network info cache for port b3ad3fcc-4893-4a8d-b571-56531232aa38 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Start _get_guest_xml network_info=[{"id": "b3ad3fcc-4893-4a8d-b571-56531232aa38", "address": "fa:16:3e:a6:c6:59", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ad3fcc-48", "ovs_interfaceid": "b3ad3fcc-4893-4a8d-b571-56531232aa38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:52:51 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:52:51 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:52:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:52:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-644202697',display_name='tempest-AttachVolumeNegativeTest-server-644202697',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-644202697',id=23,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMppTHM1FnkXOlJGlz0iPP9YDtT0ELcybzl0dCDuW66fH3EH9FaZsh1xXd4oGZRQ+YpvhreZmu503DtBwqW/f8Rlj3ukElg6Kk78sLy3JmBI158DdZh8h1fBUI2M6th/tA==',key_name='tempest-keypair-447190904',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48e4fe9e81724b9cb6b9d73748f9bdee',ramdisk_id='',reservation_id='r-men4o51d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-620954585',owner_user_name='tempest-AttachVolumeNegativeTest-620954585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:52:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99f609389e884d5490ba160d9fff28e3',uuid=87dd3b4b-c511-4784-acf9-ad21534c8337,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3ad3fcc-4893-4a8d-b571-56531232aa38", "address": "fa:16:3e:a6:c6:59", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ad3fcc-48", "ovs_interfaceid": "b3ad3fcc-4893-4a8d-b571-56531232aa38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Converting VIF {"id": "b3ad3fcc-4893-4a8d-b571-56531232aa38", "address": "fa:16:3e:a6:c6:59", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ad3fcc-48", "ovs_interfaceid": "b3ad3fcc-4893-4a8d-b571-56531232aa38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:c6:59,bridge_name='br-int',has_traffic_filtering=True,id=b3ad3fcc-4893-4a8d-b571-56531232aa38,network=Network(f83cfb34-b1ca-4a7c-9a36-3654372585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3ad3fcc-48') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG nova.objects.instance [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lazy-loading 'pci_devices' on Instance uuid 87dd3b4b-c511-4784-acf9-ad21534c8337 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:52:51 user nova-compute[72239]:   <uuid>87dd3b4b-c511-4784-acf9-ad21534c8337</uuid>
Jul 31 14:52:51 user nova-compute[72239]:   <name>instance-00000017</name>
Jul 31 14:52:51 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:52:51 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:52:51 user nova-compute[72239]:   <metadata>
Jul 31 14:52:51 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:52:51 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:52:51 user nova-compute[72239]:       <nova:name>tempest-AttachVolumeNegativeTest-server-644202697</nova:name>
Jul 31 14:52:51 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:52:51</nova:creationTime>
Jul 31 14:52:51 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:52:51 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:52:51 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:52:51 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:52:51 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:52:51 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:52:51 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:52:51 user nova-compute[72239]:       <nova:owner>
Jul 31 14:52:51 user nova-compute[72239]:         <nova:user uuid="99f609389e884d5490ba160d9fff28e3">tempest-AttachVolumeNegativeTest-620954585-project-member</nova:user>
Jul 31 14:52:51 user nova-compute[72239]:         <nova:project uuid="48e4fe9e81724b9cb6b9d73748f9bdee">tempest-AttachVolumeNegativeTest-620954585</nova:project>
Jul 31 14:52:51 user nova-compute[72239]:       </nova:owner>
Jul 31 14:52:51 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:52:51 user nova-compute[72239]:       <nova:ports>
Jul 31 14:52:51 user nova-compute[72239]:         <nova:port uuid="b3ad3fcc-4893-4a8d-b571-56531232aa38">
Jul 31 14:52:51 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 31 14:52:51 user nova-compute[72239]:         </nova:port>
Jul 31 14:52:51 user nova-compute[72239]:       </nova:ports>
Jul 31 14:52:51 user nova-compute[72239]:     </nova:instance>
Jul 31 14:52:51 user nova-compute[72239]:   </metadata>
Jul 31 14:52:51 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:52:51 user nova-compute[72239]:     <system>
Jul 31 14:52:51 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:52:51 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:52:51 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:52:51 user nova-compute[72239]:       <entry name="serial">87dd3b4b-c511-4784-acf9-ad21534c8337</entry>
Jul 31 14:52:51 user nova-compute[72239]:       <entry name="uuid">87dd3b4b-c511-4784-acf9-ad21534c8337</entry>
Jul 31 14:52:51 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:52:51 user nova-compute[72239]:     </system>
Jul 31 14:52:51 user nova-compute[72239]:   </sysinfo>
Jul 31 14:52:51 user nova-compute[72239]:   <os>
Jul 31 14:52:51 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:52:51 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:52:51 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:52:51 user nova-compute[72239]:   </os>
Jul 31 14:52:51 user nova-compute[72239]:   <features>
Jul 31 14:52:51 user nova-compute[72239]:     <acpi/>
Jul 31 14:52:51 user nova-compute[72239]:     <apic/>
Jul 31 14:52:51 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:52:51 user nova-compute[72239]:   </features>
Jul 31 14:52:51 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:52:51 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:52:51 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:52:51 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:52:51 user nova-compute[72239]:   </clock>
Jul 31 14:52:51 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:52:51 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:52:51 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:52:51 user nova-compute[72239]:   </cpu>
Jul 31 14:52:51 user nova-compute[72239]:   <devices>
Jul 31 14:52:51 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:52:51 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:52:51 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/87dd3b4b-c511-4784-acf9-ad21534c8337/disk"/>
Jul 31 14:52:51 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:52:51 user nova-compute[72239]:     </disk>
Jul 31 14:52:51 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:52:51 user nova-compute[72239]:       <mac address="fa:16:3e:a6:c6:59"/>
Jul 31 14:52:51 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:52:51 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:52:51 user nova-compute[72239]:       <target dev="tapb3ad3fcc-48"/>
Jul 31 14:52:51 user nova-compute[72239]:     </interface>
Jul 31 14:52:51 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:52:51 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/87dd3b4b-c511-4784-acf9-ad21534c8337/console.log" append="off"/>
Jul 31 14:52:51 user nova-compute[72239]:     </serial>
Jul 31 14:52:51 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:52:51 user nova-compute[72239]:     <video>
Jul 31 14:52:51 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:52:51 user nova-compute[72239]:     </video>
Jul 31 14:52:51 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:52:51 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:52:51 user nova-compute[72239]:     </rng>
Jul 31 14:52:51 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:52:51 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:52:51 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:52:51 user nova-compute[72239]:     </memballoon>
Jul 31 14:52:51 user nova-compute[72239]:   </devices>
Jul 31 14:52:51 user nova-compute[72239]: </domain>
Jul 31 14:52:51 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:52:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-644202697',display_name='tempest-AttachVolumeNegativeTest-server-644202697',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-644202697',id=23,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMppTHM1FnkXOlJGlz0iPP9YDtT0ELcybzl0dCDuW66fH3EH9FaZsh1xXd4oGZRQ+YpvhreZmu503DtBwqW/f8Rlj3ukElg6Kk78sLy3JmBI158DdZh8h1fBUI2M6th/tA==',key_name='tempest-keypair-447190904',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48e4fe9e81724b9cb6b9d73748f9bdee',ramdisk_id='',reservation_id='r-men4o51d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-620954585',owner_user_name='tempest-AttachVolumeNegativeTest-620954585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:52:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99f609389e884d5490ba160d9fff28e3',uuid=87dd3b4b-c511-4784-acf9-ad21534c8337,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b3ad3fcc-4893-4a8d-b571-56531232aa38", "address": "fa:16:3e:a6:c6:59", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ad3fcc-48", "ovs_interfaceid": "b3ad3fcc-4893-4a8d-b571-56531232aa38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Converting VIF {"id": "b3ad3fcc-4893-4a8d-b571-56531232aa38", "address": "fa:16:3e:a6:c6:59", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ad3fcc-48", "ovs_interfaceid": "b3ad3fcc-4893-4a8d-b571-56531232aa38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:c6:59,bridge_name='br-int',has_traffic_filtering=True,id=b3ad3fcc-4893-4a8d-b571-56531232aa38,network=Network(f83cfb34-b1ca-4a7c-9a36-3654372585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3ad3fcc-48') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG os_vif [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:c6:59,bridge_name='br-int',has_traffic_filtering=True,id=b3ad3fcc-4893-4a8d-b571-56531232aa38,network=Network(f83cfb34-b1ca-4a7c-9a36-3654372585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3ad3fcc-48') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb3ad3fcc-48, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb3ad3fcc-48, col_values=(('external_ids', {'iface-id': 'b3ad3fcc-4893-4a8d-b571-56531232aa38', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:c6:59', 'vm-uuid': '87dd3b4b-c511-4784-acf9-ad21534c8337'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:51 user nova-compute[72239]: INFO os_vif [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:c6:59,bridge_name='br-int',has_traffic_filtering=True,id=b3ad3fcc-4893-4a8d-b571-56531232aa38,network=Network(f83cfb34-b1ca-4a7c-9a36-3654372585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3ad3fcc-48')
Jul 31 14:52:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] No VIF found with MAC fa:16:3e:a6:c6:59, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG nova.network.neutron [req-8f4b5089-ad7d-432b-8da1-5314e80b2ab3 req-38c7f440-4c5f-49be-bf00-c0e920c22214 service nova] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Updated VIF entry in instance network info cache for port b3ad3fcc-4893-4a8d-b571-56531232aa38. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG nova.network.neutron [req-8f4b5089-ad7d-432b-8da1-5314e80b2ab3 req-38c7f440-4c5f-49be-bf00-c0e920c22214 service nova] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Updating instance_info_cache with network_info: [{"id": "b3ad3fcc-4893-4a8d-b571-56531232aa38", "address": "fa:16:3e:a6:c6:59", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ad3fcc-48", "ovs_interfaceid": "b3ad3fcc-4893-4a8d-b571-56531232aa38", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:52:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-8f4b5089-ad7d-432b-8da1-5314e80b2ab3 req-38c7f440-4c5f-49be-bf00-c0e920c22214 service nova] Releasing lock "refresh_cache-87dd3b4b-c511-4784-acf9-ad21534c8337" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:52:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c785904a-7b1d-4624-830c-9a48f3e796df tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Acquiring lock "82116af8-3702-401b-8d00-9291d4caeb03" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:52:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c785904a-7b1d-4624-830c-9a48f3e796df tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "82116af8-3702-401b-8d00-9291d4caeb03" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:52:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c785904a-7b1d-4624-830c-9a48f3e796df tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Acquiring lock "82116af8-3702-401b-8d00-9291d4caeb03-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:52:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c785904a-7b1d-4624-830c-9a48f3e796df tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "82116af8-3702-401b-8d00-9291d4caeb03-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:52:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c785904a-7b1d-4624-830c-9a48f3e796df tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "82116af8-3702-401b-8d00-9291d4caeb03-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:52:53 user nova-compute[72239]: INFO nova.compute.manager [None req-c785904a-7b1d-4624-830c-9a48f3e796df tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Terminating instance
Jul 31 14:52:53 user nova-compute[72239]: DEBUG nova.compute.manager [None req-c785904a-7b1d-4624-830c-9a48f3e796df tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 14:52:53 user nova-compute[72239]: DEBUG nova.compute.manager [req-b7affe52-9e5b-4b6f-821c-bce624fcf69b req-f7ccfaaa-290a-44cd-8140-af74cbb3a4b7 service nova] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Received event network-vif-plugged-b3ad3fcc-4893-4a8d-b571-56531232aa38 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:52:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b7affe52-9e5b-4b6f-821c-bce624fcf69b req-f7ccfaaa-290a-44cd-8140-af74cbb3a4b7 service nova] Acquiring lock "87dd3b4b-c511-4784-acf9-ad21534c8337-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:52:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b7affe52-9e5b-4b6f-821c-bce624fcf69b req-f7ccfaaa-290a-44cd-8140-af74cbb3a4b7 service nova] Lock "87dd3b4b-c511-4784-acf9-ad21534c8337-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:52:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b7affe52-9e5b-4b6f-821c-bce624fcf69b req-f7ccfaaa-290a-44cd-8140-af74cbb3a4b7 service nova] Lock "87dd3b4b-c511-4784-acf9-ad21534c8337-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:52:53 user nova-compute[72239]: DEBUG nova.compute.manager [req-b7affe52-9e5b-4b6f-821c-bce624fcf69b req-f7ccfaaa-290a-44cd-8140-af74cbb3a4b7 service nova] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] No waiting events found dispatching network-vif-plugged-b3ad3fcc-4893-4a8d-b571-56531232aa38 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:52:53 user nova-compute[72239]: WARNING nova.compute.manager [req-b7affe52-9e5b-4b6f-821c-bce624fcf69b req-f7ccfaaa-290a-44cd-8140-af74cbb3a4b7 service nova] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Received unexpected event network-vif-plugged-b3ad3fcc-4893-4a8d-b571-56531232aa38 for instance with vm_state building and task_state spawning.
Jul 31 14:52:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:53 user nova-compute[72239]: DEBUG nova.compute.manager [req-dd06878b-4f07-46f7-9bc9-117d838cfcb9 req-aa40b498-cfb3-4719-87b5-67be15618686 service nova] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Received event network-vif-unplugged-8bcdec5f-6bd8-4afc-8618-284f21e2d3c5 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:52:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-dd06878b-4f07-46f7-9bc9-117d838cfcb9 req-aa40b498-cfb3-4719-87b5-67be15618686 service nova] Acquiring lock "82116af8-3702-401b-8d00-9291d4caeb03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:52:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-dd06878b-4f07-46f7-9bc9-117d838cfcb9 req-aa40b498-cfb3-4719-87b5-67be15618686 service nova] Lock "82116af8-3702-401b-8d00-9291d4caeb03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:52:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-dd06878b-4f07-46f7-9bc9-117d838cfcb9 req-aa40b498-cfb3-4719-87b5-67be15618686 service nova] Lock "82116af8-3702-401b-8d00-9291d4caeb03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:52:53 user nova-compute[72239]: DEBUG nova.compute.manager [req-dd06878b-4f07-46f7-9bc9-117d838cfcb9 req-aa40b498-cfb3-4719-87b5-67be15618686 service nova] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] No waiting events found dispatching network-vif-unplugged-8bcdec5f-6bd8-4afc-8618-284f21e2d3c5 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:52:53 user nova-compute[72239]: DEBUG nova.compute.manager [req-dd06878b-4f07-46f7-9bc9-117d838cfcb9 req-aa40b498-cfb3-4719-87b5-67be15618686 service nova] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Received event network-vif-unplugged-8bcdec5f-6bd8-4afc-8618-284f21e2d3c5 for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 14:52:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:54 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Instance destroyed successfully.
Jul 31 14:52:54 user nova-compute[72239]: DEBUG nova.objects.instance [None req-c785904a-7b1d-4624-830c-9a48f3e796df tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lazy-loading 'resources' on Instance uuid 82116af8-3702-401b-8d00-9291d4caeb03 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:52:54 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-c785904a-7b1d-4624-830c-9a48f3e796df tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:45:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1597607562',display_name='tempest-SnapshotDataIntegrityTests-server-1597607562',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1597607562',id=11,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHxPO8LGil8BUJkpe+8ZDhYdxaLZWbxGvYYvgGOuPdgnWgmfh33I91T8iB0MFgEJJfRvOthDXudaMrT/wC+uYbQc7zTrC8bZd99lVyvt5Qn3IGqKBkwMWsE1pT4//IG3vA==',key_name='tempest-keypair-1907358817',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:45:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='464c4d98738c4a58b69e93b15eacda29',ramdisk_id='',reservation_id='r-zcpx50y9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-888246672',owner_user_name='tempest-SnapshotDataIntegrityTests-888246672-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:45:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='57f64bf571964fb5ab30b6bcf647becc',uuid=82116af8-3702-401b-8d00-9291d4caeb03,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8bcdec5f-6bd8-4afc-8618-284f21e2d3c5", "address": "fa:16:3e:2e:96:96", "network": {"id": "024fea8e-c1bc-4b21-9965-ac495ab32b25", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1281491819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "464c4d98738c4a58b69e93b15eacda29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bcdec5f-6b", "ovs_interfaceid": "8bcdec5f-6bd8-4afc-8618-284f21e2d3c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:52:54 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-c785904a-7b1d-4624-830c-9a48f3e796df tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Converting VIF {"id": "8bcdec5f-6bd8-4afc-8618-284f21e2d3c5", "address": "fa:16:3e:2e:96:96", "network": {"id": "024fea8e-c1bc-4b21-9965-ac495ab32b25", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1281491819-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "464c4d98738c4a58b69e93b15eacda29", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8bcdec5f-6b", "ovs_interfaceid": "8bcdec5f-6bd8-4afc-8618-284f21e2d3c5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:52:54 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-c785904a-7b1d-4624-830c-9a48f3e796df tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:96:96,bridge_name='br-int',has_traffic_filtering=True,id=8bcdec5f-6bd8-4afc-8618-284f21e2d3c5,network=Network(024fea8e-c1bc-4b21-9965-ac495ab32b25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bcdec5f-6b') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:52:54 user nova-compute[72239]: DEBUG os_vif [None req-c785904a-7b1d-4624-830c-9a48f3e796df tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:96:96,bridge_name='br-int',has_traffic_filtering=True,id=8bcdec5f-6bd8-4afc-8618-284f21e2d3c5,network=Network(024fea8e-c1bc-4b21-9965-ac495ab32b25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bcdec5f-6b') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:52:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8bcdec5f-6b, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:52:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:52:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:54 user nova-compute[72239]: INFO os_vif [None req-c785904a-7b1d-4624-830c-9a48f3e796df tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:96:96,bridge_name='br-int',has_traffic_filtering=True,id=8bcdec5f-6bd8-4afc-8618-284f21e2d3c5,network=Network(024fea8e-c1bc-4b21-9965-ac495ab32b25),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8bcdec5f-6b')
Jul 31 14:52:54 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-c785904a-7b1d-4624-830c-9a48f3e796df tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Deleting instance files /opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03_del
Jul 31 14:52:54 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-c785904a-7b1d-4624-830c-9a48f3e796df tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Deletion of /opt/stack/data/nova/instances/82116af8-3702-401b-8d00-9291d4caeb03_del complete
Jul 31 14:52:54 user nova-compute[72239]: INFO nova.compute.manager [None req-c785904a-7b1d-4624-830c-9a48f3e796df tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Took 0.98 seconds to destroy the instance on the hypervisor.
Jul 31 14:52:54 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-c785904a-7b1d-4624-830c-9a48f3e796df tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 14:52:54 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 14:52:54 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 14:52:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:55 user nova-compute[72239]: DEBUG nova.compute.manager [req-f3842530-78da-4817-926f-154ac122caac req-94ca091b-f080-42ea-9fa8-67bf31a26e4d service nova] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Received event network-vif-plugged-b3ad3fcc-4893-4a8d-b571-56531232aa38 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:52:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-f3842530-78da-4817-926f-154ac122caac req-94ca091b-f080-42ea-9fa8-67bf31a26e4d service nova] Acquiring lock "87dd3b4b-c511-4784-acf9-ad21534c8337-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:52:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-f3842530-78da-4817-926f-154ac122caac req-94ca091b-f080-42ea-9fa8-67bf31a26e4d service nova] Lock "87dd3b4b-c511-4784-acf9-ad21534c8337-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:52:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-f3842530-78da-4817-926f-154ac122caac req-94ca091b-f080-42ea-9fa8-67bf31a26e4d service nova] Lock "87dd3b4b-c511-4784-acf9-ad21534c8337-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:52:55 user nova-compute[72239]: DEBUG nova.compute.manager [req-f3842530-78da-4817-926f-154ac122caac req-94ca091b-f080-42ea-9fa8-67bf31a26e4d service nova] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] No waiting events found dispatching network-vif-plugged-b3ad3fcc-4893-4a8d-b571-56531232aa38 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:52:55 user nova-compute[72239]: WARNING nova.compute.manager [req-f3842530-78da-4817-926f-154ac122caac req-94ca091b-f080-42ea-9fa8-67bf31a26e4d service nova] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Received unexpected event network-vif-plugged-b3ad3fcc-4893-4a8d-b571-56531232aa38 for instance with vm_state building and task_state spawning.
Jul 31 14:52:55 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:52:55 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Took 1.15 seconds to deallocate network for instance.
Jul 31 14:52:55 user nova-compute[72239]: DEBUG nova.compute.manager [req-680c61b2-c1e9-4166-b8a6-538559e79950 req-e8a91737-09f6-469b-8fa2-331cbc92c59a service nova] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Received event network-vif-deleted-8bcdec5f-6bd8-4afc-8618-284f21e2d3c5 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:52:55 user nova-compute[72239]: INFO nova.compute.manager [req-680c61b2-c1e9-4166-b8a6-538559e79950 req-e8a91737-09f6-469b-8fa2-331cbc92c59a service nova] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Neutron deleted interface 8bcdec5f-6bd8-4afc-8618-284f21e2d3c5; detaching it from the instance and deleting it from the info cache
Jul 31 14:52:55 user nova-compute[72239]: DEBUG nova.network.neutron [req-680c61b2-c1e9-4166-b8a6-538559e79950 req-e8a91737-09f6-469b-8fa2-331cbc92c59a service nova] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:52:55 user nova-compute[72239]: DEBUG nova.compute.manager [req-680c61b2-c1e9-4166-b8a6-538559e79950 req-e8a91737-09f6-469b-8fa2-331cbc92c59a service nova] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Detach interface failed, port_id=8bcdec5f-6bd8-4afc-8618-284f21e2d3c5, reason: Instance 82116af8-3702-401b-8d00-9291d4caeb03 could not be found. {{(pid=72239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 14:52:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c785904a-7b1d-4624-830c-9a48f3e796df tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:52:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c785904a-7b1d-4624-830c-9a48f3e796df tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:52:55 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815175.5071228, 87dd3b4b-c511-4784-acf9-ad21534c8337 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:52:55 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] VM Resumed (Lifecycle Event)
Jul 31 14:52:55 user nova-compute[72239]: DEBUG nova.compute.manager [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:52:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 14:52:55 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Instance spawned successfully.
Jul 31 14:52:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 14:52:55 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:52:55 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:52:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:52:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:52:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:52:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:52:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:52:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:52:55 user nova-compute[72239]: DEBUG nova.compute.manager [req-3aa6af02-c39d-49f7-8360-7e8543e4c058 req-9b922394-e519-4857-94bb-f45455618ff1 service nova] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Received event network-vif-plugged-8bcdec5f-6bd8-4afc-8618-284f21e2d3c5 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:52:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-3aa6af02-c39d-49f7-8360-7e8543e4c058 req-9b922394-e519-4857-94bb-f45455618ff1 service nova] Acquiring lock "82116af8-3702-401b-8d00-9291d4caeb03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:52:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-3aa6af02-c39d-49f7-8360-7e8543e4c058 req-9b922394-e519-4857-94bb-f45455618ff1 service nova] Lock "82116af8-3702-401b-8d00-9291d4caeb03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:52:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-3aa6af02-c39d-49f7-8360-7e8543e4c058 req-9b922394-e519-4857-94bb-f45455618ff1 service nova] Lock "82116af8-3702-401b-8d00-9291d4caeb03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:52:55 user nova-compute[72239]: DEBUG nova.compute.manager [req-3aa6af02-c39d-49f7-8360-7e8543e4c058 req-9b922394-e519-4857-94bb-f45455618ff1 service nova] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] No waiting events found dispatching network-vif-plugged-8bcdec5f-6bd8-4afc-8618-284f21e2d3c5 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:52:55 user nova-compute[72239]: WARNING nova.compute.manager [req-3aa6af02-c39d-49f7-8360-7e8543e4c058 req-9b922394-e519-4857-94bb-f45455618ff1 service nova] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Received unexpected event network-vif-plugged-8bcdec5f-6bd8-4afc-8618-284f21e2d3c5 for instance with vm_state deleted and task_state None.
Jul 31 14:52:55 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:52:55 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815175.508192, 87dd3b4b-c511-4784-acf9-ad21534c8337 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:52:55 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] VM Started (Lifecycle Event)
Jul 31 14:52:55 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:52:55 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:52:55 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:52:55 user nova-compute[72239]: INFO nova.compute.manager [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Took 6.62 seconds to spawn the instance on the hypervisor.
Jul 31 14:52:55 user nova-compute[72239]: DEBUG nova.compute.manager [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:52:55 user nova-compute[72239]: INFO nova.compute.manager [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Took 7.58 seconds to build instance.
Jul 31 14:52:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b0c6a8d2-2cf6-45aa-b325-c40efdfbc40c tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "87dd3b4b-c511-4784-acf9-ad21534c8337" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.723s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:52:55 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-c785904a-7b1d-4624-830c-9a48f3e796df tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:52:55 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-c785904a-7b1d-4624-830c-9a48f3e796df tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:52:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c785904a-7b1d-4624-830c-9a48f3e796df tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.549s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:52:55 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-c785904a-7b1d-4624-830c-9a48f3e796df tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Deleted allocations for instance 82116af8-3702-401b-8d00-9291d4caeb03
Jul 31 14:52:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c785904a-7b1d-4624-830c-9a48f3e796df tempest-SnapshotDataIntegrityTests-888246672 tempest-SnapshotDataIntegrityTests-888246672-project-member] Lock "82116af8-3702-401b-8d00-9291d4caeb03" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.932s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:52:56 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NWHqjgwZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:52:58 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:52:58 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:52:58 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:52:58 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:52:58 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 14:52:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc567ccd-dc79-47ae-ae59-c8a0f5df5d48]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 14:52:58 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd3477b-fb80-4f8b-acf8-97038462dd34]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36] added
Jul 31 14:52:58 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f00cf2-efab-4a9f-8af5-b9d8576794ac]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[59081ae5-a6a0-41e6-b70a-a8aac078e611]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NWHqjgwZ {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NWHqjgwZ" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87ea996-40a5-40d5-9e7d-67ce7357c4ab]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NWHqjgwZ'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce53640-072e-4304-8689-29bd69421683]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[594f94ef-787c-4c67-9f0f-f21b688a4151]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:52:58 user nova-compute[72239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:52:58 user nova-compute[72239]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:52:58 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:52:58 user nova-compute[72239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:52:58 user nova-compute[72239]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:52:58 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5869f3-695e-424a-b2e0-534a8c4ce414]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36, portal: 172.16.0.220,3260]
Jul 31 14:52:58 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36, portal: 172.16.0.220,3260] successful.
Jul 31 14:52:58 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ac3a4b-3a7b-4da7-996c-664c641e4542]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7748bd-d2b9-44e1-91b2-fd4aae5f206d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:52:58 user nova-compute[72239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:52:58 user nova-compute[72239]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:52:58 user nova-compute[72239]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)
Jul 31 14:52:58 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:52:58 user nova-compute[72239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:52:58 user nova-compute[72239]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:52:58 user nova-compute[72239]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)
Jul 31 14:52:58 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] HCTL ('35', '-', '-', 0) found on session 26 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9c328e-759c-433a-baa9-4908a1d0b795]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Searching for a device in session 26 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NWHqjgwZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Acquiring lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Acquiring lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:52:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:52:58 user nova-compute[72239]: INFO nova.compute.manager [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Terminating instance
Jul 31 14:52:58 user nova-compute[72239]: DEBUG nova.compute.manager [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG nova.compute.manager [req-36ed8c52-d7ce-4713-9cc7-a6e02dd707e3 req-23e6f53d-5c46-4fe2-aece-85a36135d12e service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Received event network-vif-unplugged-d6ef6541-6b7e-4dc5-8149-a10940dfe87b {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-36ed8c52-d7ce-4713-9cc7-a6e02dd707e3 req-23e6f53d-5c46-4fe2-aece-85a36135d12e service nova] Acquiring lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-36ed8c52-d7ce-4713-9cc7-a6e02dd707e3 req-23e6f53d-5c46-4fe2-aece-85a36135d12e service nova] Lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-36ed8c52-d7ce-4713-9cc7-a6e02dd707e3 req-23e6f53d-5c46-4fe2-aece-85a36135d12e service nova] Lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG nova.compute.manager [req-36ed8c52-d7ce-4713-9cc7-a6e02dd707e3 req-23e6f53d-5c46-4fe2-aece-85a36135d12e service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] No waiting events found dispatching network-vif-unplugged-d6ef6541-6b7e-4dc5-8149-a10940dfe87b {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG nova.compute.manager [req-36ed8c52-d7ce-4713-9cc7-a6e02dd707e3 req-23e6f53d-5c46-4fe2-aece-85a36135d12e service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Received event network-vif-unplugged-d6ef6541-6b7e-4dc5-8149-a10940dfe87b for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 14:52:59 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Instance destroyed successfully.
Jul 31 14:52:59 user nova-compute[72239]: DEBUG nova.objects.instance [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lazy-loading 'resources' on Instance uuid d3e3612b-c6b9-4308-a45a-1ff3805e18bb {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:44:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-704430368',display_name='tempest-ServerActionsTestOtherB-server-704430368',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-704430368',id=5,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCMAieHq8I0ZAPg3BJdF9GCCYAxcsl1TuUTZpA9U0PVBIFwXLp4luFdF9A4kOklr7N7b3+Doyb1i/MuF4moMlBsM1nlQtqnIuFR3yVshdpPI3XQmqmueJHWFXMGjAp573g==',key_name='tempest-keypair-1046174319',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:50:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='506aad3c95a94800a4cc333a3478da17',ramdisk_id='',reservation_id='r-rcs9kimd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-858495710',owner_user_name='tempest-ServerActionsTestOtherB-858495710-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:50:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c92e1d7e3b944359fcbf9475dcacef0',uuid=d3e3612b-c6b9-4308-a45a-1ff3805e18bb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "address": "fa:16:3e:f4:8d:da", "network": {"id": "ad1d78ca-d597-4586-8b1b-4dc00fac3c3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-398965992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "506aad3c95a94800a4cc333a3478da17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ef6541-6b", "ovs_interfaceid": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Converting VIF {"id": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "address": "fa:16:3e:f4:8d:da", "network": {"id": "ad1d78ca-d597-4586-8b1b-4dc00fac3c3f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-398965992-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "506aad3c95a94800a4cc333a3478da17", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd6ef6541-6b", "ovs_interfaceid": "d6ef6541-6b7e-4dc5-8149-a10940dfe87b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:8d:da,bridge_name='br-int',has_traffic_filtering=True,id=d6ef6541-6b7e-4dc5-8149-a10940dfe87b,network=Network(ad1d78ca-d597-4586-8b1b-4dc00fac3c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ef6541-6b') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG os_vif [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:8d:da,bridge_name='br-int',has_traffic_filtering=True,id=d6ef6541-6b7e-4dc5-8149-a10940dfe87b,network=Network(ad1d78ca-d597-4586-8b1b-4dc00fac3c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ef6541-6b') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd6ef6541-6b, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:52:59 user nova-compute[72239]: INFO os_vif [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:8d:da,bridge_name='br-int',has_traffic_filtering=True,id=d6ef6541-6b7e-4dc5-8149-a10940dfe87b,network=Network(ad1d78ca-d597-4586-8b1b-4dc00fac3c3f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd6ef6541-6b')
Jul 31 14:52:59 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PjhAmCqu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:52:59 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:52:59 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23138356632346631', 'path': '/dev/sdd'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138356632346631', 'path': '/dev/sdd'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.061s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG nova.objects.instance [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lazy-loading 'flavor' on Instance uuid c10918e9-9731-48ea-860e-8a02cb6a0ad9 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e13358-bfba-4fd0-9e95-6726b66e73d0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 14:52:59 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:52:59 user nova-compute[72239]:   <source dev="/dev/sdd"/>
Jul 31 14:52:59 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:52:59 user nova-compute[72239]:   <serial>dc2112e3-a3ce-416f-ab29-be87255daa36</serial>
Jul 31 14:52:59 user nova-compute[72239]: </disk>
Jul 31 14:52:59 user nova-compute[72239]:  {{(pid=72239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0c2e71-dfaa-4315-b24f-7197e1449abe]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:52:59 user nova-compute[72239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:52:59 user nova-compute[72239]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:52:59 user nova-compute[72239]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)
Jul 31 14:52:59 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:52:59 user nova-compute[72239]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f (non-flash)
Jul 31 14:52:59 user nova-compute[72239]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:52:59 user nova-compute[72239]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)
Jul 31 14:52:59 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4118382170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f'): ({'sdb'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Removing single pathed devices sdb {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[134190ae-d765-4b80-9c1e-50470d6364c5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09dbe93-a582-44c3-b47f-1a63e6d71dc1]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Flushing IO for device /dev/sdb {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.026s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba69da93-da72-4a10-b071-59772534ed9f]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 14:52:59 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b261efe2-a8bf-4234-9e77-e2f3c91b52c5]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:00 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 14:53:00 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 14:53:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 14:53:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[17070459-38c1-4220-af67-e11ff87de480]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:53:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[62108b5d-e04c-44bb-b4ca-74dc45afa8a4]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f, portal: 172.16.0.220,3260]
Jul 31 14:53:00 user nova-compute[72239]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f, portal: 172.16.0.220,3260] successful.
Jul 31 14:53:00 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:53:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0442beb2-94e8-445b-b688-af66bd23814f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66d8703-583d-4e1a-b19c-dc599ff5b5ef]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:53:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:53:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] <== disconnect_volume: return (393ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:53:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 14:53:00 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Deleting instance files /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb_del
Jul 31 14:53:00 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Deletion of /opt/stack/data/nova/instances/d3e3612b-c6b9-4308-a45a-1ff3805e18bb_del complete
Jul 31 14:53:00 user nova-compute[72239]: INFO nova.compute.manager [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Took 1.35 seconds to destroy the instance on the hypervisor.
Jul 31 14:53:00 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 14:53:00 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 14:53:00 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 14:53:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:53:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:53:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] No VIF found with MAC fa:16:3e:56:1c:d6, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:53:00 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:53:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e26f7469-3f38-4474-9cfc-e6d00c4ee876 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.408s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:53:01 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:53:01 user nova-compute[72239]: DEBUG nova.compute.manager [req-6cc2a59a-99dd-4303-aaea-926f4049e126 req-28aaae19-d829-4618-89fd-30e303ee4448 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Received event network-vif-plugged-d6ef6541-6b7e-4dc5-8149-a10940dfe87b {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:53:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-6cc2a59a-99dd-4303-aaea-926f4049e126 req-28aaae19-d829-4618-89fd-30e303ee4448 service nova] Acquiring lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:53:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-6cc2a59a-99dd-4303-aaea-926f4049e126 req-28aaae19-d829-4618-89fd-30e303ee4448 service nova] Lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:53:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-6cc2a59a-99dd-4303-aaea-926f4049e126 req-28aaae19-d829-4618-89fd-30e303ee4448 service nova] Lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:53:01 user nova-compute[72239]: DEBUG nova.compute.manager [req-6cc2a59a-99dd-4303-aaea-926f4049e126 req-28aaae19-d829-4618-89fd-30e303ee4448 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] No waiting events found dispatching network-vif-plugged-d6ef6541-6b7e-4dc5-8149-a10940dfe87b {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:53:01 user nova-compute[72239]: WARNING nova.compute.manager [req-6cc2a59a-99dd-4303-aaea-926f4049e126 req-28aaae19-d829-4618-89fd-30e303ee4448 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Received unexpected event network-vif-plugged-d6ef6541-6b7e-4dc5-8149-a10940dfe87b for instance with vm_state active and task_state deleting.
Jul 31 14:53:01 user nova-compute[72239]: INFO nova.compute.manager [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Rebuilding instance
Jul 31 14:53:02 user nova-compute[72239]: DEBUG nova.objects.instance [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lazy-loading 'trusted_certs' on Instance uuid c10918e9-9731-48ea-860e-8a02cb6a0ad9 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:53:02 user nova-compute[72239]: DEBUG nova.compute.manager [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:53:02 user nova-compute[72239]: DEBUG nova.objects.instance [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lazy-loading 'pci_requests' on Instance uuid c10918e9-9731-48ea-860e-8a02cb6a0ad9 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:53:02 user nova-compute[72239]: DEBUG nova.objects.instance [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lazy-loading 'pci_devices' on Instance uuid c10918e9-9731-48ea-860e-8a02cb6a0ad9 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:53:02 user nova-compute[72239]: DEBUG nova.objects.instance [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lazy-loading 'resources' on Instance uuid c10918e9-9731-48ea-860e-8a02cb6a0ad9 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:53:02 user nova-compute[72239]: DEBUG nova.objects.instance [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lazy-loading 'migration_context' on Instance uuid c10918e9-9731-48ea-860e-8a02cb6a0ad9 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:53:02 user nova-compute[72239]: DEBUG nova.objects.instance [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72239) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 31 14:53:02 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:53:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:02 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Took 1.98 seconds to deallocate network for instance.
Jul 31 14:53:02 user nova-compute[72239]: DEBUG nova.compute.manager [req-fb542c47-6335-4925-815c-aae9311d741a req-5de90491-0b50-4248-8580-3d44351b2010 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Received event network-vif-deleted-d6ef6541-6b7e-4dc5-8149-a10940dfe87b {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:53:02 user nova-compute[72239]: INFO nova.compute.manager [req-fb542c47-6335-4925-815c-aae9311d741a req-5de90491-0b50-4248-8580-3d44351b2010 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Neutron deleted interface d6ef6541-6b7e-4dc5-8149-a10940dfe87b; detaching it from the instance and deleting it from the info cache
Jul 31 14:53:02 user nova-compute[72239]: DEBUG nova.network.neutron [req-fb542c47-6335-4925-815c-aae9311d741a req-5de90491-0b50-4248-8580-3d44351b2010 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:53:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:02 user nova-compute[72239]: DEBUG nova.compute.manager [req-fb542c47-6335-4925-815c-aae9311d741a req-5de90491-0b50-4248-8580-3d44351b2010 service nova] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Detach interface failed, port_id=d6ef6541-6b7e-4dc5-8149-a10940dfe87b, reason: Instance d3e3612b-c6b9-4308-a45a-1ff3805e18bb could not be found. {{(pid=72239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 14:53:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:02 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:53:02 user nova-compute[72239]: DEBUG nova.compute.manager [req-8dc32d03-6fba-4f5b-9d5d-b084802b5dab req-0a38019b-eb39-4a1d-ad9a-d50e1fc169c2 service nova] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Received event network-vif-unplugged-8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:53:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-8dc32d03-6fba-4f5b-9d5d-b084802b5dab req-0a38019b-eb39-4a1d-ad9a-d50e1fc169c2 service nova] Acquiring lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:53:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-8dc32d03-6fba-4f5b-9d5d-b084802b5dab req-0a38019b-eb39-4a1d-ad9a-d50e1fc169c2 service nova] Lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:53:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-8dc32d03-6fba-4f5b-9d5d-b084802b5dab req-0a38019b-eb39-4a1d-ad9a-d50e1fc169c2 service nova] Lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:53:02 user nova-compute[72239]: DEBUG nova.compute.manager [req-8dc32d03-6fba-4f5b-9d5d-b084802b5dab req-0a38019b-eb39-4a1d-ad9a-d50e1fc169c2 service nova] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] No waiting events found dispatching network-vif-unplugged-8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:53:02 user nova-compute[72239]: WARNING nova.compute.manager [req-8dc32d03-6fba-4f5b-9d5d-b084802b5dab req-0a38019b-eb39-4a1d-ad9a-d50e1fc169c2 service nova] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Received unexpected event network-vif-unplugged-8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed for instance with vm_state active and task_state rebuilding.
Jul 31 14:53:02 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Instance destroyed successfully.
Jul 31 14:53:03 user nova-compute[72239]: INFO nova.compute.manager [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Detaching volume dc2112e3-a3ce-416f-ab29-be87255daa36
Jul 31 14:53:03 user nova-compute[72239]: INFO nova.virt.block_device [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Attempting to driver detach volume dc2112e3-a3ce-416f-ab29-be87255daa36 from mountpoint /dev/vdb
Jul 31 14:53:03 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Attempting to detach device vdb from instance c10918e9-9731-48ea-860e-8a02cb6a0ad9 from the persistent domain config. {{(pid=72239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 14:53:03 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:53:03 user nova-compute[72239]:   <source dev="/dev/sdd"/>
Jul 31 14:53:03 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:53:03 user nova-compute[72239]:   <serial>dc2112e3-a3ce-416f-ab29-be87255daa36</serial>
Jul 31 14:53:03 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 14:53:03 user nova-compute[72239]: </disk>
Jul 31 14:53:03 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 14:53:03 user nova-compute[72239]: INFO nova.compute.manager [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Took 1.00 seconds to detach 1 volumes for instance.
Jul 31 14:53:03 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Successfully detached device vdb from instance c10918e9-9731-48ea-860e-8a02cb6a0ad9 from the persistent domain config.
Jul 31 14:53:03 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NWHqjgwZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:53:03 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 31 14:53:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a21f299-d2b9-44fd-b071-6811dd6eb0f5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ede5c1-81ab-447d-a194-46f28fcf0d66]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:53:03 user nova-compute[72239]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:53:03 user nova-compute[72239]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)
Jul 31 14:53:03 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:53:03 user nova-compute[72239]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:53:03 user nova-compute[72239]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)
Jul 31 14:53:03 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4120404160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36'): ({'sdd'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Removing single pathed devices sdd {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2988bf-da7e-460a-a337-eea142408342]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8853e114-e342-4962-8328-1aec90ca08d3]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Flushing IO for device /dev/sdd {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7cded2-9e08-4679-ae0a-92dc522fac30]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb24cf9-e747-46c9-aef4-362cdc26d8c5]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] SCSI volumes sdd have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a13beb2-e1b8-40e1-8edc-a8c89f3d8a64]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-7d81b881-b44e-4fb3-8245-9dea634bdec9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-7d81b881-b44e-4fb3-8245-9dea634bdec9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d90e6ba-25f1-4cee-a4f6-65e7e86b538a]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36, portal: 172.16.0.220,3260]
Jul 31 14:53:03 user nova-compute[72239]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36, portal: 172.16.0.220,3260] successful.
Jul 31 14:53:03 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[613ea696-ad38-4b98-98f4-7039214471a8]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] <== disconnect_volume: return (296ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.436s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:53:03 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Deleted allocations for instance d3e3612b-c6b9-4308-a45a-1ff3805e18bb
Jul 31 14:53:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-753c6bae-7515-4981-9275-3723a36f9ed0 tempest-ServerActionsTestOtherB-858495710 tempest-ServerActionsTestOtherB-858495710-project-member] Lock "d3e3612b-c6b9-4308-a45a-1ff3805e18bb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.995s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Acquiring lock "99961538-dde9-4f3b-9c87-ceb07a10e7dc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "99961538-dde9-4f3b-9c87-ceb07a10e7dc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:53:03 user nova-compute[72239]: DEBUG nova.compute.manager [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Updating instance_info_cache with network_info: [{"id": "60f70f18-4024-4388-ae64-3c2cca0cafbc", "address": "fa:16:3e:a5:de:4b", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f70f18-40", "ovs_interfaceid": "60f70f18-4024-4388-ae64-3c2cca0cafbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-7d81b881-b44e-4fb3-8245-9dea634bdec9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 14:53:04 user nova-compute[72239]: INFO nova.compute.claims [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Claim successful on node user
Jul 31 14:53:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:04 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Instance destroyed successfully.
Jul 31 14:53:04 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1591567707',display_name='tempest-ServerActionsTestOtherA-server-1620341665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1591567707',id=16,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcC0f3guhYTNzECKpfyNk4cXj6Y8F4GpucRwb/0EBaXIalClpDyM69s13M23SyVQiCvr0tglg8FRaf5C4ibRcE2Gd6CEj06wnsuSnTBc8jPOcwf8pDTnQMrdikVLzRidg==',key_name='tempest-keypair-538819016',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:49:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='217b0eef1c154602850f4cf2d81b7ead',ramdisk_id='',reservation_id='r-qi1uxdkp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-456571617',owner_user_name='tempest-ServerActionsTestOtherA-456571617-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:53:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0e2796894b249cc868a888fac759983',uuid=c10918e9-9731-48ea-860e-8a02cb6a0ad9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "address": "fa:16:3e:56:1c:d6", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8307e7-0d", "ovs_interfaceid": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Converting VIF {"id": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "address": "fa:16:3e:56:1c:d6", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8307e7-0d", "ovs_interfaceid": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:1c:d6,bridge_name='br-int',has_traffic_filtering=True,id=8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed,network=Network(6d954fa8-21ae-4438-b6c0-6ae7fb37718c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8307e7-0d') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG os_vif [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:1c:d6,bridge_name='br-int',has_traffic_filtering=True,id=8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed,network=Network(6d954fa8-21ae-4438-b6c0-6ae7fb37718c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8307e7-0d') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b8307e7-0d, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:53:04 user nova-compute[72239]: INFO os_vif [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:1c:d6,bridge_name='br-int',has_traffic_filtering=True,id=8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed,network=Network(6d954fa8-21ae-4438-b6c0-6ae7fb37718c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8307e7-0d')
Jul 31 14:53:04 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NWHqjgwZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:53:04 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 31 14:53:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac65505-e608-43c0-a6e8-3c62c83c755b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG nova.compute.manager [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.447s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22321f1-a617-4cf2-b627-3e305f41a395]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:53:04 user nova-compute[72239]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:53:04 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:53:04 user nova-compute[72239]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:53:04 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4118381c60>, {}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Disconnecting from: [] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.050s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] <== disconnect_volume: return (52ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 14:53:04 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Deleting instance files /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9_del
Jul 31 14:53:04 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Deletion of /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9_del complete
Jul 31 14:53:04 user nova-compute[72239]: DEBUG nova.compute.manager [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG nova.network.neutron [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 14:53:04 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 14:53:04 user nova-compute[72239]: DEBUG nova.compute.manager [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG nova.compute.manager [req-3a0f4247-f667-4d0e-b82c-5a1ac44d7946 req-5feca99a-7303-4a37-b546-eba53e94a3a3 service nova] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Received event network-vif-plugged-8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-3a0f4247-f667-4d0e-b82c-5a1ac44d7946 req-5feca99a-7303-4a37-b546-eba53e94a3a3 service nova] Acquiring lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-3a0f4247-f667-4d0e-b82c-5a1ac44d7946 req-5feca99a-7303-4a37-b546-eba53e94a3a3 service nova] Lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-3a0f4247-f667-4d0e-b82c-5a1ac44d7946 req-5feca99a-7303-4a37-b546-eba53e94a3a3 service nova] Lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG nova.compute.manager [req-3a0f4247-f667-4d0e-b82c-5a1ac44d7946 req-5feca99a-7303-4a37-b546-eba53e94a3a3 service nova] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] No waiting events found dispatching network-vif-plugged-8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:53:04 user nova-compute[72239]: WARNING nova.compute.manager [req-3a0f4247-f667-4d0e-b82c-5a1ac44d7946 req-5feca99a-7303-4a37-b546-eba53e94a3a3 service nova] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Received unexpected event network-vif-plugged-8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed for instance with vm_state active and task_state rebuilding.
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG nova.policy [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3c842cf4052f4822948614bb63072812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd888450f903d41c5b6fde5de0b513a84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 14:53:04 user nova-compute[72239]: INFO nova.virt.block_device [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Booting with volume dc2112e3-a3ce-416f-ab29-be87255daa36 at /dev/vdb
Jul 31 14:53:04 user nova-compute[72239]: DEBUG nova.compute.manager [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 14:53:04 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Creating image(s)
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Acquiring lock "/opt/stack/data/nova/instances/99961538-dde9-4f3b-9c87-ceb07a10e7dc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "/opt/stack/data/nova/instances/99961538-dde9-4f3b-9c87-ceb07a10e7dc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "/opt/stack/data/nova/instances/99961538-dde9-4f3b-9c87-ceb07a10e7dc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG os_brick.utils [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[599c5ed8-145d-45b5-a612-91d617e83457]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[63378f64-2a8d-4fb1-84ac-958b287e0fc0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed25e6e6-aa14-4cee-8139-592854b2845e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c3e639-de17-45ac-b5ec-6d3b96de3869]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.160s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Acquiring lock "ca449065000c92aac3b7b9fa685f9a7710929444" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:53:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:53:05 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 14:53:05 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e82c26df-f043-4506-bc1f-47205c005992]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:05 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 14:53:05 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 14:53:05 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 14:53:05 user nova-compute[72239]: DEBUG os_brick.utils [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] <== get_connector_properties: return (211ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:53:05 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Updating existing volume attachment record: 256c6152-5d86-404c-98be-ba8aa7fa5f2c {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 14:53:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:05 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Error from libvirt while getting description of instance-00000010: [Error Code 42] Domain not found: no domain with matching uuid 'c10918e9-9731-48ea-860e-8a02cb6a0ad9' (instance-00000010): libvirt.libvirtError: Domain not found: no domain with matching uuid 'c10918e9-9731-48ea-860e-8a02cb6a0ad9' (instance-00000010)
Jul 31 14:53:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.150s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/99961538-dde9-4f3b-9c87-ceb07a10e7dc/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/99961538-dde9-4f3b-9c87-ceb07a10e7dc/disk 1073741824" returned: 0 in 0.107s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:53:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json" returned: 0 in 0.258s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.224s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:05 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Checking if we can resize image /opt/stack/data/nova/instances/99961538-dde9-4f3b-9c87-ceb07a10e7dc/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 14:53:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99961538-dde9-4f3b-9c87-ceb07a10e7dc/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99961538-dde9-4f3b-9c87-ceb07a10e7dc/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:05 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Cannot resize image /opt/stack/data/nova/instances/99961538-dde9-4f3b-9c87-ceb07a10e7dc/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 14:53:05 user nova-compute[72239]: DEBUG nova.objects.instance [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lazy-loading 'migration_context' on Instance uuid 99961538-dde9-4f3b-9c87-ceb07a10e7dc {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:53:05 user nova-compute[72239]: DEBUG nova.network.neutron [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Successfully created port: d4f1a9e6-e739-4938-acd2-8769845f2a63 {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:53:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 14:53:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Ensure instance console log exists: /opt/stack/data/nova/instances/99961538-dde9-4f3b-9c87-ceb07a10e7dc/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 14:53:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:53:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:53:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:53:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:53:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:53:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:06 user nova-compute[72239]: DEBUG nova.network.neutron [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Successfully updated port: d4f1a9e6-e739-4938-acd2-8769845f2a63 {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:53:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:06 user nova-compute[72239]: DEBUG nova.compute.manager [req-51614cd5-2021-4f5b-9adc-36375524aef1 req-b0ba8d19-f218-4692-a678-ccc8444e7595 service nova] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Received event network-changed-d4f1a9e6-e739-4938-acd2-8769845f2a63 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:53:06 user nova-compute[72239]: DEBUG nova.compute.manager [req-51614cd5-2021-4f5b-9adc-36375524aef1 req-b0ba8d19-f218-4692-a678-ccc8444e7595 service nova] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Refreshing instance network info cache due to event network-changed-d4f1a9e6-e739-4938-acd2-8769845f2a63. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:53:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-51614cd5-2021-4f5b-9adc-36375524aef1 req-b0ba8d19-f218-4692-a678-ccc8444e7595 service nova] Acquiring lock "refresh_cache-99961538-dde9-4f3b-9c87-ceb07a10e7dc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:53:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-51614cd5-2021-4f5b-9adc-36375524aef1 req-b0ba8d19-f218-4692-a678-ccc8444e7595 service nova] Acquired lock "refresh_cache-99961538-dde9-4f3b-9c87-ceb07a10e7dc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:53:06 user nova-compute[72239]: DEBUG nova.network.neutron [req-51614cd5-2021-4f5b-9adc-36375524aef1 req-b0ba8d19-f218-4692-a678-ccc8444e7595 service nova] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Refreshing network info cache for port d4f1a9e6-e739-4938-acd2-8769845f2a63 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:53:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Acquiring lock "refresh_cache-99961538-dde9-4f3b-9c87-ceb07a10e7dc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:53:06 user nova-compute[72239]: DEBUG nova.network.neutron [req-51614cd5-2021-4f5b-9adc-36375524aef1 req-b0ba8d19-f218-4692-a678-ccc8444e7595 service nova] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:53:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:06 user nova-compute[72239]: DEBUG nova.network.neutron [req-51614cd5-2021-4f5b-9adc-36375524aef1 req-b0ba8d19-f218-4692-a678-ccc8444e7595 service nova] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:53:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-51614cd5-2021-4f5b-9adc-36375524aef1 req-b0ba8d19-f218-4692-a678-ccc8444e7595 service nova] Releasing lock "refresh_cache-99961538-dde9-4f3b-9c87-ceb07a10e7dc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:53:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Acquired lock "refresh_cache-99961538-dde9-4f3b-9c87-ceb07a10e7dc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:53:06 user nova-compute[72239]: DEBUG nova.network.neutron [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:53:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:06 user nova-compute[72239]: DEBUG nova.network.neutron [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:53:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG nova.network.neutron [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Updating instance_info_cache with network_info: [{"id": "d4f1a9e6-e739-4938-acd2-8769845f2a63", "address": "fa:16:3e:31:ea:2f", "network": {"id": "807530ad-b1c8-4426-9036-a796ba7dee91", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-277511856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d888450f903d41c5b6fde5de0b513a84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f1a9e6-e7", "ovs_interfaceid": "d4f1a9e6-e739-4938-acd2-8769845f2a63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Releasing lock "refresh_cache-99961538-dde9-4f3b-9c87-ceb07a10e7dc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG nova.compute.manager [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Instance network_info: |[{"id": "d4f1a9e6-e739-4938-acd2-8769845f2a63", "address": "fa:16:3e:31:ea:2f", "network": {"id": "807530ad-b1c8-4426-9036-a796ba7dee91", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-277511856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d888450f903d41c5b6fde5de0b513a84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f1a9e6-e7", "ovs_interfaceid": "d4f1a9e6-e739-4938-acd2-8769845f2a63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Start _get_guest_xml network_info=[{"id": "d4f1a9e6-e739-4938-acd2-8769845f2a63", "address": "fa:16:3e:31:ea:2f", "network": {"id": "807530ad-b1c8-4426-9036-a796ba7dee91", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-277511856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d888450f903d41c5b6fde5de0b513a84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f1a9e6-e7", "ovs_interfaceid": "d4f1a9e6-e739-4938-acd2-8769845f2a63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:53:07 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:53:07 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:53:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:53:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2014230836',display_name='tempest-VolumesSnapshotTestJSON-instance-2014230836',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2014230836',id=24,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBITKrPqlRlMHUn+c7c7MiwVi26siELl57cI9X/uLcDzFnH4B2WNXU45YGhJHX/Swj2Jl+FX57hnaGdF3W9OOo+tfLb/hGwkAaatct74oUi/o27VHALGXcvOWJNZaxVua1w==',key_name='tempest-keypair-404801197',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d888450f903d41c5b6fde5de0b513a84',ramdisk_id='',reservation_id='r-vlccrbzr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2087706080',owner_user_name='tempest-VolumesSnapshotTestJSON-2087706080-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:53:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c842cf4052f4822948614bb63072812',uuid=99961538-dde9-4f3b-9c87-ceb07a10e7dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4f1a9e6-e739-4938-acd2-8769845f2a63", "address": "fa:16:3e:31:ea:2f", "network": {"id": "807530ad-b1c8-4426-9036-a796ba7dee91", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-277511856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d888450f903d41c5b6fde5de0b513a84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f1a9e6-e7", "ovs_interfaceid": "d4f1a9e6-e739-4938-acd2-8769845f2a63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Converting VIF {"id": "d4f1a9e6-e739-4938-acd2-8769845f2a63", "address": "fa:16:3e:31:ea:2f", "network": {"id": "807530ad-b1c8-4426-9036-a796ba7dee91", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-277511856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d888450f903d41c5b6fde5de0b513a84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f1a9e6-e7", "ovs_interfaceid": "d4f1a9e6-e739-4938-acd2-8769845f2a63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:ea:2f,bridge_name='br-int',has_traffic_filtering=True,id=d4f1a9e6-e739-4938-acd2-8769845f2a63,network=Network(807530ad-b1c8-4426-9036-a796ba7dee91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4f1a9e6-e7') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG nova.objects.instance [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lazy-loading 'pci_devices' on Instance uuid 99961538-dde9-4f3b-9c87-ceb07a10e7dc {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87dd3b4b-c511-4784-acf9-ad21534c8337/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:53:07 user nova-compute[72239]:   <uuid>99961538-dde9-4f3b-9c87-ceb07a10e7dc</uuid>
Jul 31 14:53:07 user nova-compute[72239]:   <name>instance-00000018</name>
Jul 31 14:53:07 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:53:07 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:53:07 user nova-compute[72239]:   <metadata>
Jul 31 14:53:07 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:53:07 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:53:07 user nova-compute[72239]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-2014230836</nova:name>
Jul 31 14:53:07 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:53:07</nova:creationTime>
Jul 31 14:53:07 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:53:07 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:53:07 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:53:07 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:53:07 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:53:07 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:53:07 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:53:07 user nova-compute[72239]:       <nova:owner>
Jul 31 14:53:07 user nova-compute[72239]:         <nova:user uuid="3c842cf4052f4822948614bb63072812">tempest-VolumesSnapshotTestJSON-2087706080-project-member</nova:user>
Jul 31 14:53:07 user nova-compute[72239]:         <nova:project uuid="d888450f903d41c5b6fde5de0b513a84">tempest-VolumesSnapshotTestJSON-2087706080</nova:project>
Jul 31 14:53:07 user nova-compute[72239]:       </nova:owner>
Jul 31 14:53:07 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:53:07 user nova-compute[72239]:       <nova:ports>
Jul 31 14:53:07 user nova-compute[72239]:         <nova:port uuid="d4f1a9e6-e739-4938-acd2-8769845f2a63">
Jul 31 14:53:07 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 31 14:53:07 user nova-compute[72239]:         </nova:port>
Jul 31 14:53:07 user nova-compute[72239]:       </nova:ports>
Jul 31 14:53:07 user nova-compute[72239]:     </nova:instance>
Jul 31 14:53:07 user nova-compute[72239]:   </metadata>
Jul 31 14:53:07 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:53:07 user nova-compute[72239]:     <system>
Jul 31 14:53:07 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:53:07 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:53:07 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:53:07 user nova-compute[72239]:       <entry name="serial">99961538-dde9-4f3b-9c87-ceb07a10e7dc</entry>
Jul 31 14:53:07 user nova-compute[72239]:       <entry name="uuid">99961538-dde9-4f3b-9c87-ceb07a10e7dc</entry>
Jul 31 14:53:07 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:53:07 user nova-compute[72239]:     </system>
Jul 31 14:53:07 user nova-compute[72239]:   </sysinfo>
Jul 31 14:53:07 user nova-compute[72239]:   <os>
Jul 31 14:53:07 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:53:07 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:53:07 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:53:07 user nova-compute[72239]:   </os>
Jul 31 14:53:07 user nova-compute[72239]:   <features>
Jul 31 14:53:07 user nova-compute[72239]:     <acpi/>
Jul 31 14:53:07 user nova-compute[72239]:     <apic/>
Jul 31 14:53:07 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:53:07 user nova-compute[72239]:   </features>
Jul 31 14:53:07 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:53:07 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:53:07 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:53:07 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:53:07 user nova-compute[72239]:   </clock>
Jul 31 14:53:07 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:53:07 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:53:07 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:53:07 user nova-compute[72239]:   </cpu>
Jul 31 14:53:07 user nova-compute[72239]:   <devices>
Jul 31 14:53:07 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:53:07 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:53:07 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/99961538-dde9-4f3b-9c87-ceb07a10e7dc/disk"/>
Jul 31 14:53:07 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:53:07 user nova-compute[72239]:     </disk>
Jul 31 14:53:07 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:53:07 user nova-compute[72239]:       <mac address="fa:16:3e:31:ea:2f"/>
Jul 31 14:53:07 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:53:07 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:53:07 user nova-compute[72239]:       <target dev="tapd4f1a9e6-e7"/>
Jul 31 14:53:07 user nova-compute[72239]:     </interface>
Jul 31 14:53:07 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:53:07 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/99961538-dde9-4f3b-9c87-ceb07a10e7dc/console.log" append="off"/>
Jul 31 14:53:07 user nova-compute[72239]:     </serial>
Jul 31 14:53:07 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:53:07 user nova-compute[72239]:     <video>
Jul 31 14:53:07 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:53:07 user nova-compute[72239]:     </video>
Jul 31 14:53:07 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:53:07 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:53:07 user nova-compute[72239]:     </rng>
Jul 31 14:53:07 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:53:07 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:53:07 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:53:07 user nova-compute[72239]:     </memballoon>
Jul 31 14:53:07 user nova-compute[72239]:   </devices>
Jul 31 14:53:07 user nova-compute[72239]: </domain>
Jul 31 14:53:07 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:53:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2014230836',display_name='tempest-VolumesSnapshotTestJSON-instance-2014230836',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2014230836',id=24,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBITKrPqlRlMHUn+c7c7MiwVi26siELl57cI9X/uLcDzFnH4B2WNXU45YGhJHX/Swj2Jl+FX57hnaGdF3W9OOo+tfLb/hGwkAaatct74oUi/o27VHALGXcvOWJNZaxVua1w==',key_name='tempest-keypair-404801197',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d888450f903d41c5b6fde5de0b513a84',ramdisk_id='',reservation_id='r-vlccrbzr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-2087706080',owner_user_name='tempest-VolumesSnapshotTestJSON-2087706080-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:53:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c842cf4052f4822948614bb63072812',uuid=99961538-dde9-4f3b-9c87-ceb07a10e7dc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d4f1a9e6-e739-4938-acd2-8769845f2a63", "address": "fa:16:3e:31:ea:2f", "network": {"id": "807530ad-b1c8-4426-9036-a796ba7dee91", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-277511856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d888450f903d41c5b6fde5de0b513a84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f1a9e6-e7", "ovs_interfaceid": "d4f1a9e6-e739-4938-acd2-8769845f2a63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Converting VIF {"id": "d4f1a9e6-e739-4938-acd2-8769845f2a63", "address": "fa:16:3e:31:ea:2f", "network": {"id": "807530ad-b1c8-4426-9036-a796ba7dee91", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-277511856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d888450f903d41c5b6fde5de0b513a84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f1a9e6-e7", "ovs_interfaceid": "d4f1a9e6-e739-4938-acd2-8769845f2a63", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:ea:2f,bridge_name='br-int',has_traffic_filtering=True,id=d4f1a9e6-e739-4938-acd2-8769845f2a63,network=Network(807530ad-b1c8-4426-9036-a796ba7dee91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4f1a9e6-e7') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG os_vif [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:ea:2f,bridge_name='br-int',has_traffic_filtering=True,id=d4f1a9e6-e739-4938-acd2-8769845f2a63,network=Network(807530ad-b1c8-4426-9036-a796ba7dee91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4f1a9e6-e7') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd4f1a9e6-e7, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd4f1a9e6-e7, col_values=(('external_ids', {'iface-id': 'd4f1a9e6-e739-4938-acd2-8769845f2a63', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:ea:2f', 'vm-uuid': '99961538-dde9-4f3b-9c87-ceb07a10e7dc'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:07 user nova-compute[72239]: INFO os_vif [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:ea:2f,bridge_name='br-int',has_traffic_filtering=True,id=d4f1a9e6-e739-4938-acd2-8769845f2a63,network=Network(807530ad-b1c8-4426-9036-a796ba7dee91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4f1a9e6-e7')
Jul 31 14:53:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] No VIF found with MAC fa:16:3e:31:ea:2f, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87dd3b4b-c511-4784-acf9-ad21534c8337/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87dd3b4b-c511-4784-acf9-ad21534c8337/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87dd3b4b-c511-4784-acf9-ad21534c8337/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815191.2046456, 99961538-dde9-4f3b-9c87-ceb07a10e7dc => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:53:11 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] VM Resumed (Lifecycle Event)
Jul 31 14:53:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690815174.0015948, 82116af8-3702-401b-8d00-9291d4caeb03 => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:53:11 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] VM Stopped (Lifecycle Event)
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.compute.manager [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.compute.manager [req-58365d84-ade6-4c50-b300-4aa171b114a1 req-549bb1e9-fc69-4300-821a-4a2370269ca2 service nova] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Received event network-vif-plugged-d4f1a9e6-e739-4938-acd2-8769845f2a63 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-58365d84-ade6-4c50-b300-4aa171b114a1 req-549bb1e9-fc69-4300-821a-4a2370269ca2 service nova] Acquiring lock "99961538-dde9-4f3b-9c87-ceb07a10e7dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-58365d84-ade6-4c50-b300-4aa171b114a1 req-549bb1e9-fc69-4300-821a-4a2370269ca2 service nova] Lock "99961538-dde9-4f3b-9c87-ceb07a10e7dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-58365d84-ade6-4c50-b300-4aa171b114a1 req-549bb1e9-fc69-4300-821a-4a2370269ca2 service nova] Lock "99961538-dde9-4f3b-9c87-ceb07a10e7dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.compute.manager [req-58365d84-ade6-4c50-b300-4aa171b114a1 req-549bb1e9-fc69-4300-821a-4a2370269ca2 service nova] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] No waiting events found dispatching network-vif-plugged-d4f1a9e6-e739-4938-acd2-8769845f2a63 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:53:11 user nova-compute[72239]: WARNING nova.compute.manager [req-58365d84-ade6-4c50-b300-4aa171b114a1 req-549bb1e9-fc69-4300-821a-4a2370269ca2 service nova] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Received unexpected event network-vif-plugged-d4f1a9e6-e739-4938-acd2-8769845f2a63 for instance with vm_state building and task_state spawning.
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.compute.manager [req-0e504d9b-ca53-4371-bcd0-6203b67761bf req-7f37087e-5fb0-48c9-ba90-eb55cf8df904 service nova] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Received event network-vif-plugged-d4f1a9e6-e739-4938-acd2-8769845f2a63 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0e504d9b-ca53-4371-bcd0-6203b67761bf req-7f37087e-5fb0-48c9-ba90-eb55cf8df904 service nova] Acquiring lock "99961538-dde9-4f3b-9c87-ceb07a10e7dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0e504d9b-ca53-4371-bcd0-6203b67761bf req-7f37087e-5fb0-48c9-ba90-eb55cf8df904 service nova] Lock "99961538-dde9-4f3b-9c87-ceb07a10e7dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0e504d9b-ca53-4371-bcd0-6203b67761bf req-7f37087e-5fb0-48c9-ba90-eb55cf8df904 service nova] Lock "99961538-dde9-4f3b-9c87-ceb07a10e7dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.compute.manager [req-0e504d9b-ca53-4371-bcd0-6203b67761bf req-7f37087e-5fb0-48c9-ba90-eb55cf8df904 service nova] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] No waiting events found dispatching network-vif-plugged-d4f1a9e6-e739-4938-acd2-8769845f2a63 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:53:11 user nova-compute[72239]: WARNING nova.compute.manager [req-0e504d9b-ca53-4371-bcd0-6203b67761bf req-7f37087e-5fb0-48c9-ba90-eb55cf8df904 service nova] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Received unexpected event network-vif-plugged-d4f1a9e6-e739-4938-acd2-8769845f2a63 for instance with vm_state building and task_state spawning.
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Acquiring lock "fb09290d-4200-465f-8090-f062572b2e05" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Lock "fb09290d-4200-465f-8090-f062572b2e05" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.compute.manager [None req-f488fe57-6860-496b-a6ad-7c17a538acf7 None None] [instance: 82116af8-3702-401b-8d00-9291d4caeb03] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.objects.instance [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lazy-loading 'flavor' on Instance uuid db15ad45-8f28-4e0c-8d7e-7db75f33fe92 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:53:11 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Instance spawned successfully.
Jul 31 14:53:11 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:53:11 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=7578MB free_disk=25.361251831054688GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.compute.manager [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: fb09290d-4200-465f-8090-f062572b2e05] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 14:53:11 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815191.2050202, 99961538-dde9-4f3b-9c87-ceb07a10e7dc => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:53:11 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] VM Started (Lifecycle Event)
Jul 31 14:53:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "refresh_cache-db15ad45-8f28-4e0c-8d7e-7db75f33fe92" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquired lock "refresh_cache-db15ad45-8f28-4e0c-8d7e-7db75f33fe92" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.network.neutron [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.objects.instance [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lazy-loading 'info_cache' on Instance uuid db15ad45-8f28-4e0c-8d7e-7db75f33fe92 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:53:11 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:53:11 user nova-compute[72239]: INFO nova.compute.manager [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Took 6.92 seconds to spawn the instance on the hypervisor.
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.compute.manager [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 20abf743-de5b-4122-aad0-e2124c7804b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 7d81b881-b44e-4fb3-8245-9dea634bdec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 079a5ed7-ee25-495b-a2a4-924d830a670a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 2f11022e-a007-4d4c-adc1-b54ea59b9e6a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance c10918e9-9731-48ea-860e-8a02cb6a0ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance db15ad45-8f28-4e0c-8d7e-7db75f33fe92 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 14653984-6c32-4ddd-bc0b-203a670c2b4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance c2b3c85b-e939-41d0-8bf0-3a7f650177b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 3559f541-ed61-41b2-9a9d-8b10e18f7375 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 87dd3b4b-c511-4784-acf9-ad21534c8337 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 99961538-dde9-4f3b-9c87-ceb07a10e7dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance fb09290d-4200-465f-8090-f062572b2e05 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 14:53:11 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 14:53:11 user nova-compute[72239]: INFO nova.compute.manager [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Took 7.79 seconds to build instance.
Jul 31 14:53:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d1d0a94e-f1de-449b-aeff-4f45cdece552 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "99961538-dde9-4f3b-9c87-ceb07a10e7dc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.898s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.621s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.460s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 14:53:12 user nova-compute[72239]: INFO nova.compute.claims [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: fb09290d-4200-465f-8090-f062572b2e05] Claim successful on node user
Jul 31 14:53:12 user nova-compute[72239]: DEBUG nova.network.neutron [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Updating instance_info_cache with network_info: [{"id": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "address": "fa:16:3e:55:1a:9a", "network": {"id": "50e01a2d-5e91-4aca-a74c-7687f91ed21e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-937098047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e5e2cd6854f0985aa161b1e8a6db7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a60ced2-5c", "ovs_interfaceid": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Releasing lock "refresh_cache-db15ad45-8f28-4e0c-8d7e-7db75f33fe92" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:53:12 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Instance destroyed successfully.
Jul 31 14:53:12 user nova-compute[72239]: DEBUG nova.objects.instance [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lazy-loading 'resources' on Instance uuid db15ad45-8f28-4e0c-8d7e-7db75f33fe92 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:49:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1651644081',display_name='tempest-AttachVolumeTestJSON-server-1651644081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1651644081',id=17,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLc/1qoHPqiofv/4pq100FlHUUylmOhucQEOjm11Kc1EqvJcfHvM7rWQswLn8aCkbuoEn1btWVn/JCFreVgCA/Qh5g2ERD7C+D0EfwpykQR0pThmq61xI0NeRT3g5N4h2A==',key_name='tempest-keypair-1206654507',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:49:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a18e5e2cd6854f0985aa161b1e8a6db7',ramdisk_id='',reservation_id='r-32farejl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-853601938',owner_user_name='tempest-AttachVolumeTestJSON-853601938-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:51:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f8df817a91d41c8a421e2ba562c5015',uuid=db15ad45-8f28-4e0c-8d7e-7db75f33fe92,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "address": "fa:16:3e:55:1a:9a", "network": {"id": "50e01a2d-5e91-4aca-a74c-7687f91ed21e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-937098047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e5e2cd6854f0985aa161b1e8a6db7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a60ced2-5c", "ovs_interfaceid": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Converting VIF {"id": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "address": "fa:16:3e:55:1a:9a", "network": {"id": "50e01a2d-5e91-4aca-a74c-7687f91ed21e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-937098047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e5e2cd6854f0985aa161b1e8a6db7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a60ced2-5c", "ovs_interfaceid": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:1a:9a,bridge_name='br-int',has_traffic_filtering=True,id=4a60ced2-5c35-4f83-9734-e812bce6fad2,network=Network(50e01a2d-5e91-4aca-a74c-7687f91ed21e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a60ced2-5c') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG os_vif [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:1a:9a,bridge_name='br-int',has_traffic_filtering=True,id=4a60ced2-5c35-4f83-9734-e812bce6fad2,network=Network(50e01a2d-5e91-4aca-a74c-7687f91ed21e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a60ced2-5c') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a60ced2-5c, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:53:12 user nova-compute[72239]: INFO os_vif [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:1a:9a,bridge_name='br-int',has_traffic_filtering=True,id=4a60ced2-5c35-4f83-9734-e812bce6fad2,network=Network(50e01a2d-5e91-4aca-a74c-7687f91ed21e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a60ced2-5c')
Jul 31 14:53:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYFEHIBJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:53:12 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:53:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9b3638-59ef-40a7-ac5c-46f6a0c0b73c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab64cb21-f5c1-4618-b51b-49a5dc7f1886]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:53:12 user nova-compute[72239]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:53:12 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:53:12 user nova-compute[72239]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:53:12 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4120407760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79'): ({'sdc'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Removing single pathed devices sdc {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca055646-5db0-493f-9d1d-0b3c4fcf4369]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[492d1d4a-5cc2-44c4-9263-76832c12da37]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Flushing IO for device /dev/sdc {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4f6b2d-adb0-4e3e-a4ed-7a1338b6bcb7]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8be8282-8bcc-4943-92f9-02cd282bb076]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] SCSI volumes sdc have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bb30d6-de91-4c68-8994-7c3ea9d7fd71]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff3f3fc-ff5b-4dab-925c-caee921cd5ca]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79, portal: 172.16.0.220,3260]
Jul 31 14:53:12 user nova-compute[72239]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79, portal: 172.16.0.220,3260] successful.
Jul 31 14:53:12 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd3cb8d-90e0-48aa-bb41-3f8ebf6a3dd7]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] <== disconnect_volume: return (320ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.540s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG nova.compute.manager [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: fb09290d-4200-465f-8090-f062572b2e05] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Start _get_guest_xml network_info=[{"id": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "address": "fa:16:3e:55:1a:9a", "network": {"id": "50e01a2d-5e91-4aca-a74c-7687f91ed21e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-937098047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e5e2cd6854f0985aa161b1e8a6db7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a60ced2-5c", "ovs_interfaceid": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '8310b4a7-b965-40fb-9a7c-9b5a05218be0', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYFEHIBJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'db15ad45-8f28-4e0c-8d7e-7db75f33fe92', 'attached_at': '', 'detached_at': '', 'volume_id': '96e3e2e1-1942-4ccc-ad2c-33aa63817e79', 'serial': '96e3e2e1-1942-4ccc-ad2c-33aa63817e79'}, 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG nova.objects.instance [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lazy-loading 'numa_topology' on Instance uuid db15ad45-8f28-4e0c-8d7e-7db75f33fe92 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:53:12 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:53:12 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:53:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG nova.objects.instance [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lazy-loading 'vcpu_model' on Instance uuid db15ad45-8f28-4e0c-8d7e-7db75f33fe92 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG nova.compute.manager [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: fb09290d-4200-465f-8090-f062572b2e05] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG nova.network.neutron [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: fb09290d-4200-465f-8090-f062572b2e05] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYFEHIBJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:53:12 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:53:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:53:12 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:53:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:53:12 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 14:53:12 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: fb09290d-4200-465f-8090-f062572b2e05] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG nova.compute.manager [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: fb09290d-4200-465f-8090-f062572b2e05] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b290060a-0a47-48e7-a912-cb0e38578b88]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 14:53:12 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[83017e99-2da1-4166-92cd-18c1bde69d63]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79] added
Jul 31 14:53:12 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 14:53:12 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Creating image(s)
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "/opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "/opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "/opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce714819-83b4-4fd1-9d6d-2e507be691af]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:53:12 user nova-compute[72239]: DEBUG nova.policy [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fb45b0c1b7404ad2835ebab1ca3b4ff6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a74501c9a7e4063b3f84e4bf0f15559', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f226b4-4219-49c6-be33-6946151f50e2]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UYFEHIBJ {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UYFEHIBJ" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de50567-e4df-4976-bd95-769e6e5cc9d6]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UYFEHIBJ'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG nova.compute.manager [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: fb09290d-4200-465f-8090-f062572b2e05] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: fb09290d-4200-465f-8090-f062572b2e05] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 14:53:13 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: fb09290d-4200-465f-8090-f062572b2e05] Creating image(s)
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Acquiring lock "/opt/stack/data/nova/instances/fb09290d-4200-465f-8090-f062572b2e05/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Lock "/opt/stack/data/nova/instances/fb09290d-4200-465f-8090-f062572b2e05/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Lock "/opt/stack/data/nova/instances/fb09290d-4200-465f-8090-f062572b2e05/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b875ad-1013-416b-aa40-ce532fd60e02]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.160s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "ca449065000c92aac3b7b9fa685f9a7710929444" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e27d8f4-ee51-4e27-99c0-4200cedd6584]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:53:13 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:53:13 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5ac336-e299-4f10-aa9d-f63f4a456a22]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79, portal: 172.16.0.220,3260]
Jul 31 14:53:13 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79, portal: 172.16.0.220,3260] successful.
Jul 31 14:53:13 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.155s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Acquiring lock "ca449065000c92aac3b7b9fa685f9a7710929444" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0925219f-b1ec-4cd4-8bac-76dd88e14a54]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.153s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6306cd-3969-4ad7-aa35-b34ee43b1544]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:53:13 user nova-compute[72239]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:53:13 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:53:13 user nova-compute[72239]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:53:13 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.427s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk 1073741824" returned: 0 in 0.050s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.206s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ecb6e5-c2f0-42cd-8ab8-7c5fd1e2f3a4]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.140s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYFEHIBJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.150s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.157s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/fb09290d-4200-465f-8090-f062572b2e05/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/fb09290d-4200-465f-8090-f062572b2e05/disk 1073741824" returned: 0 in 0.057s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Cannot resize image /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Ensure instance console log exists: /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Start _get_guest_xml network_info=[{"id": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "address": "fa:16:3e:56:1c:d6", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8307e7-0d", "ovs_interfaceid": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': '256c6152-5d86-404c-98be-ba8aa7fa5f2c', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NWHqjgwZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c10918e9-9731-48ea-860e-8a02cb6a0ad9', 'attached_at': '', 'detached_at': '', 'volume_id': 'dc2112e3-a3ce-416f-ab29-be87255daa36', 'serial': 'dc2112e3-a3ce-416f-ab29-be87255daa36'}, 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:53:13 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 31 14:53:13 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 31 14:53:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG nova.objects.instance [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lazy-loading 'vcpu_model' on Instance uuid c10918e9-9731-48ea-860e-8a02cb6a0ad9 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG nova.network.neutron [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: fb09290d-4200-465f-8090-f062572b2e05] Successfully created port: 2f5911fe-ab67-43db-b108-a8a97eca6bbc {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NWHqjgwZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:53:13 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 31 14:53:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.154s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fb09290d-4200-465f-8090-f062572b2e05/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb09290d-4200-465f-8090-f062572b2e05/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb09290d-4200-465f-8090-f062572b2e05/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Cannot resize image /opt/stack/data/nova/instances/fb09290d-4200-465f-8090-f062572b2e05/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG nova.objects.instance [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Lazy-loading 'migration_context' on Instance uuid fb09290d-4200-465f-8090-f062572b2e05 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: fb09290d-4200-465f-8090-f062572b2e05] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: fb09290d-4200-465f-8090-f062572b2e05] Ensure instance console log exists: /opt/stack/data/nova/instances/fb09290d-4200-465f-8090-f062572b2e05/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:53:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.528s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] <== connect_volume: return (1530ms) {'type': 'block', 'scsi_wwn': '26338313637336362', 'path': '/dev/sdb'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338313637336362', 'path': '/dev/sdb'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.673s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:53:14 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 31 14:53:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:53:14 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c72092-14f8-46ad-9d77-1a801d110605]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 14:53:14 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:49:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1651644081',display_name='tempest-AttachVolumeTestJSON-server-1651644081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1651644081',id=17,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLc/1qoHPqiofv/4pq100FlHUUylmOhucQEOjm11Kc1EqvJcfHvM7rWQswLn8aCkbuoEn1btWVn/JCFreVgCA/Qh5g2ERD7C+D0EfwpykQR0pThmq61xI0NeRT3g5N4h2A==',key_name='tempest-keypair-1206654507',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:49:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a18e5e2cd6854f0985aa161b1e8a6db7',ramdisk_id='',reservation_id='r-32farejl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-853601938',owner_user_name='tempest-AttachVolumeTestJSON-853601938-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:51:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f8df817a91d41c8a421e2ba562c5015',uuid=db15ad45-8f28-4e0c-8d7e-7db75f33fe92,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "address": "fa:16:3e:55:1a:9a", "network": {"id": "50e01a2d-5e91-4aca-a74c-7687f91ed21e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-937098047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e5e2cd6854f0985aa161b1e8a6db7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a60ced2-5c", "ovs_interfaceid": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Converting VIF {"id": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "address": "fa:16:3e:55:1a:9a", "network": {"id": "50e01a2d-5e91-4aca-a74c-7687f91ed21e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-937098047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e5e2cd6854f0985aa161b1e8a6db7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a60ced2-5c", "ovs_interfaceid": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:1a:9a,bridge_name='br-int',has_traffic_filtering=True,id=4a60ced2-5c35-4f83-9734-e812bce6fad2,network=Network(50e01a2d-5e91-4aca-a74c-7687f91ed21e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a60ced2-5c') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG nova.objects.instance [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lazy-loading 'pci_devices' on Instance uuid db15ad45-8f28-4e0c-8d7e-7db75f33fe92 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:53:14 user nova-compute[72239]:   <uuid>db15ad45-8f28-4e0c-8d7e-7db75f33fe92</uuid>
Jul 31 14:53:14 user nova-compute[72239]:   <name>instance-00000011</name>
Jul 31 14:53:14 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:53:14 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:53:14 user nova-compute[72239]:   <metadata>
Jul 31 14:53:14 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:53:14 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:53:14 user nova-compute[72239]:       <nova:name>tempest-AttachVolumeTestJSON-server-1651644081</nova:name>
Jul 31 14:53:14 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:53:12</nova:creationTime>
Jul 31 14:53:14 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:53:14 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:53:14 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:53:14 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:53:14 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:53:14 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:53:14 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:53:14 user nova-compute[72239]:       <nova:owner>
Jul 31 14:53:14 user nova-compute[72239]:         <nova:user uuid="2f8df817a91d41c8a421e2ba562c5015">tempest-AttachVolumeTestJSON-853601938-project-member</nova:user>
Jul 31 14:53:14 user nova-compute[72239]:         <nova:project uuid="a18e5e2cd6854f0985aa161b1e8a6db7">tempest-AttachVolumeTestJSON-853601938</nova:project>
Jul 31 14:53:14 user nova-compute[72239]:       </nova:owner>
Jul 31 14:53:14 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:53:14 user nova-compute[72239]:       <nova:ports>
Jul 31 14:53:14 user nova-compute[72239]:         <nova:port uuid="4a60ced2-5c35-4f83-9734-e812bce6fad2">
Jul 31 14:53:14 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 31 14:53:14 user nova-compute[72239]:         </nova:port>
Jul 31 14:53:14 user nova-compute[72239]:       </nova:ports>
Jul 31 14:53:14 user nova-compute[72239]:     </nova:instance>
Jul 31 14:53:14 user nova-compute[72239]:   </metadata>
Jul 31 14:53:14 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:53:14 user nova-compute[72239]:     <system>
Jul 31 14:53:14 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:53:14 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:53:14 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:53:14 user nova-compute[72239]:       <entry name="serial">db15ad45-8f28-4e0c-8d7e-7db75f33fe92</entry>
Jul 31 14:53:14 user nova-compute[72239]:       <entry name="uuid">db15ad45-8f28-4e0c-8d7e-7db75f33fe92</entry>
Jul 31 14:53:14 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:53:14 user nova-compute[72239]:     </system>
Jul 31 14:53:14 user nova-compute[72239]:   </sysinfo>
Jul 31 14:53:14 user nova-compute[72239]:   <os>
Jul 31 14:53:14 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:53:14 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:53:14 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:53:14 user nova-compute[72239]:   </os>
Jul 31 14:53:14 user nova-compute[72239]:   <features>
Jul 31 14:53:14 user nova-compute[72239]:     <acpi/>
Jul 31 14:53:14 user nova-compute[72239]:     <apic/>
Jul 31 14:53:14 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:53:14 user nova-compute[72239]:   </features>
Jul 31 14:53:14 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:53:14 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:53:14 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:53:14 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:53:14 user nova-compute[72239]:   </clock>
Jul 31 14:53:14 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:53:14 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:53:14 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:53:14 user nova-compute[72239]:   </cpu>
Jul 31 14:53:14 user nova-compute[72239]:   <devices>
Jul 31 14:53:14 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:53:14 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:53:14 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk"/>
Jul 31 14:53:14 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:53:14 user nova-compute[72239]:     </disk>
Jul 31 14:53:14 user nova-compute[72239]:     <disk type="block" device="disk">
Jul 31 14:53:14 user nova-compute[72239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:53:14 user nova-compute[72239]:       <source dev="/dev/sdb"/>
Jul 31 14:53:14 user nova-compute[72239]:       <target dev="vdb" bus="virtio"/>
Jul 31 14:53:14 user nova-compute[72239]:       <serial>96e3e2e1-1942-4ccc-ad2c-33aa63817e79</serial>
Jul 31 14:53:14 user nova-compute[72239]:     </disk>
Jul 31 14:53:14 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:53:14 user nova-compute[72239]:       <mac address="fa:16:3e:55:1a:9a"/>
Jul 31 14:53:14 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:53:14 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:53:14 user nova-compute[72239]:       <target dev="tap4a60ced2-5c"/>
Jul 31 14:53:14 user nova-compute[72239]:     </interface>
Jul 31 14:53:14 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:53:14 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/console.log" append="off"/>
Jul 31 14:53:14 user nova-compute[72239]:     </serial>
Jul 31 14:53:14 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:53:14 user nova-compute[72239]:     <video>
Jul 31 14:53:14 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:53:14 user nova-compute[72239]:     </video>
Jul 31 14:53:14 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:53:14 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:53:14 user nova-compute[72239]:     </rng>
Jul 31 14:53:14 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:53:14 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:53:14 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:53:14 user nova-compute[72239]:     </memballoon>
Jul 31 14:53:14 user nova-compute[72239]:   </devices>
Jul 31 14:53:14 user nova-compute[72239]: </domain>
Jul 31 14:53:14 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec94360-ed13-4182-86ca-d1ce1c1528e3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36] added
Jul 31 14:53:14 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff384e31-be47-42d6-b6e4-4c135613fcde]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec64c195-4bc7-4d38-b867-fef68c8a8e50]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NWHqjgwZ {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NWHqjgwZ" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48452e3-9367-407d-9d28-7f469a29b8d8]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NWHqjgwZ'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3d04ef-7f60-4028-9855-e00d2e4b3aa8]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG nova.network.neutron [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: fb09290d-4200-465f-8090-f062572b2e05] Successfully updated port: 2f5911fe-ab67-43db-b108-a8a97eca6bbc {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee6c3723-fb80-4003-a433-b1aeb294aa00]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:53:14 user nova-compute[72239]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:53:14 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:53:14 user nova-compute[72239]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:53:14 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Acquiring lock "refresh_cache-fb09290d-4200-465f-8090-f062572b2e05" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Acquired lock "refresh_cache-fb09290d-4200-465f-8090-f062572b2e05" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG nova.network.neutron [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: fb09290d-4200-465f-8090-f062572b2e05] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG nova.compute.manager [req-272da814-0f7a-4248-be52-c07da70b1b72 req-315e6445-2bb0-45a3-9c10-4532ade13715 service nova] [instance: fb09290d-4200-465f-8090-f062572b2e05] Received event network-changed-2f5911fe-ab67-43db-b108-a8a97eca6bbc {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG nova.compute.manager [req-272da814-0f7a-4248-be52-c07da70b1b72 req-315e6445-2bb0-45a3-9c10-4532ade13715 service nova] [instance: fb09290d-4200-465f-8090-f062572b2e05] Refreshing instance network info cache due to event network-changed-2f5911fe-ab67-43db-b108-a8a97eca6bbc. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-272da814-0f7a-4248-be52-c07da70b1b72 req-315e6445-2bb0-45a3-9c10-4532ade13715 service nova] Acquiring lock "refresh_cache-fb09290d-4200-465f-8090-f062572b2e05" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690815179.7206454, d3e3612b-c6b9-4308-a45a-1ff3805e18bb => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:53:14 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] VM Stopped (Lifecycle Event)
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[48779976-4c72-4894-9bf4-6298dc93a32b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36, portal: 172.16.0.220,3260]
Jul 31 14:53:14 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36, portal: 172.16.0.220,3260] successful.
Jul 31 14:53:14 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG nova.network.neutron [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: fb09290d-4200-465f-8090-f062572b2e05] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG nova.compute.manager [None req-6dea8d45-da95-400d-8a6e-cda92812ba29 None None] [instance: d3e3612b-c6b9-4308-a45a-1ff3805e18bb] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[88276523-d5e7-4edb-913c-5c270834c79d]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG nova.objects.instance [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lazy-loading 'trusted_certs' on Instance uuid db15ad45-8f28-4e0c-8d7e-7db75f33fe92 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b539ad-e1db-4e21-a91b-9f9e6edac168]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:53:14 user nova-compute[72239]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:53:14 user nova-compute[72239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)
Jul 31 14:53:14 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:53:14 user nova-compute[72239]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:53:14 user nova-compute[72239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)
Jul 31 14:53:14 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.431s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8f0f02d-638d-4ca7-a5c1-2710d739b4e0]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: None {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.149s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Checking if we can resize image /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 14:53:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Cannot resize image /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.objects.instance [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lazy-loading 'migration_context' on Instance uuid db15ad45-8f28-4e0c-8d7e-7db75f33fe92 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:49:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1651644081',display_name='tempest-AttachVolumeTestJSON-server-1651644081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1651644081',id=17,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLc/1qoHPqiofv/4pq100FlHUUylmOhucQEOjm11Kc1EqvJcfHvM7rWQswLn8aCkbuoEn1btWVn/JCFreVgCA/Qh5g2ERD7C+D0EfwpykQR0pThmq61xI0NeRT3g5N4h2A==',key_name='tempest-keypair-1206654507',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:49:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='a18e5e2cd6854f0985aa161b1e8a6db7',ramdisk_id='',reservation_id='r-32farejl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-853601938',owner_user_name='tempest-AttachVolumeTestJSON-853601938-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:51:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f8df817a91d41c8a421e2ba562c5015',uuid=db15ad45-8f28-4e0c-8d7e-7db75f33fe92,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "address": "fa:16:3e:55:1a:9a", "network": {"id": "50e01a2d-5e91-4aca-a74c-7687f91ed21e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-937098047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e5e2cd6854f0985aa161b1e8a6db7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a60ced2-5c", "ovs_interfaceid": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Converting VIF {"id": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "address": "fa:16:3e:55:1a:9a", "network": {"id": "50e01a2d-5e91-4aca-a74c-7687f91ed21e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-937098047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e5e2cd6854f0985aa161b1e8a6db7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a60ced2-5c", "ovs_interfaceid": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:1a:9a,bridge_name='br-int',has_traffic_filtering=True,id=4a60ced2-5c35-4f83-9734-e812bce6fad2,network=Network(50e01a2d-5e91-4aca-a74c-7687f91ed21e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a60ced2-5c') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG os_vif [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:1a:9a,bridge_name='br-int',has_traffic_filtering=True,id=4a60ced2-5c35-4f83-9734-e812bce6fad2,network=Network(50e01a2d-5e91-4aca-a74c-7687f91ed21e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a60ced2-5c') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a60ced2-5c, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4a60ced2-5c, col_values=(('external_ids', {'iface-id': '4a60ced2-5c35-4f83-9734-e812bce6fad2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:1a:9a', 'vm-uuid': 'db15ad45-8f28-4e0c-8d7e-7db75f33fe92'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.network.neutron [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: fb09290d-4200-465f-8090-f062572b2e05] Updating instance_info_cache with network_info: [{"id": "2f5911fe-ab67-43db-b108-a8a97eca6bbc", "address": "fa:16:3e:45:61:6c", "network": {"id": "bcfa9b25-4156-49df-8aa7-70f499ea3479", "bridge": "br-int", "label": "tempest-VolumesActionsTest-203290973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a74501c9a7e4063b3f84e4bf0f15559", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5911fe-ab", "ovs_interfaceid": "2f5911fe-ab67-43db-b108-a8a97eca6bbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:15 user nova-compute[72239]: INFO os_vif [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:1a:9a,bridge_name='br-int',has_traffic_filtering=True,id=4a60ced2-5c35-4f83-9734-e812bce6fad2,network=Network(50e01a2d-5e91-4aca-a74c-7687f91ed21e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a60ced2-5c')
Jul 31 14:53:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Releasing lock "refresh_cache-fb09290d-4200-465f-8090-f062572b2e05" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.compute.manager [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: fb09290d-4200-465f-8090-f062572b2e05] Instance network_info: |[{"id": "2f5911fe-ab67-43db-b108-a8a97eca6bbc", "address": "fa:16:3e:45:61:6c", "network": {"id": "bcfa9b25-4156-49df-8aa7-70f499ea3479", "bridge": "br-int", "label": "tempest-VolumesActionsTest-203290973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a74501c9a7e4063b3f84e4bf0f15559", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5911fe-ab", "ovs_interfaceid": "2f5911fe-ab67-43db-b108-a8a97eca6bbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-272da814-0f7a-4248-be52-c07da70b1b72 req-315e6445-2bb0-45a3-9c10-4532ade13715 service nova] Acquired lock "refresh_cache-fb09290d-4200-465f-8090-f062572b2e05" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.network.neutron [req-272da814-0f7a-4248-be52-c07da70b1b72 req-315e6445-2bb0-45a3-9c10-4532ade13715 service nova] [instance: fb09290d-4200-465f-8090-f062572b2e05] Refreshing network info cache for port 2f5911fe-ab67-43db-b108-a8a97eca6bbc {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: fb09290d-4200-465f-8090-f062572b2e05] Start _get_guest_xml network_info=[{"id": "2f5911fe-ab67-43db-b108-a8a97eca6bbc", "address": "fa:16:3e:45:61:6c", "network": {"id": "bcfa9b25-4156-49df-8aa7-70f499ea3479", "bridge": "br-int", "label": "tempest-VolumesActionsTest-203290973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a74501c9a7e4063b3f84e4bf0f15559", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5911fe-ab", "ovs_interfaceid": "2f5911fe-ab67-43db-b108-a8a97eca6bbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:53:15 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:53:15 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:53:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-887893133',display_name='tempest-VolumesActionsTest-instance-887893133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-887893133',id=25,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a74501c9a7e4063b3f84e4bf0f15559',ramdisk_id='',reservation_id='r-4x6n09p1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-200342881',owner_user_name='tempest-VolumesActionsTest-200342881-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:53:13Z,user_data=None,user_id='fb45b0c1b7404ad2835ebab1ca3b4ff6',uuid=fb09290d-4200-465f-8090-f062572b2e05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f5911fe-ab67-43db-b108-a8a97eca6bbc", "address": "fa:16:3e:45:61:6c", "network": {"id": "bcfa9b25-4156-49df-8aa7-70f499ea3479", "bridge": "br-int", "label": "tempest-VolumesActionsTest-203290973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a74501c9a7e4063b3f84e4bf0f15559", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5911fe-ab", "ovs_interfaceid": "2f5911fe-ab67-43db-b108-a8a97eca6bbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Converting VIF {"id": "2f5911fe-ab67-43db-b108-a8a97eca6bbc", "address": "fa:16:3e:45:61:6c", "network": {"id": "bcfa9b25-4156-49df-8aa7-70f499ea3479", "bridge": "br-int", "label": "tempest-VolumesActionsTest-203290973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a74501c9a7e4063b3f84e4bf0f15559", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5911fe-ab", "ovs_interfaceid": "2f5911fe-ab67-43db-b108-a8a97eca6bbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:61:6c,bridge_name='br-int',has_traffic_filtering=True,id=2f5911fe-ab67-43db-b108-a8a97eca6bbc,network=Network(bcfa9b25-4156-49df-8aa7-70f499ea3479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f5911fe-ab') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.objects.instance [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Lazy-loading 'pci_devices' on Instance uuid fb09290d-4200-465f-8090-f062572b2e05 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: fb09290d-4200-465f-8090-f062572b2e05] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:53:15 user nova-compute[72239]:   <uuid>fb09290d-4200-465f-8090-f062572b2e05</uuid>
Jul 31 14:53:15 user nova-compute[72239]:   <name>instance-00000019</name>
Jul 31 14:53:15 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:53:15 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:53:15 user nova-compute[72239]:   <metadata>
Jul 31 14:53:15 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:53:15 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:53:15 user nova-compute[72239]:       <nova:name>tempest-VolumesActionsTest-instance-887893133</nova:name>
Jul 31 14:53:15 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:53:15</nova:creationTime>
Jul 31 14:53:15 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:53:15 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:53:15 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:53:15 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:53:15 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:53:15 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:53:15 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:53:15 user nova-compute[72239]:       <nova:owner>
Jul 31 14:53:15 user nova-compute[72239]:         <nova:user uuid="fb45b0c1b7404ad2835ebab1ca3b4ff6">tempest-VolumesActionsTest-200342881-project-member</nova:user>
Jul 31 14:53:15 user nova-compute[72239]:         <nova:project uuid="2a74501c9a7e4063b3f84e4bf0f15559">tempest-VolumesActionsTest-200342881</nova:project>
Jul 31 14:53:15 user nova-compute[72239]:       </nova:owner>
Jul 31 14:53:15 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:53:15 user nova-compute[72239]:       <nova:ports>
Jul 31 14:53:15 user nova-compute[72239]:         <nova:port uuid="2f5911fe-ab67-43db-b108-a8a97eca6bbc">
Jul 31 14:53:15 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 31 14:53:15 user nova-compute[72239]:         </nova:port>
Jul 31 14:53:15 user nova-compute[72239]:       </nova:ports>
Jul 31 14:53:15 user nova-compute[72239]:     </nova:instance>
Jul 31 14:53:15 user nova-compute[72239]:   </metadata>
Jul 31 14:53:15 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:53:15 user nova-compute[72239]:     <system>
Jul 31 14:53:15 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:53:15 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:53:15 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:53:15 user nova-compute[72239]:       <entry name="serial">fb09290d-4200-465f-8090-f062572b2e05</entry>
Jul 31 14:53:15 user nova-compute[72239]:       <entry name="uuid">fb09290d-4200-465f-8090-f062572b2e05</entry>
Jul 31 14:53:15 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:53:15 user nova-compute[72239]:     </system>
Jul 31 14:53:15 user nova-compute[72239]:   </sysinfo>
Jul 31 14:53:15 user nova-compute[72239]:   <os>
Jul 31 14:53:15 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:53:15 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:53:15 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:53:15 user nova-compute[72239]:   </os>
Jul 31 14:53:15 user nova-compute[72239]:   <features>
Jul 31 14:53:15 user nova-compute[72239]:     <acpi/>
Jul 31 14:53:15 user nova-compute[72239]:     <apic/>
Jul 31 14:53:15 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:53:15 user nova-compute[72239]:   </features>
Jul 31 14:53:15 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:53:15 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:53:15 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:53:15 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:53:15 user nova-compute[72239]:   </clock>
Jul 31 14:53:15 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:53:15 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:53:15 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:53:15 user nova-compute[72239]:   </cpu>
Jul 31 14:53:15 user nova-compute[72239]:   <devices>
Jul 31 14:53:15 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:53:15 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:53:15 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/fb09290d-4200-465f-8090-f062572b2e05/disk"/>
Jul 31 14:53:15 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:53:15 user nova-compute[72239]:     </disk>
Jul 31 14:53:15 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:53:15 user nova-compute[72239]:       <mac address="fa:16:3e:45:61:6c"/>
Jul 31 14:53:15 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:53:15 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:53:15 user nova-compute[72239]:       <target dev="tap2f5911fe-ab"/>
Jul 31 14:53:15 user nova-compute[72239]:     </interface>
Jul 31 14:53:15 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:53:15 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/fb09290d-4200-465f-8090-f062572b2e05/console.log" append="off"/>
Jul 31 14:53:15 user nova-compute[72239]:     </serial>
Jul 31 14:53:15 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:53:15 user nova-compute[72239]:     <video>
Jul 31 14:53:15 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:53:15 user nova-compute[72239]:     </video>
Jul 31 14:53:15 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:53:15 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:53:15 user nova-compute[72239]:     </rng>
Jul 31 14:53:15 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:53:15 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:53:15 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:53:15 user nova-compute[72239]:     </memballoon>
Jul 31 14:53:15 user nova-compute[72239]:   </devices>
Jul 31 14:53:15 user nova-compute[72239]: </domain>
Jul 31 14:53:15 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:53:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-887893133',display_name='tempest-VolumesActionsTest-instance-887893133',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-887893133',id=25,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a74501c9a7e4063b3f84e4bf0f15559',ramdisk_id='',reservation_id='r-4x6n09p1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-200342881',owner_user_name='tempest-VolumesActionsTest-200342881-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:53:13Z,user_data=None,user_id='fb45b0c1b7404ad2835ebab1ca3b4ff6',uuid=fb09290d-4200-465f-8090-f062572b2e05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f5911fe-ab67-43db-b108-a8a97eca6bbc", "address": "fa:16:3e:45:61:6c", "network": {"id": "bcfa9b25-4156-49df-8aa7-70f499ea3479", "bridge": "br-int", "label": "tempest-VolumesActionsTest-203290973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a74501c9a7e4063b3f84e4bf0f15559", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5911fe-ab", "ovs_interfaceid": "2f5911fe-ab67-43db-b108-a8a97eca6bbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Converting VIF {"id": "2f5911fe-ab67-43db-b108-a8a97eca6bbc", "address": "fa:16:3e:45:61:6c", "network": {"id": "bcfa9b25-4156-49df-8aa7-70f499ea3479", "bridge": "br-int", "label": "tempest-VolumesActionsTest-203290973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a74501c9a7e4063b3f84e4bf0f15559", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5911fe-ab", "ovs_interfaceid": "2f5911fe-ab67-43db-b108-a8a97eca6bbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:61:6c,bridge_name='br-int',has_traffic_filtering=True,id=2f5911fe-ab67-43db-b108-a8a97eca6bbc,network=Network(bcfa9b25-4156-49df-8aa7-70f499ea3479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f5911fe-ab') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG os_vif [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:61:6c,bridge_name='br-int',has_traffic_filtering=True,id=2f5911fe-ab67-43db-b108-a8a97eca6bbc,network=Network(bcfa9b25-4156-49df-8aa7-70f499ea3479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f5911fe-ab') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f5911fe-ab, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2f5911fe-ab, col_values=(('external_ids', {'iface-id': '2f5911fe-ab67-43db-b108-a8a97eca6bbc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:61:6c', 'vm-uuid': 'fb09290d-4200-465f-8090-f062572b2e05'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:15 user nova-compute[72239]: INFO os_vif [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:61:6c,bridge_name='br-int',has_traffic_filtering=True,id=2f5911fe-ab67-43db-b108-a8a97eca6bbc,network=Network(bcfa9b25-4156-49df-8aa7-70f499ea3479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f5911fe-ab')
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] No VIF found with MAC fa:16:3e:45:61:6c, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.network.neutron [req-272da814-0f7a-4248-be52-c07da70b1b72 req-315e6445-2bb0-45a3-9c10-4532ade13715 service nova] [instance: fb09290d-4200-465f-8090-f062572b2e05] Updated VIF entry in instance network info cache for port 2f5911fe-ab67-43db-b108-a8a97eca6bbc. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.network.neutron [req-272da814-0f7a-4248-be52-c07da70b1b72 req-315e6445-2bb0-45a3-9c10-4532ade13715 service nova] [instance: fb09290d-4200-465f-8090-f062572b2e05] Updating instance_info_cache with network_info: [{"id": "2f5911fe-ab67-43db-b108-a8a97eca6bbc", "address": "fa:16:3e:45:61:6c", "network": {"id": "bcfa9b25-4156-49df-8aa7-70f499ea3479", "bridge": "br-int", "label": "tempest-VolumesActionsTest-203290973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a74501c9a7e4063b3f84e4bf0f15559", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5911fe-ab", "ovs_interfaceid": "2f5911fe-ab67-43db-b108-a8a97eca6bbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-272da814-0f7a-4248-be52-c07da70b1b72 req-315e6445-2bb0-45a3-9c10-4532ade13715 service nova] Releasing lock "refresh_cache-fb09290d-4200-465f-8090-f062572b2e05" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NWHqjgwZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.461s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] <== connect_volume: return (2133ms) {'type': 'block', 'scsi_wwn': '23138356632346631', 'path': '/dev/sdc'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23138356632346631', 'path': '/dev/sdc'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T14:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1591567707',display_name='tempest-ServerActionsTestOtherA-server-1620341665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1591567707',id=16,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcC0f3guhYTNzECKpfyNk4cXj6Y8F4GpucRwb/0EBaXIalClpDyM69s13M23SyVQiCvr0tglg8FRaf5C4ibRcE2Gd6CEj06wnsuSnTBc8jPOcwf8pDTnQMrdikVLzRidg==',key_name='tempest-keypair-538819016',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:49:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='217b0eef1c154602850f4cf2d81b7ead',ramdisk_id='',reservation_id='r-qi1uxdkp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-456571617',owner_user_name='tempest-ServerActionsTestOtherA-456571617-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:53:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0e2796894b249cc868a888fac759983',uuid=c10918e9-9731-48ea-860e-8a02cb6a0ad9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "address": "fa:16:3e:56:1c:d6", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8307e7-0d", "ovs_interfaceid": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Converting VIF {"id": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "address": "fa:16:3e:56:1c:d6", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8307e7-0d", "ovs_interfaceid": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:1c:d6,bridge_name='br-int',has_traffic_filtering=True,id=8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed,network=Network(6d954fa8-21ae-4438-b6c0-6ae7fb37718c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8307e7-0d') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:53:15 user nova-compute[72239]:   <uuid>c10918e9-9731-48ea-860e-8a02cb6a0ad9</uuid>
Jul 31 14:53:15 user nova-compute[72239]:   <name>instance-00000010</name>
Jul 31 14:53:15 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:53:15 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:53:15 user nova-compute[72239]:   <metadata>
Jul 31 14:53:15 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:53:15 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:53:15 user nova-compute[72239]:       <nova:name>tempest-ServerActionsTestOtherA-server-1620341665</nova:name>
Jul 31 14:53:15 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:53:13</nova:creationTime>
Jul 31 14:53:15 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:53:15 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:53:15 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:53:15 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:53:15 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:53:15 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:53:15 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:53:15 user nova-compute[72239]:       <nova:owner>
Jul 31 14:53:15 user nova-compute[72239]:         <nova:user uuid="d0e2796894b249cc868a888fac759983">tempest-ServerActionsTestOtherA-456571617-project-member</nova:user>
Jul 31 14:53:15 user nova-compute[72239]:         <nova:project uuid="217b0eef1c154602850f4cf2d81b7ead">tempest-ServerActionsTestOtherA-456571617</nova:project>
Jul 31 14:53:15 user nova-compute[72239]:       </nova:owner>
Jul 31 14:53:15 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:53:15 user nova-compute[72239]:       <nova:ports>
Jul 31 14:53:15 user nova-compute[72239]:         <nova:port uuid="8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed">
Jul 31 14:53:15 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 31 14:53:15 user nova-compute[72239]:         </nova:port>
Jul 31 14:53:15 user nova-compute[72239]:       </nova:ports>
Jul 31 14:53:15 user nova-compute[72239]:     </nova:instance>
Jul 31 14:53:15 user nova-compute[72239]:   </metadata>
Jul 31 14:53:15 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:53:15 user nova-compute[72239]:     <system>
Jul 31 14:53:15 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:53:15 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:53:15 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:53:15 user nova-compute[72239]:       <entry name="serial">c10918e9-9731-48ea-860e-8a02cb6a0ad9</entry>
Jul 31 14:53:15 user nova-compute[72239]:       <entry name="uuid">c10918e9-9731-48ea-860e-8a02cb6a0ad9</entry>
Jul 31 14:53:15 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:53:15 user nova-compute[72239]:     </system>
Jul 31 14:53:15 user nova-compute[72239]:   </sysinfo>
Jul 31 14:53:15 user nova-compute[72239]:   <os>
Jul 31 14:53:15 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:53:15 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:53:15 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:53:15 user nova-compute[72239]:   </os>
Jul 31 14:53:15 user nova-compute[72239]:   <features>
Jul 31 14:53:15 user nova-compute[72239]:     <acpi/>
Jul 31 14:53:15 user nova-compute[72239]:     <apic/>
Jul 31 14:53:15 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:53:15 user nova-compute[72239]:   </features>
Jul 31 14:53:15 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:53:15 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:53:15 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:53:15 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:53:15 user nova-compute[72239]:   </clock>
Jul 31 14:53:15 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:53:15 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:53:15 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:53:15 user nova-compute[72239]:   </cpu>
Jul 31 14:53:15 user nova-compute[72239]:   <devices>
Jul 31 14:53:15 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:53:15 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:53:15 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk"/>
Jul 31 14:53:15 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:53:15 user nova-compute[72239]:     </disk>
Jul 31 14:53:15 user nova-compute[72239]:     <disk type="block" device="disk">
Jul 31 14:53:15 user nova-compute[72239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:53:15 user nova-compute[72239]:       <source dev="/dev/sdc"/>
Jul 31 14:53:15 user nova-compute[72239]:       <target dev="vdb" bus="virtio"/>
Jul 31 14:53:15 user nova-compute[72239]:       <serial>dc2112e3-a3ce-416f-ab29-be87255daa36</serial>
Jul 31 14:53:15 user nova-compute[72239]:     </disk>
Jul 31 14:53:15 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:53:15 user nova-compute[72239]:       <mac address="fa:16:3e:56:1c:d6"/>
Jul 31 14:53:15 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:53:15 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:53:15 user nova-compute[72239]:       <target dev="tap8b8307e7-0d"/>
Jul 31 14:53:15 user nova-compute[72239]:     </interface>
Jul 31 14:53:15 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:53:15 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/console.log" append="off"/>
Jul 31 14:53:15 user nova-compute[72239]:     </serial>
Jul 31 14:53:15 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:53:15 user nova-compute[72239]:     <video>
Jul 31 14:53:15 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:53:15 user nova-compute[72239]:     </video>
Jul 31 14:53:15 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:53:15 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:53:15 user nova-compute[72239]:     </rng>
Jul 31 14:53:15 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:53:15 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:53:15 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:53:15 user nova-compute[72239]:     </memballoon>
Jul 31 14:53:15 user nova-compute[72239]:   </devices>
Jul 31 14:53:15 user nova-compute[72239]: </domain>
Jul 31 14:53:15 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T14:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1591567707',display_name='tempest-ServerActionsTestOtherA-server-1620341665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1591567707',id=16,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcC0f3guhYTNzECKpfyNk4cXj6Y8F4GpucRwb/0EBaXIalClpDyM69s13M23SyVQiCvr0tglg8FRaf5C4ibRcE2Gd6CEj06wnsuSnTBc8jPOcwf8pDTnQMrdikVLzRidg==',key_name='tempest-keypair-538819016',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:49:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='217b0eef1c154602850f4cf2d81b7ead',ramdisk_id='',reservation_id='r-qi1uxdkp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-456571617',owner_user_name='tempest-ServerActionsTestOtherA-456571617-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:53:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0e2796894b249cc868a888fac759983',uuid=c10918e9-9731-48ea-860e-8a02cb6a0ad9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "address": "fa:16:3e:56:1c:d6", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8307e7-0d", "ovs_interfaceid": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Converting VIF {"id": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "address": "fa:16:3e:56:1c:d6", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8307e7-0d", "ovs_interfaceid": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:1c:d6,bridge_name='br-int',has_traffic_filtering=True,id=8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed,network=Network(6d954fa8-21ae-4438-b6c0-6ae7fb37718c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8307e7-0d') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG os_vif [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:1c:d6,bridge_name='br-int',has_traffic_filtering=True,id=8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed,network=Network(6d954fa8-21ae-4438-b6c0-6ae7fb37718c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8307e7-0d') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b8307e7-0d, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8b8307e7-0d, col_values=(('external_ids', {'iface-id': '8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:1c:d6', 'vm-uuid': 'c10918e9-9731-48ea-860e-8a02cb6a0ad9'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:53:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:15 user nova-compute[72239]: INFO os_vif [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:1c:d6,bridge_name='br-int',has_traffic_filtering=True,id=8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed,network=Network(6d954fa8-21ae-4438-b6c0-6ae7fb37718c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8307e7-0d')
Jul 31 14:53:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:53:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:53:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] No VIF found with MAC fa:16:3e:56:1c:d6, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:53:17 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690815182.912975, c10918e9-9731-48ea-860e-8a02cb6a0ad9 => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:53:17 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] VM Stopped (Lifecycle Event)
Jul 31 14:53:17 user nova-compute[72239]: DEBUG nova.compute.manager [None req-83767a73-a2ba-40ae-ae72-1b09b6de0aef None None] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:53:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:18 user nova-compute[72239]: DEBUG nova.compute.manager [req-99fcaff8-4592-42ab-b7ce-1c0f635b3d10 req-00164e5e-9173-46cc-9a47-3ea221655195 service nova] [instance: fb09290d-4200-465f-8090-f062572b2e05] Received event network-vif-plugged-2f5911fe-ab67-43db-b108-a8a97eca6bbc {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:53:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-99fcaff8-4592-42ab-b7ce-1c0f635b3d10 req-00164e5e-9173-46cc-9a47-3ea221655195 service nova] Acquiring lock "fb09290d-4200-465f-8090-f062572b2e05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:53:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-99fcaff8-4592-42ab-b7ce-1c0f635b3d10 req-00164e5e-9173-46cc-9a47-3ea221655195 service nova] Lock "fb09290d-4200-465f-8090-f062572b2e05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:53:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-99fcaff8-4592-42ab-b7ce-1c0f635b3d10 req-00164e5e-9173-46cc-9a47-3ea221655195 service nova] Lock "fb09290d-4200-465f-8090-f062572b2e05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:53:18 user nova-compute[72239]: DEBUG nova.compute.manager [req-99fcaff8-4592-42ab-b7ce-1c0f635b3d10 req-00164e5e-9173-46cc-9a47-3ea221655195 service nova] [instance: fb09290d-4200-465f-8090-f062572b2e05] No waiting events found dispatching network-vif-plugged-2f5911fe-ab67-43db-b108-a8a97eca6bbc {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:53:18 user nova-compute[72239]: WARNING nova.compute.manager [req-99fcaff8-4592-42ab-b7ce-1c0f635b3d10 req-00164e5e-9173-46cc-9a47-3ea221655195 service nova] [instance: fb09290d-4200-465f-8090-f062572b2e05] Received unexpected event network-vif-plugged-2f5911fe-ab67-43db-b108-a8a97eca6bbc for instance with vm_state building and task_state spawning.
Jul 31 14:53:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:18 user nova-compute[72239]: DEBUG nova.compute.manager [req-d733d44f-000b-4ff4-bdc6-808b87972c59 req-ad1035ff-9139-432f-8f96-d63a77fde165 service nova] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Received event network-vif-plugged-8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:53:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d733d44f-000b-4ff4-bdc6-808b87972c59 req-ad1035ff-9139-432f-8f96-d63a77fde165 service nova] Acquiring lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:53:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d733d44f-000b-4ff4-bdc6-808b87972c59 req-ad1035ff-9139-432f-8f96-d63a77fde165 service nova] Lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:53:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d733d44f-000b-4ff4-bdc6-808b87972c59 req-ad1035ff-9139-432f-8f96-d63a77fde165 service nova] Lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:53:18 user nova-compute[72239]: DEBUG nova.compute.manager [req-d733d44f-000b-4ff4-bdc6-808b87972c59 req-ad1035ff-9139-432f-8f96-d63a77fde165 service nova] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] No waiting events found dispatching network-vif-plugged-8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:53:18 user nova-compute[72239]: WARNING nova.compute.manager [req-d733d44f-000b-4ff4-bdc6-808b87972c59 req-ad1035ff-9139-432f-8f96-d63a77fde165 service nova] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Received unexpected event network-vif-plugged-8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed for instance with vm_state active and task_state rebuild_spawning.
Jul 31 14:53:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-38700166-cba7-48e5-90fd-4c83772a4949 req-52e36807-fa2b-4bf8-93d3-e3160bfec556 service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Received event network-vif-plugged-4a60ced2-5c35-4f83-9734-e812bce6fad2 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:53:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-38700166-cba7-48e5-90fd-4c83772a4949 req-52e36807-fa2b-4bf8-93d3-e3160bfec556 service nova] Acquiring lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:53:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-38700166-cba7-48e5-90fd-4c83772a4949 req-52e36807-fa2b-4bf8-93d3-e3160bfec556 service nova] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:53:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-38700166-cba7-48e5-90fd-4c83772a4949 req-52e36807-fa2b-4bf8-93d3-e3160bfec556 service nova] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:53:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-38700166-cba7-48e5-90fd-4c83772a4949 req-52e36807-fa2b-4bf8-93d3-e3160bfec556 service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] No waiting events found dispatching network-vif-plugged-4a60ced2-5c35-4f83-9734-e812bce6fad2 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:53:19 user nova-compute[72239]: WARNING nova.compute.manager [req-38700166-cba7-48e5-90fd-4c83772a4949 req-52e36807-fa2b-4bf8-93d3-e3160bfec556 service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Received unexpected event network-vif-plugged-4a60ced2-5c35-4f83-9734-e812bce6fad2 for instance with vm_state stopped and task_state powering-on.
Jul 31 14:53:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:20 user nova-compute[72239]: DEBUG nova.compute.manager [req-8209ac43-8348-4d8a-a942-b72aa42607a1 req-d166b6b8-d185-459d-86eb-8a33ff4e1473 service nova] [instance: fb09290d-4200-465f-8090-f062572b2e05] Received event network-vif-plugged-2f5911fe-ab67-43db-b108-a8a97eca6bbc {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:53:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-8209ac43-8348-4d8a-a942-b72aa42607a1 req-d166b6b8-d185-459d-86eb-8a33ff4e1473 service nova] Acquiring lock "fb09290d-4200-465f-8090-f062572b2e05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:53:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-8209ac43-8348-4d8a-a942-b72aa42607a1 req-d166b6b8-d185-459d-86eb-8a33ff4e1473 service nova] Lock "fb09290d-4200-465f-8090-f062572b2e05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:53:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-8209ac43-8348-4d8a-a942-b72aa42607a1 req-d166b6b8-d185-459d-86eb-8a33ff4e1473 service nova] Lock "fb09290d-4200-465f-8090-f062572b2e05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:53:20 user nova-compute[72239]: DEBUG nova.compute.manager [req-8209ac43-8348-4d8a-a942-b72aa42607a1 req-d166b6b8-d185-459d-86eb-8a33ff4e1473 service nova] [instance: fb09290d-4200-465f-8090-f062572b2e05] No waiting events found dispatching network-vif-plugged-2f5911fe-ab67-43db-b108-a8a97eca6bbc {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:53:20 user nova-compute[72239]: WARNING nova.compute.manager [req-8209ac43-8348-4d8a-a942-b72aa42607a1 req-d166b6b8-d185-459d-86eb-8a33ff4e1473 service nova] [instance: fb09290d-4200-465f-8090-f062572b2e05] Received unexpected event network-vif-plugged-2f5911fe-ab67-43db-b108-a8a97eca6bbc for instance with vm_state building and task_state spawning.
Jul 31 14:53:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:20 user nova-compute[72239]: DEBUG nova.compute.manager [req-25e131de-4192-48b0-bee4-d21fada09ff5 req-58e1fa2b-c115-49f0-a346-1c778d8c2fd7 service nova] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Received event network-vif-plugged-8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:53:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-25e131de-4192-48b0-bee4-d21fada09ff5 req-58e1fa2b-c115-49f0-a346-1c778d8c2fd7 service nova] Acquiring lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:53:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-25e131de-4192-48b0-bee4-d21fada09ff5 req-58e1fa2b-c115-49f0-a346-1c778d8c2fd7 service nova] Lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:53:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-25e131de-4192-48b0-bee4-d21fada09ff5 req-58e1fa2b-c115-49f0-a346-1c778d8c2fd7 service nova] Lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:53:20 user nova-compute[72239]: DEBUG nova.compute.manager [req-25e131de-4192-48b0-bee4-d21fada09ff5 req-58e1fa2b-c115-49f0-a346-1c778d8c2fd7 service nova] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] No waiting events found dispatching network-vif-plugged-8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:53:20 user nova-compute[72239]: WARNING nova.compute.manager [req-25e131de-4192-48b0-bee4-d21fada09ff5 req-58e1fa2b-c115-49f0-a346-1c778d8c2fd7 service nova] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Received unexpected event network-vif-plugged-8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed for instance with vm_state active and task_state rebuild_spawning.
Jul 31 14:53:21 user nova-compute[72239]: DEBUG nova.compute.manager [req-68bc979e-413f-49d1-b0ca-ed2bc2078863 req-4f9ea658-ffa9-4b4b-976d-82312980e960 service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Received event network-vif-plugged-4a60ced2-5c35-4f83-9734-e812bce6fad2 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:53:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-68bc979e-413f-49d1-b0ca-ed2bc2078863 req-4f9ea658-ffa9-4b4b-976d-82312980e960 service nova] Acquiring lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:53:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-68bc979e-413f-49d1-b0ca-ed2bc2078863 req-4f9ea658-ffa9-4b4b-976d-82312980e960 service nova] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:53:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-68bc979e-413f-49d1-b0ca-ed2bc2078863 req-4f9ea658-ffa9-4b4b-976d-82312980e960 service nova] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:53:21 user nova-compute[72239]: DEBUG nova.compute.manager [req-68bc979e-413f-49d1-b0ca-ed2bc2078863 req-4f9ea658-ffa9-4b4b-976d-82312980e960 service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] No waiting events found dispatching network-vif-plugged-4a60ced2-5c35-4f83-9734-e812bce6fad2 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:53:21 user nova-compute[72239]: WARNING nova.compute.manager [req-68bc979e-413f-49d1-b0ca-ed2bc2078863 req-4f9ea658-ffa9-4b4b-976d-82312980e960 service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Received unexpected event network-vif-plugged-4a60ced2-5c35-4f83-9734-e812bce6fad2 for instance with vm_state stopped and task_state powering-on.
Jul 31 14:53:21 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815201.9875202, fb09290d-4200-465f-8090-f062572b2e05 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:53:21 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: fb09290d-4200-465f-8090-f062572b2e05] VM Resumed (Lifecycle Event)
Jul 31 14:53:21 user nova-compute[72239]: DEBUG nova.compute.manager [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: fb09290d-4200-465f-8090-f062572b2e05] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:53:21 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: fb09290d-4200-465f-8090-f062572b2e05] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 14:53:21 user nova-compute[72239]: DEBUG nova.compute.manager [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:53:21 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 14:53:22 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: fb09290d-4200-465f-8090-f062572b2e05] Instance spawned successfully.
Jul 31 14:53:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: fb09290d-4200-465f-8090-f062572b2e05] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 14:53:22 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Instance spawned successfully.
Jul 31 14:53:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 14:53:22 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: fb09290d-4200-465f-8090-f062572b2e05] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:53:22 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: fb09290d-4200-465f-8090-f062572b2e05] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:53:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: fb09290d-4200-465f-8090-f062572b2e05] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:53:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: fb09290d-4200-465f-8090-f062572b2e05] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:53:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: fb09290d-4200-465f-8090-f062572b2e05] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:53:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: fb09290d-4200-465f-8090-f062572b2e05] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:53:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: fb09290d-4200-465f-8090-f062572b2e05] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:53:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: fb09290d-4200-465f-8090-f062572b2e05] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:53:22 user nova-compute[72239]: DEBUG nova.compute.manager [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:53:22 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: fb09290d-4200-465f-8090-f062572b2e05] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:53:22 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815201.9882715, fb09290d-4200-465f-8090-f062572b2e05 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:53:22 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: fb09290d-4200-465f-8090-f062572b2e05] VM Started (Lifecycle Event)
Jul 31 14:53:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:53:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:53:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:53:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:53:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:53:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:53:22 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Instance rebooted successfully.
Jul 31 14:53:22 user nova-compute[72239]: DEBUG nova.compute.manager [None req-6dd8fdcb-8c1e-4da6-bae7-a072a5652007 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:53:22 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: fb09290d-4200-465f-8090-f062572b2e05] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:53:22 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: fb09290d-4200-465f-8090-f062572b2e05] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:53:22 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: fb09290d-4200-465f-8090-f062572b2e05] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:53:22 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815201.997932, c10918e9-9731-48ea-860e-8a02cb6a0ad9 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:53:22 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] VM Resumed (Lifecycle Event)
Jul 31 14:53:22 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:53:22 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:53:22 user nova-compute[72239]: DEBUG nova.compute.manager [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:53:22 user nova-compute[72239]: INFO nova.compute.manager [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: fb09290d-4200-465f-8090-f062572b2e05] Took 9.12 seconds to spawn the instance on the hypervisor.
Jul 31 14:53:22 user nova-compute[72239]: DEBUG nova.compute.manager [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: fb09290d-4200-465f-8090-f062572b2e05] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:53:22 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 31 14:53:22 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815201.9986818, c10918e9-9731-48ea-860e-8a02cb6a0ad9 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:53:22 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] VM Started (Lifecycle Event)
Jul 31 14:53:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:53:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:53:22 user nova-compute[72239]: DEBUG nova.objects.instance [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72239) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 31 14:53:22 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:53:22 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:53:22 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815202.0306613, db15ad45-8f28-4e0c-8d7e-7db75f33fe92 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:53:22 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] VM Resumed (Lifecycle Event)
Jul 31 14:53:22 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:53:22 user nova-compute[72239]: INFO nova.compute.manager [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: fb09290d-4200-465f-8090-f062572b2e05] Took 10.56 seconds to build instance.
Jul 31 14:53:22 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:53:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f50f9e14-0315-4e7e-8487-65acd84b5fc3 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.072s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:53:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f4456c89-420a-4b04-a264-aeb7c6b004f4 tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Lock "fb09290d-4200-465f-8090-f062572b2e05" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.716s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:53:22 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815202.0323248, db15ad45-8f28-4e0c-8d7e-7db75f33fe92 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:53:22 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] VM Started (Lifecycle Event)
Jul 31 14:53:22 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:53:22 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:53:24 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:30 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:36 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:37 user nova-compute[72239]: DEBUG nova.compute.manager [req-ea78bfdb-e217-48ab-ba4f-6e6e86a9bf7f req-0e5fc2c9-677f-4fe7-b08d-afab848eef51 service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Received event network-changed-b1b01e63-209d-4388-a81d-eb17afdf0db4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:53:37 user nova-compute[72239]: DEBUG nova.compute.manager [req-ea78bfdb-e217-48ab-ba4f-6e6e86a9bf7f req-0e5fc2c9-677f-4fe7-b08d-afab848eef51 service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Refreshing instance network info cache due to event network-changed-b1b01e63-209d-4388-a81d-eb17afdf0db4. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:53:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ea78bfdb-e217-48ab-ba4f-6e6e86a9bf7f req-0e5fc2c9-677f-4fe7-b08d-afab848eef51 service nova] Acquiring lock "refresh_cache-14653984-6c32-4ddd-bc0b-203a670c2b4e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:53:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ea78bfdb-e217-48ab-ba4f-6e6e86a9bf7f req-0e5fc2c9-677f-4fe7-b08d-afab848eef51 service nova] Acquired lock "refresh_cache-14653984-6c32-4ddd-bc0b-203a670c2b4e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:53:37 user nova-compute[72239]: DEBUG nova.network.neutron [req-ea78bfdb-e217-48ab-ba4f-6e6e86a9bf7f req-0e5fc2c9-677f-4fe7-b08d-afab848eef51 service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Refreshing network info cache for port b1b01e63-209d-4388-a81d-eb17afdf0db4 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:53:38 user nova-compute[72239]: DEBUG nova.network.neutron [req-ea78bfdb-e217-48ab-ba4f-6e6e86a9bf7f req-0e5fc2c9-677f-4fe7-b08d-afab848eef51 service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Updated VIF entry in instance network info cache for port b1b01e63-209d-4388-a81d-eb17afdf0db4. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:53:38 user nova-compute[72239]: DEBUG nova.network.neutron [req-ea78bfdb-e217-48ab-ba4f-6e6e86a9bf7f req-0e5fc2c9-677f-4fe7-b08d-afab848eef51 service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Updating instance_info_cache with network_info: [{"id": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "address": "fa:16:3e:5e:e5:b2", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b01e63-20", "ovs_interfaceid": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:53:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ea78bfdb-e217-48ab-ba4f-6e6e86a9bf7f req-0e5fc2c9-677f-4fe7-b08d-afab848eef51 service nova] Releasing lock "refresh_cache-14653984-6c32-4ddd-bc0b-203a670c2b4e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:53:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:41 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c4c4f176-999d-4e63-b2e2-37b1aedcef2b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "14653984-6c32-4ddd-bc0b-203a670c2b4e" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:53:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c4c4f176-999d-4e63-b2e2-37b1aedcef2b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "14653984-6c32-4ddd-bc0b-203a670c2b4e" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:53:42 user nova-compute[72239]: INFO nova.compute.manager [None req-c4c4f176-999d-4e63-b2e2-37b1aedcef2b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Shelving
Jul 31 14:53:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:42 user nova-compute[72239]: DEBUG nova.compute.manager [req-451b1461-13ab-4aa8-ac49-edbade67f9ee req-b1102520-73a0-461f-afff-c1b17ee18687 service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Received event network-vif-unplugged-b1b01e63-209d-4388-a81d-eb17afdf0db4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:53:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-451b1461-13ab-4aa8-ac49-edbade67f9ee req-b1102520-73a0-461f-afff-c1b17ee18687 service nova] Acquiring lock "14653984-6c32-4ddd-bc0b-203a670c2b4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:53:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-451b1461-13ab-4aa8-ac49-edbade67f9ee req-b1102520-73a0-461f-afff-c1b17ee18687 service nova] Lock "14653984-6c32-4ddd-bc0b-203a670c2b4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:53:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-451b1461-13ab-4aa8-ac49-edbade67f9ee req-b1102520-73a0-461f-afff-c1b17ee18687 service nova] Lock "14653984-6c32-4ddd-bc0b-203a670c2b4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:53:42 user nova-compute[72239]: DEBUG nova.compute.manager [req-451b1461-13ab-4aa8-ac49-edbade67f9ee req-b1102520-73a0-461f-afff-c1b17ee18687 service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] No waiting events found dispatching network-vif-unplugged-b1b01e63-209d-4388-a81d-eb17afdf0db4 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:53:42 user nova-compute[72239]: WARNING nova.compute.manager [req-451b1461-13ab-4aa8-ac49-edbade67f9ee req-b1102520-73a0-461f-afff-c1b17ee18687 service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Received unexpected event network-vif-unplugged-b1b01e63-209d-4388-a81d-eb17afdf0db4 for instance with vm_state active and task_state shelving.
Jul 31 14:53:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:42 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Instance destroyed successfully.
Jul 31 14:53:42 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-c4c4f176-999d-4e63-b2e2-37b1aedcef2b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Beginning cold snapshot process
Jul 31 14:53:43 user nova-compute[72239]: DEBUG nova.privsep.utils [None req-c4c4f176-999d-4e63-b2e2-37b1aedcef2b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72239) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 14:53:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-c4c4f176-999d-4e63-b2e2-37b1aedcef2b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/disk /opt/stack/data/nova/instances/snapshots/tmp3dwij9su/8b249adee1ee4d3f883168bbdcc88982 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:53:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-c4c4f176-999d-4e63-b2e2-37b1aedcef2b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/disk /opt/stack/data/nova/instances/snapshots/tmp3dwij9su/8b249adee1ee4d3f883168bbdcc88982" returned: 0 in 0.572s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:53:43 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-c4c4f176-999d-4e63-b2e2-37b1aedcef2b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Snapshot extracted, beginning image upload
Jul 31 14:53:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:44 user nova-compute[72239]: DEBUG nova.compute.manager [req-916e45a8-a5c2-4ff2-b7f3-9470e81aedc1 req-1c7d667a-2bf2-4ad7-a9ba-03b6303f576f service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Received event network-vif-plugged-b1b01e63-209d-4388-a81d-eb17afdf0db4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:53:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-916e45a8-a5c2-4ff2-b7f3-9470e81aedc1 req-1c7d667a-2bf2-4ad7-a9ba-03b6303f576f service nova] Acquiring lock "14653984-6c32-4ddd-bc0b-203a670c2b4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:53:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-916e45a8-a5c2-4ff2-b7f3-9470e81aedc1 req-1c7d667a-2bf2-4ad7-a9ba-03b6303f576f service nova] Lock "14653984-6c32-4ddd-bc0b-203a670c2b4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:53:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-916e45a8-a5c2-4ff2-b7f3-9470e81aedc1 req-1c7d667a-2bf2-4ad7-a9ba-03b6303f576f service nova] Lock "14653984-6c32-4ddd-bc0b-203a670c2b4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:53:44 user nova-compute[72239]: DEBUG nova.compute.manager [req-916e45a8-a5c2-4ff2-b7f3-9470e81aedc1 req-1c7d667a-2bf2-4ad7-a9ba-03b6303f576f service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] No waiting events found dispatching network-vif-plugged-b1b01e63-209d-4388-a81d-eb17afdf0db4 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:53:44 user nova-compute[72239]: WARNING nova.compute.manager [req-916e45a8-a5c2-4ff2-b7f3-9470e81aedc1 req-1c7d667a-2bf2-4ad7-a9ba-03b6303f576f service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Received unexpected event network-vif-plugged-b1b01e63-209d-4388-a81d-eb17afdf0db4 for instance with vm_state active and task_state shelving_image_uploading.
Jul 31 14:53:45 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-c4c4f176-999d-4e63-b2e2-37b1aedcef2b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Snapshot image upload complete
Jul 31 14:53:45 user nova-compute[72239]: DEBUG nova.compute.manager [None req-c4c4f176-999d-4e63-b2e2-37b1aedcef2b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:53:46 user nova-compute[72239]: INFO nova.compute.manager [None req-c4c4f176-999d-4e63-b2e2-37b1aedcef2b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Shelve offloading
Jul 31 14:53:46 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Instance destroyed successfully.
Jul 31 14:53:46 user nova-compute[72239]: DEBUG nova.compute.manager [None req-c4c4f176-999d-4e63-b2e2-37b1aedcef2b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:53:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c4c4f176-999d-4e63-b2e2-37b1aedcef2b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "refresh_cache-14653984-6c32-4ddd-bc0b-203a670c2b4e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:53:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c4c4f176-999d-4e63-b2e2-37b1aedcef2b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquired lock "refresh_cache-14653984-6c32-4ddd-bc0b-203a670c2b4e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:53:46 user nova-compute[72239]: DEBUG nova.network.neutron [None req-c4c4f176-999d-4e63-b2e2-37b1aedcef2b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:53:46 user nova-compute[72239]: DEBUG nova.network.neutron [None req-c4c4f176-999d-4e63-b2e2-37b1aedcef2b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Updating instance_info_cache with network_info: [{"id": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "address": "fa:16:3e:5e:e5:b2", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b01e63-20", "ovs_interfaceid": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:53:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c4c4f176-999d-4e63-b2e2-37b1aedcef2b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Releasing lock "refresh_cache-14653984-6c32-4ddd-bc0b-203a670c2b4e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:53:47 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Instance destroyed successfully.
Jul 31 14:53:47 user nova-compute[72239]: DEBUG nova.objects.instance [None req-c4c4f176-999d-4e63-b2e2-37b1aedcef2b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lazy-loading 'resources' on Instance uuid 14653984-6c32-4ddd-bc0b-203a670c2b4e {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:53:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-c4c4f176-999d-4e63-b2e2-37b1aedcef2b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:51:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-236697822',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-236697822',id=20,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRPopS6NZ8SJLGIqXpCTuBDBqc4poSQIzgLPnpX8KBSKuZ0J23omJc+3/YxYJoxechHepUs7tMFC/G2hd/C8KcWH0ZiYO+ptZU4vZL8aClAs6bSSlr6XibY/Q6VYdulsg==',key_name='tempest-keypair-1016500460',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:51:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5a6715a7ff38401d844b620cb8d8769e',ramdisk_id='',reservation_id='r-m9hzvwfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-599528407',owner_user_name='tempest-AttachVolumeShelveTestJSON-599528407-project-member',shelved_at='2023-07-31T14:53:45.991835',shelved_host='user',shelved_image_id='e9ca2aa9-f324-4640-9fe3-c8839494aed1'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:53:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70c6001a7ac5434fbc5ac7d003edd4eb',uuid=14653984-6c32-4ddd-bc0b-203a670c2b4e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "address": "fa:16:3e:5e:e5:b2", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b01e63-20", "ovs_interfaceid": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:53:47 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-c4c4f176-999d-4e63-b2e2-37b1aedcef2b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Converting VIF {"id": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "address": "fa:16:3e:5e:e5:b2", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b01e63-20", "ovs_interfaceid": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:53:47 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-c4c4f176-999d-4e63-b2e2-37b1aedcef2b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:e5:b2,bridge_name='br-int',has_traffic_filtering=True,id=b1b01e63-209d-4388-a81d-eb17afdf0db4,network=Network(37a946a3-d20a-4694-8647-73e84d2b0cb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1b01e63-20') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:53:47 user nova-compute[72239]: DEBUG os_vif [None req-c4c4f176-999d-4e63-b2e2-37b1aedcef2b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:e5:b2,bridge_name='br-int',has_traffic_filtering=True,id=b1b01e63-209d-4388-a81d-eb17afdf0db4,network=Network(37a946a3-d20a-4694-8647-73e84d2b0cb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1b01e63-20') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:53:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1b01e63-20, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:53:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:53:47 user nova-compute[72239]: INFO os_vif [None req-c4c4f176-999d-4e63-b2e2-37b1aedcef2b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:e5:b2,bridge_name='br-int',has_traffic_filtering=True,id=b1b01e63-209d-4388-a81d-eb17afdf0db4,network=Network(37a946a3-d20a-4694-8647-73e84d2b0cb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1b01e63-20')
Jul 31 14:53:47 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-c4c4f176-999d-4e63-b2e2-37b1aedcef2b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Deleting instance files /opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e_del
Jul 31 14:53:47 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-c4c4f176-999d-4e63-b2e2-37b1aedcef2b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Deletion of /opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e_del complete
Jul 31 14:53:47 user nova-compute[72239]: DEBUG nova.compute.manager [req-2cb5044c-2e98-425f-a632-4cf542b85c8a req-113cbb77-03ad-4831-b2f4-1f26d11e60f6 service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Received event network-changed-b1b01e63-209d-4388-a81d-eb17afdf0db4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:53:47 user nova-compute[72239]: DEBUG nova.compute.manager [req-2cb5044c-2e98-425f-a632-4cf542b85c8a req-113cbb77-03ad-4831-b2f4-1f26d11e60f6 service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Refreshing instance network info cache due to event network-changed-b1b01e63-209d-4388-a81d-eb17afdf0db4. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:53:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-2cb5044c-2e98-425f-a632-4cf542b85c8a req-113cbb77-03ad-4831-b2f4-1f26d11e60f6 service nova] Acquiring lock "refresh_cache-14653984-6c32-4ddd-bc0b-203a670c2b4e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:53:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-2cb5044c-2e98-425f-a632-4cf542b85c8a req-113cbb77-03ad-4831-b2f4-1f26d11e60f6 service nova] Acquired lock "refresh_cache-14653984-6c32-4ddd-bc0b-203a670c2b4e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:53:47 user nova-compute[72239]: DEBUG nova.network.neutron [req-2cb5044c-2e98-425f-a632-4cf542b85c8a req-113cbb77-03ad-4831-b2f4-1f26d11e60f6 service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Refreshing network info cache for port b1b01e63-209d-4388-a81d-eb17afdf0db4 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:53:47 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-c4c4f176-999d-4e63-b2e2-37b1aedcef2b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Deleted allocations for instance 14653984-6c32-4ddd-bc0b-203a670c2b4e
Jul 31 14:53:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c4c4f176-999d-4e63-b2e2-37b1aedcef2b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:53:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c4c4f176-999d-4e63-b2e2-37b1aedcef2b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:53:47 user nova-compute[72239]: DEBUG nova.objects.instance [None req-c4c4f176-999d-4e63-b2e2-37b1aedcef2b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lazy-loading 'numa_topology' on Instance uuid 14653984-6c32-4ddd-bc0b-203a670c2b4e {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:53:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:48 user nova-compute[72239]: DEBUG nova.network.neutron [req-2cb5044c-2e98-425f-a632-4cf542b85c8a req-113cbb77-03ad-4831-b2f4-1f26d11e60f6 service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Updated VIF entry in instance network info cache for port b1b01e63-209d-4388-a81d-eb17afdf0db4. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:53:48 user nova-compute[72239]: DEBUG nova.network.neutron [req-2cb5044c-2e98-425f-a632-4cf542b85c8a req-113cbb77-03ad-4831-b2f4-1f26d11e60f6 service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Updating instance_info_cache with network_info: [{"id": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "address": "fa:16:3e:5e:e5:b2", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb1b01e63-20", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:53:48 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-c4c4f176-999d-4e63-b2e2-37b1aedcef2b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:53:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-2cb5044c-2e98-425f-a632-4cf542b85c8a req-113cbb77-03ad-4831-b2f4-1f26d11e60f6 service nova] Releasing lock "refresh_cache-14653984-6c32-4ddd-bc0b-203a670c2b4e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:53:48 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-c4c4f176-999d-4e63-b2e2-37b1aedcef2b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:53:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c4c4f176-999d-4e63-b2e2-37b1aedcef2b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.350s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:53:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c4c4f176-999d-4e63-b2e2-37b1aedcef2b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "14653984-6c32-4ddd-bc0b-203a670c2b4e" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.183s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:53:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:56 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:53:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:53:57 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690815222.8438225, 14653984-6c32-4ddd-bc0b-203a670c2b4e => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:53:57 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] VM Stopped (Lifecycle Event)
Jul 31 14:53:57 user nova-compute[72239]: DEBUG nova.compute.manager [None req-2c34aa7c-e667-40d3-b275-660a7aa030a1 None None] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:53:58 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:54:01 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:54:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:03 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:54:03 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:04 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:54:04 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 14:54:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-079a5ed7-ee25-495b-a2a4-924d830a670a" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:54:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-079a5ed7-ee25-495b-a2a4-924d830a670a" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:54:04 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 14:54:05 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Updating instance_info_cache with network_info: [{"id": "e22b0941-5069-46e7-9722-621a758253f1", "address": "fa:16:3e:5e:88:13", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape22b0941-50", "ovs_interfaceid": "e22b0941-5069-46e7-9722-621a758253f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:54:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-079a5ed7-ee25-495b-a2a4-924d830a670a" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:54:05 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 14:54:05 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:54:05 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:54:05 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:54:05 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:54:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:54:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:54:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:54:05 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 14:54:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99961538-dde9-4f3b-9c87-ceb07a10e7dc/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99961538-dde9-4f3b-9c87-ceb07a10e7dc/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99961538-dde9-4f3b-9c87-ceb07a10e7dc/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:06 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99961538-dde9-4f3b-9c87-ceb07a10e7dc/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:54:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:54:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:54:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb09290d-4200-465f-8090-f062572b2e05/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb09290d-4200-465f-8090-f062572b2e05/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb09290d-4200-465f-8090-f062572b2e05/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fb09290d-4200-465f-8090-f062572b2e05/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87dd3b4b-c511-4784-acf9-ad21534c8337/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87dd3b4b-c511-4784-acf9-ad21534c8337/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87dd3b4b-c511-4784-acf9-ad21534c8337/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87dd3b4b-c511-4784-acf9-ad21534c8337/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Acquiring lock "7dcd718a-280f-4b0e-b54f-616ee983ad16" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:54:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "7dcd718a-280f-4b0e-b54f-616ee983ad16" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:54:09 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:54:09 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:54:09 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=7133MB free_disk=25.214584350585938GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 14:54:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:54:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:54:09 user nova-compute[72239]: DEBUG nova.compute.manager [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 14:54:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:54:09 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 20abf743-de5b-4122-aad0-e2124c7804b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:54:09 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 7d81b881-b44e-4fb3-8245-9dea634bdec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:54:09 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 079a5ed7-ee25-495b-a2a4-924d830a670a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:54:09 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 2f11022e-a007-4d4c-adc1-b54ea59b9e6a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:54:09 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance c10918e9-9731-48ea-860e-8a02cb6a0ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:54:09 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance db15ad45-8f28-4e0c-8d7e-7db75f33fe92 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:54:09 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance c2b3c85b-e939-41d0-8bf0-3a7f650177b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:54:09 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 3559f541-ed61-41b2-9a9d-8b10e18f7375 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:54:09 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 87dd3b4b-c511-4784-acf9-ad21534c8337 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:54:09 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 99961538-dde9-4f3b-9c87-ceb07a10e7dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:54:09 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance fb09290d-4200-465f-8090-f062572b2e05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:54:09 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 7dcd718a-280f-4b0e-b54f-616ee983ad16 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Jul 31 14:54:09 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 14:54:09 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 14:54:09 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:54:09 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:54:09 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 14:54:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.529s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:54:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.425s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:54:09 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 14:54:09 user nova-compute[72239]: INFO nova.compute.claims [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Claim successful on node user
Jul 31 14:54:10 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:54:10 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:54:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.509s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:54:10 user nova-compute[72239]: DEBUG nova.compute.manager [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 14:54:10 user nova-compute[72239]: DEBUG nova.compute.manager [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 14:54:10 user nova-compute[72239]: DEBUG nova.network.neutron [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 14:54:10 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 14:54:10 user nova-compute[72239]: DEBUG nova.compute.manager [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 14:54:10 user nova-compute[72239]: DEBUG nova.policy [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '946df3f784544702b6b057e66e23a97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fbc9073ba94f6e93d8491accb42231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 14:54:10 user nova-compute[72239]: DEBUG nova.compute.manager [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 14:54:10 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 14:54:10 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Creating image(s)
Jul 31 14:54:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Acquiring lock "/opt/stack/data/nova/instances/7dcd718a-280f-4b0e-b54f-616ee983ad16/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:54:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "/opt/stack/data/nova/instances/7dcd718a-280f-4b0e-b54f-616ee983ad16/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:54:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "/opt/stack/data/nova/instances/7dcd718a-280f-4b0e-b54f-616ee983ad16/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:54:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.144s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Acquiring lock "ca449065000c92aac3b7b9fa685f9a7710929444" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:54:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:54:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.136s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/7dcd718a-280f-4b0e-b54f-616ee983ad16/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/7dcd718a-280f-4b0e-b54f-616ee983ad16/disk 1073741824" returned: 0 in 0.051s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:54:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.137s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:11 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7dcd718a-280f-4b0e-b54f-616ee983ad16/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 14:54:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dcd718a-280f-4b0e-b54f-616ee983ad16/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:11 user nova-compute[72239]: DEBUG nova.network.neutron [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Successfully created port: 3f2a8e6b-1b4c-4382-a093-865fc8151290 {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:54:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dcd718a-280f-4b0e-b54f-616ee983ad16/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:11 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Cannot resize image /opt/stack/data/nova/instances/7dcd718a-280f-4b0e-b54f-616ee983ad16/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 14:54:11 user nova-compute[72239]: DEBUG nova.objects.instance [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lazy-loading 'migration_context' on Instance uuid 7dcd718a-280f-4b0e-b54f-616ee983ad16 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:54:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 14:54:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Ensure instance console log exists: /opt/stack/data/nova/instances/7dcd718a-280f-4b0e-b54f-616ee983ad16/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 14:54:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:54:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:54:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:54:11 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:54:11 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 14:54:11 user nova-compute[72239]: DEBUG nova.network.neutron [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Successfully updated port: 3f2a8e6b-1b4c-4382-a093-865fc8151290 {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:54:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Acquiring lock "refresh_cache-7dcd718a-280f-4b0e-b54f-616ee983ad16" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:54:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Acquired lock "refresh_cache-7dcd718a-280f-4b0e-b54f-616ee983ad16" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:54:11 user nova-compute[72239]: DEBUG nova.network.neutron [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:54:11 user nova-compute[72239]: DEBUG nova.compute.manager [req-08a932b6-7d44-4433-abf2-e28e368ae239 req-0bf4e9f4-dccd-4ace-a3c1-722274267524 service nova] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Received event network-changed-3f2a8e6b-1b4c-4382-a093-865fc8151290 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:54:11 user nova-compute[72239]: DEBUG nova.compute.manager [req-08a932b6-7d44-4433-abf2-e28e368ae239 req-0bf4e9f4-dccd-4ace-a3c1-722274267524 service nova] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Refreshing instance network info cache due to event network-changed-3f2a8e6b-1b4c-4382-a093-865fc8151290. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:54:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-08a932b6-7d44-4433-abf2-e28e368ae239 req-0bf4e9f4-dccd-4ace-a3c1-722274267524 service nova] Acquiring lock "refresh_cache-7dcd718a-280f-4b0e-b54f-616ee983ad16" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:54:11 user nova-compute[72239]: DEBUG nova.network.neutron [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG nova.network.neutron [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Updating instance_info_cache with network_info: [{"id": "3f2a8e6b-1b4c-4382-a093-865fc8151290", "address": "fa:16:3e:fe:06:0d", "network": {"id": "ef3b3133-c6fe-4492-84f9-211f520dd339", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-428761984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0fbc9073ba94f6e93d8491accb42231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2a8e6b-1b", "ovs_interfaceid": "3f2a8e6b-1b4c-4382-a093-865fc8151290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Releasing lock "refresh_cache-7dcd718a-280f-4b0e-b54f-616ee983ad16" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG nova.compute.manager [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Instance network_info: |[{"id": "3f2a8e6b-1b4c-4382-a093-865fc8151290", "address": "fa:16:3e:fe:06:0d", "network": {"id": "ef3b3133-c6fe-4492-84f9-211f520dd339", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-428761984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0fbc9073ba94f6e93d8491accb42231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2a8e6b-1b", "ovs_interfaceid": "3f2a8e6b-1b4c-4382-a093-865fc8151290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-08a932b6-7d44-4433-abf2-e28e368ae239 req-0bf4e9f4-dccd-4ace-a3c1-722274267524 service nova] Acquired lock "refresh_cache-7dcd718a-280f-4b0e-b54f-616ee983ad16" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG nova.network.neutron [req-08a932b6-7d44-4433-abf2-e28e368ae239 req-0bf4e9f4-dccd-4ace-a3c1-722274267524 service nova] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Refreshing network info cache for port 3f2a8e6b-1b4c-4382-a093-865fc8151290 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Start _get_guest_xml network_info=[{"id": "3f2a8e6b-1b4c-4382-a093-865fc8151290", "address": "fa:16:3e:fe:06:0d", "network": {"id": "ef3b3133-c6fe-4492-84f9-211f520dd339", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-428761984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0fbc9073ba94f6e93d8491accb42231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2a8e6b-1b", "ovs_interfaceid": "3f2a8e6b-1b4c-4382-a093-865fc8151290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:54:12 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:54:12 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:54:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:54:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1517360624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1517360624',id=26,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBx3W4P2zAjU3Ub3TTeYMxI4tICd31ZsG+xdyUIEMCiJ6C2HMa4Zs5t+xbAX9f7zr4xygbnTvJSoUbZi0I4t3O8Na4hZbw/ELUJzuAoZF7tqPoHZSoA6lH0SKAvEiAOuWw==',key_name='tempest-keypair-330604452',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0fbc9073ba94f6e93d8491accb42231',ramdisk_id='',reservation_id='r-pryejrft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-339927996',owner_user_name='tempest-ServerActionsV293TestJSON-339927996-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:54:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='946df3f784544702b6b057e66e23a97d',uuid=7dcd718a-280f-4b0e-b54f-616ee983ad16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f2a8e6b-1b4c-4382-a093-865fc8151290", "address": "fa:16:3e:fe:06:0d", "network": {"id": "ef3b3133-c6fe-4492-84f9-211f520dd339", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-428761984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0fbc9073ba94f6e93d8491accb42231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2a8e6b-1b", "ovs_interfaceid": "3f2a8e6b-1b4c-4382-a093-865fc8151290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Converting VIF {"id": "3f2a8e6b-1b4c-4382-a093-865fc8151290", "address": "fa:16:3e:fe:06:0d", "network": {"id": "ef3b3133-c6fe-4492-84f9-211f520dd339", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-428761984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0fbc9073ba94f6e93d8491accb42231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2a8e6b-1b", "ovs_interfaceid": "3f2a8e6b-1b4c-4382-a093-865fc8151290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:06:0d,bridge_name='br-int',has_traffic_filtering=True,id=3f2a8e6b-1b4c-4382-a093-865fc8151290,network=Network(ef3b3133-c6fe-4492-84f9-211f520dd339),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f2a8e6b-1b') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG nova.objects.instance [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lazy-loading 'pci_devices' on Instance uuid 7dcd718a-280f-4b0e-b54f-616ee983ad16 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:54:12 user nova-compute[72239]:   <uuid>7dcd718a-280f-4b0e-b54f-616ee983ad16</uuid>
Jul 31 14:54:12 user nova-compute[72239]:   <name>instance-0000001a</name>
Jul 31 14:54:12 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:54:12 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:54:12 user nova-compute[72239]:   <metadata>
Jul 31 14:54:12 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:54:12 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:54:12 user nova-compute[72239]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1517360624</nova:name>
Jul 31 14:54:12 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:54:12</nova:creationTime>
Jul 31 14:54:12 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:54:12 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:54:12 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:54:12 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:54:12 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:54:12 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:54:12 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:54:12 user nova-compute[72239]:       <nova:owner>
Jul 31 14:54:12 user nova-compute[72239]:         <nova:user uuid="946df3f784544702b6b057e66e23a97d">tempest-ServerActionsV293TestJSON-339927996-project-member</nova:user>
Jul 31 14:54:12 user nova-compute[72239]:         <nova:project uuid="b0fbc9073ba94f6e93d8491accb42231">tempest-ServerActionsV293TestJSON-339927996</nova:project>
Jul 31 14:54:12 user nova-compute[72239]:       </nova:owner>
Jul 31 14:54:12 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:54:12 user nova-compute[72239]:       <nova:ports>
Jul 31 14:54:12 user nova-compute[72239]:         <nova:port uuid="3f2a8e6b-1b4c-4382-a093-865fc8151290">
Jul 31 14:54:12 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 31 14:54:12 user nova-compute[72239]:         </nova:port>
Jul 31 14:54:12 user nova-compute[72239]:       </nova:ports>
Jul 31 14:54:12 user nova-compute[72239]:     </nova:instance>
Jul 31 14:54:12 user nova-compute[72239]:   </metadata>
Jul 31 14:54:12 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:54:12 user nova-compute[72239]:     <system>
Jul 31 14:54:12 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:54:12 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:54:12 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:54:12 user nova-compute[72239]:       <entry name="serial">7dcd718a-280f-4b0e-b54f-616ee983ad16</entry>
Jul 31 14:54:12 user nova-compute[72239]:       <entry name="uuid">7dcd718a-280f-4b0e-b54f-616ee983ad16</entry>
Jul 31 14:54:12 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:54:12 user nova-compute[72239]:     </system>
Jul 31 14:54:12 user nova-compute[72239]:   </sysinfo>
Jul 31 14:54:12 user nova-compute[72239]:   <os>
Jul 31 14:54:12 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:54:12 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:54:12 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:54:12 user nova-compute[72239]:   </os>
Jul 31 14:54:12 user nova-compute[72239]:   <features>
Jul 31 14:54:12 user nova-compute[72239]:     <acpi/>
Jul 31 14:54:12 user nova-compute[72239]:     <apic/>
Jul 31 14:54:12 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:54:12 user nova-compute[72239]:   </features>
Jul 31 14:54:12 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:54:12 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:54:12 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:54:12 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:54:12 user nova-compute[72239]:   </clock>
Jul 31 14:54:12 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:54:12 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:54:12 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:54:12 user nova-compute[72239]:   </cpu>
Jul 31 14:54:12 user nova-compute[72239]:   <devices>
Jul 31 14:54:12 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:54:12 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:54:12 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/7dcd718a-280f-4b0e-b54f-616ee983ad16/disk"/>
Jul 31 14:54:12 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:54:12 user nova-compute[72239]:     </disk>
Jul 31 14:54:12 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:54:12 user nova-compute[72239]:       <mac address="fa:16:3e:fe:06:0d"/>
Jul 31 14:54:12 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:54:12 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:54:12 user nova-compute[72239]:       <target dev="tap3f2a8e6b-1b"/>
Jul 31 14:54:12 user nova-compute[72239]:     </interface>
Jul 31 14:54:12 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:54:12 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/7dcd718a-280f-4b0e-b54f-616ee983ad16/console.log" append="off"/>
Jul 31 14:54:12 user nova-compute[72239]:     </serial>
Jul 31 14:54:12 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:54:12 user nova-compute[72239]:     <video>
Jul 31 14:54:12 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:54:12 user nova-compute[72239]:     </video>
Jul 31 14:54:12 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:54:12 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:54:12 user nova-compute[72239]:     </rng>
Jul 31 14:54:12 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:54:12 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:54:12 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:54:12 user nova-compute[72239]:     </memballoon>
Jul 31 14:54:12 user nova-compute[72239]:   </devices>
Jul 31 14:54:12 user nova-compute[72239]: </domain>
Jul 31 14:54:12 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:54:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1517360624',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1517360624',id=26,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBx3W4P2zAjU3Ub3TTeYMxI4tICd31ZsG+xdyUIEMCiJ6C2HMa4Zs5t+xbAX9f7zr4xygbnTvJSoUbZi0I4t3O8Na4hZbw/ELUJzuAoZF7tqPoHZSoA6lH0SKAvEiAOuWw==',key_name='tempest-keypair-330604452',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0fbc9073ba94f6e93d8491accb42231',ramdisk_id='',reservation_id='r-pryejrft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-339927996',owner_user_name='tempest-ServerActionsV293TestJSON-339927996-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:54:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='946df3f784544702b6b057e66e23a97d',uuid=7dcd718a-280f-4b0e-b54f-616ee983ad16,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3f2a8e6b-1b4c-4382-a093-865fc8151290", "address": "fa:16:3e:fe:06:0d", "network": {"id": "ef3b3133-c6fe-4492-84f9-211f520dd339", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-428761984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0fbc9073ba94f6e93d8491accb42231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2a8e6b-1b", "ovs_interfaceid": "3f2a8e6b-1b4c-4382-a093-865fc8151290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Converting VIF {"id": "3f2a8e6b-1b4c-4382-a093-865fc8151290", "address": "fa:16:3e:fe:06:0d", "network": {"id": "ef3b3133-c6fe-4492-84f9-211f520dd339", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-428761984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0fbc9073ba94f6e93d8491accb42231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2a8e6b-1b", "ovs_interfaceid": "3f2a8e6b-1b4c-4382-a093-865fc8151290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:06:0d,bridge_name='br-int',has_traffic_filtering=True,id=3f2a8e6b-1b4c-4382-a093-865fc8151290,network=Network(ef3b3133-c6fe-4492-84f9-211f520dd339),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f2a8e6b-1b') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG os_vif [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:06:0d,bridge_name='br-int',has_traffic_filtering=True,id=3f2a8e6b-1b4c-4382-a093-865fc8151290,network=Network(ef3b3133-c6fe-4492-84f9-211f520dd339),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f2a8e6b-1b') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3f2a8e6b-1b, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3f2a8e6b-1b, col_values=(('external_ids', {'iface-id': '3f2a8e6b-1b4c-4382-a093-865fc8151290', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:06:0d', 'vm-uuid': '7dcd718a-280f-4b0e-b54f-616ee983ad16'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:12 user nova-compute[72239]: INFO os_vif [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:06:0d,bridge_name='br-int',has_traffic_filtering=True,id=3f2a8e6b-1b4c-4382-a093-865fc8151290,network=Network(ef3b3133-c6fe-4492-84f9-211f520dd339),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f2a8e6b-1b')
Jul 31 14:54:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] No VIF found with MAC fa:16:3e:fe:06:0d, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG nova.network.neutron [req-08a932b6-7d44-4433-abf2-e28e368ae239 req-0bf4e9f4-dccd-4ace-a3c1-722274267524 service nova] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Updated VIF entry in instance network info cache for port 3f2a8e6b-1b4c-4382-a093-865fc8151290. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG nova.network.neutron [req-08a932b6-7d44-4433-abf2-e28e368ae239 req-0bf4e9f4-dccd-4ace-a3c1-722274267524 service nova] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Updating instance_info_cache with network_info: [{"id": "3f2a8e6b-1b4c-4382-a093-865fc8151290", "address": "fa:16:3e:fe:06:0d", "network": {"id": "ef3b3133-c6fe-4492-84f9-211f520dd339", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-428761984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0fbc9073ba94f6e93d8491accb42231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2a8e6b-1b", "ovs_interfaceid": "3f2a8e6b-1b4c-4382-a093-865fc8151290", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:54:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-08a932b6-7d44-4433-abf2-e28e368ae239 req-0bf4e9f4-dccd-4ace-a3c1-722274267524 service nova] Releasing lock "refresh_cache-7dcd718a-280f-4b0e-b54f-616ee983ad16" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:54:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:14 user nova-compute[72239]: DEBUG nova.compute.manager [req-da2accc1-de9b-4e03-ad7e-3cd76b9ff1e6 req-33120292-7aa8-43ce-9038-8c6a90ddc332 service nova] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Received event network-vif-plugged-3f2a8e6b-1b4c-4382-a093-865fc8151290 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:54:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-da2accc1-de9b-4e03-ad7e-3cd76b9ff1e6 req-33120292-7aa8-43ce-9038-8c6a90ddc332 service nova] Acquiring lock "7dcd718a-280f-4b0e-b54f-616ee983ad16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:54:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-da2accc1-de9b-4e03-ad7e-3cd76b9ff1e6 req-33120292-7aa8-43ce-9038-8c6a90ddc332 service nova] Lock "7dcd718a-280f-4b0e-b54f-616ee983ad16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:54:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-da2accc1-de9b-4e03-ad7e-3cd76b9ff1e6 req-33120292-7aa8-43ce-9038-8c6a90ddc332 service nova] Lock "7dcd718a-280f-4b0e-b54f-616ee983ad16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:54:14 user nova-compute[72239]: DEBUG nova.compute.manager [req-da2accc1-de9b-4e03-ad7e-3cd76b9ff1e6 req-33120292-7aa8-43ce-9038-8c6a90ddc332 service nova] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] No waiting events found dispatching network-vif-plugged-3f2a8e6b-1b4c-4382-a093-865fc8151290 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:54:14 user nova-compute[72239]: WARNING nova.compute.manager [req-da2accc1-de9b-4e03-ad7e-3cd76b9ff1e6 req-33120292-7aa8-43ce-9038-8c6a90ddc332 service nova] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Received unexpected event network-vif-plugged-3f2a8e6b-1b4c-4382-a093-865fc8151290 for instance with vm_state building and task_state spawning.
Jul 31 14:54:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:15 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815255.8285866, 7dcd718a-280f-4b0e-b54f-616ee983ad16 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:54:15 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] VM Resumed (Lifecycle Event)
Jul 31 14:54:15 user nova-compute[72239]: DEBUG nova.compute.manager [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:54:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 14:54:15 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Instance spawned successfully.
Jul 31 14:54:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 14:54:15 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:54:15 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:54:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:54:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:54:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:54:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:54:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:54:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:54:15 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:54:15 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815255.8321924, 7dcd718a-280f-4b0e-b54f-616ee983ad16 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:54:15 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] VM Started (Lifecycle Event)
Jul 31 14:54:15 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:54:15 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:54:15 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:54:15 user nova-compute[72239]: INFO nova.compute.manager [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Took 5.29 seconds to spawn the instance on the hypervisor.
Jul 31 14:54:15 user nova-compute[72239]: DEBUG nova.compute.manager [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:54:16 user nova-compute[72239]: INFO nova.compute.manager [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Took 6.58 seconds to build instance.
Jul 31 14:54:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bcbc0cd6-8a60-4a4c-a800-a40670131b25 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "7dcd718a-280f-4b0e-b54f-616ee983ad16" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.678s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:54:16 user nova-compute[72239]: DEBUG nova.compute.manager [req-ad1f2507-f4f9-4219-8cf5-46f8b19f1a2f req-c085e24e-698c-4381-9167-f16e9485eb2a service nova] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Received event network-vif-plugged-3f2a8e6b-1b4c-4382-a093-865fc8151290 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:54:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ad1f2507-f4f9-4219-8cf5-46f8b19f1a2f req-c085e24e-698c-4381-9167-f16e9485eb2a service nova] Acquiring lock "7dcd718a-280f-4b0e-b54f-616ee983ad16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:54:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ad1f2507-f4f9-4219-8cf5-46f8b19f1a2f req-c085e24e-698c-4381-9167-f16e9485eb2a service nova] Lock "7dcd718a-280f-4b0e-b54f-616ee983ad16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:54:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ad1f2507-f4f9-4219-8cf5-46f8b19f1a2f req-c085e24e-698c-4381-9167-f16e9485eb2a service nova] Lock "7dcd718a-280f-4b0e-b54f-616ee983ad16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:54:16 user nova-compute[72239]: DEBUG nova.compute.manager [req-ad1f2507-f4f9-4219-8cf5-46f8b19f1a2f req-c085e24e-698c-4381-9167-f16e9485eb2a service nova] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] No waiting events found dispatching network-vif-plugged-3f2a8e6b-1b4c-4382-a093-865fc8151290 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:54:16 user nova-compute[72239]: WARNING nova.compute.manager [req-ad1f2507-f4f9-4219-8cf5-46f8b19f1a2f req-c085e24e-698c-4381-9167-f16e9485eb2a service nova] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Received unexpected event network-vif-plugged-3f2a8e6b-1b4c-4382-a093-865fc8151290 for instance with vm_state active and task_state None.
Jul 31 14:54:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:21 user nova-compute[72239]: DEBUG nova.compute.manager [None req-d3b07039-b5c3-4d75-b732-0c7034e1605b tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:54:21 user nova-compute[72239]: INFO nova.compute.manager [None req-d3b07039-b5c3-4d75-b732-0c7034e1605b tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] instance snapshotting
Jul 31 14:54:21 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-d3b07039-b5c3-4d75-b732-0c7034e1605b tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Beginning live snapshot process
Jul 31 14:54:21 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-d3b07039-b5c3-4d75-b732-0c7034e1605b tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json -f qcow2 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:21 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-d3b07039-b5c3-4d75-b732-0c7034e1605b tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json -f qcow2" returned: 0 in 0.133s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:21 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-d3b07039-b5c3-4d75-b732-0c7034e1605b tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json -f qcow2 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-d3b07039-b5c3-4d75-b732-0c7034e1605b tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json -f qcow2" returned: 0 in 0.143s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-d3b07039-b5c3-4d75-b732-0c7034e1605b tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-d3b07039-b5c3-4d75-b732-0c7034e1605b tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.131s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-d3b07039-b5c3-4d75-b732-0c7034e1605b tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmpjv6cxt/f76e73dac4464a7f97360349b3326e68.delta 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-d3b07039-b5c3-4d75-b732-0c7034e1605b tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpmpjv6cxt/f76e73dac4464a7f97360349b3326e68.delta 1073741824" returned: 0 in 0.057s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:22 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-d3b07039-b5c3-4d75-b732-0c7034e1605b tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 31 14:54:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-d3b07039-b5c3-4d75-b732-0c7034e1605b tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=72239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 14:54:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-d3b07039-b5c3-4d75-b732-0c7034e1605b tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=72239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 14:54:23 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-d3b07039-b5c3-4d75-b732-0c7034e1605b tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 31 14:54:23 user nova-compute[72239]: DEBUG nova.privsep.utils [None req-d3b07039-b5c3-4d75-b732-0c7034e1605b tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72239) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 14:54:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-d3b07039-b5c3-4d75-b732-0c7034e1605b tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmpjv6cxt/f76e73dac4464a7f97360349b3326e68.delta /opt/stack/data/nova/instances/snapshots/tmpmpjv6cxt/f76e73dac4464a7f97360349b3326e68 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-d3b07039-b5c3-4d75-b732-0c7034e1605b tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpmpjv6cxt/f76e73dac4464a7f97360349b3326e68.delta /opt/stack/data/nova/instances/snapshots/tmpmpjv6cxt/f76e73dac4464a7f97360349b3326e68" returned: 0 in 0.562s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:24 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-d3b07039-b5c3-4d75-b732-0c7034e1605b tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Snapshot extracted, beginning image upload
Jul 31 14:54:26 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-d3b07039-b5c3-4d75-b732-0c7034e1605b tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Snapshot image upload complete
Jul 31 14:54:26 user nova-compute[72239]: INFO nova.compute.manager [None req-d3b07039-b5c3-4d75-b732-0c7034e1605b tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Took 4.79 seconds to snapshot the instance on the hypervisor.
Jul 31 14:54:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:54:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:32 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:33 user nova-compute[72239]: DEBUG nova.compute.manager [req-c15c7a42-34bd-4dbc-9593-0302a0b8c8cc req-b7906d3d-14fd-4cd3-8523-88c150567215 service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Received event network-changed-a7009a29-6a23-4d7d-a2ff-046c040e5b73 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:54:33 user nova-compute[72239]: DEBUG nova.compute.manager [req-c15c7a42-34bd-4dbc-9593-0302a0b8c8cc req-b7906d3d-14fd-4cd3-8523-88c150567215 service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Refreshing instance network info cache due to event network-changed-a7009a29-6a23-4d7d-a2ff-046c040e5b73. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:54:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-c15c7a42-34bd-4dbc-9593-0302a0b8c8cc req-b7906d3d-14fd-4cd3-8523-88c150567215 service nova] Acquiring lock "refresh_cache-3559f541-ed61-41b2-9a9d-8b10e18f7375" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:54:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-c15c7a42-34bd-4dbc-9593-0302a0b8c8cc req-b7906d3d-14fd-4cd3-8523-88c150567215 service nova] Acquired lock "refresh_cache-3559f541-ed61-41b2-9a9d-8b10e18f7375" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:54:33 user nova-compute[72239]: DEBUG nova.network.neutron [req-c15c7a42-34bd-4dbc-9593-0302a0b8c8cc req-b7906d3d-14fd-4cd3-8523-88c150567215 service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Refreshing network info cache for port a7009a29-6a23-4d7d-a2ff-046c040e5b73 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:54:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "3559f541-ed61-41b2-9a9d-8b10e18f7375" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:54:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "3559f541-ed61-41b2-9a9d-8b10e18f7375" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:54:33 user nova-compute[72239]: DEBUG nova.objects.instance [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lazy-loading 'flavor' on Instance uuid 3559f541-ed61-41b2-9a9d-8b10e18f7375 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:54:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "3559f541-ed61-41b2-9a9d-8b10e18f7375" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:54:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "3559f541-ed61-41b2-9a9d-8b10e18f7375" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:54:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "3559f541-ed61-41b2-9a9d-8b10e18f7375" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:54:33 user nova-compute[72239]: INFO nova.compute.manager [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Attaching volume a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 to /dev/vdb
Jul 31 14:54:33 user nova-compute[72239]: DEBUG nova.network.neutron [req-c15c7a42-34bd-4dbc-9593-0302a0b8c8cc req-b7906d3d-14fd-4cd3-8523-88c150567215 service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Updated VIF entry in instance network info cache for port a7009a29-6a23-4d7d-a2ff-046c040e5b73. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:54:33 user nova-compute[72239]: DEBUG nova.network.neutron [req-c15c7a42-34bd-4dbc-9593-0302a0b8c8cc req-b7906d3d-14fd-4cd3-8523-88c150567215 service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Updating instance_info_cache with network_info: [{"id": "a7009a29-6a23-4d7d-a2ff-046c040e5b73", "address": "fa:16:3e:f5:e4:b4", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7009a29-6a", "ovs_interfaceid": "a7009a29-6a23-4d7d-a2ff-046c040e5b73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:54:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-c15c7a42-34bd-4dbc-9593-0302a0b8c8cc req-b7906d3d-14fd-4cd3-8523-88c150567215 service nova] Releasing lock "refresh_cache-3559f541-ed61-41b2-9a9d-8b10e18f7375" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:54:34 user nova-compute[72239]: DEBUG os_brick.utils [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:54:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:34 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b161c96-07cc-4387-a97d-b245f0f02cd3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:54:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:34 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7776d3db-451c-4a79-a072-24fd10eced7a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:54:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:34 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c203cced-89f8-4dd8-a83a-aa20a11c3da0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:54:34 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c4d4d9-c156-4fe4-a4c3-83795052996c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:54:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:54:34 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 14:54:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:54:34 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 14:54:34 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4de9fdc-c982-49d3-8ad4-697bcc742c91]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:54:34 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 14:54:34 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 14:54:34 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 14:54:34 user nova-compute[72239]: DEBUG os_brick.utils [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:54:34 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Updating existing volume attachment record: 46b3984b-cb9a-4c02-8d60-bfb5bbbdb753 {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 14:54:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:39 user nova-compute[72239]: DEBUG nova.compute.manager [req-345104e5-1193-4b51-8dcb-e6a4c1489943 req-79eb64fe-8ece-481a-b21f-c7077bb08ccc service nova] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Received event network-changed-b3ad3fcc-4893-4a8d-b571-56531232aa38 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:54:39 user nova-compute[72239]: DEBUG nova.compute.manager [req-345104e5-1193-4b51-8dcb-e6a4c1489943 req-79eb64fe-8ece-481a-b21f-c7077bb08ccc service nova] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Refreshing instance network info cache due to event network-changed-b3ad3fcc-4893-4a8d-b571-56531232aa38. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:54:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-345104e5-1193-4b51-8dcb-e6a4c1489943 req-79eb64fe-8ece-481a-b21f-c7077bb08ccc service nova] Acquiring lock "refresh_cache-87dd3b4b-c511-4784-acf9-ad21534c8337" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:54:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-345104e5-1193-4b51-8dcb-e6a4c1489943 req-79eb64fe-8ece-481a-b21f-c7077bb08ccc service nova] Acquired lock "refresh_cache-87dd3b4b-c511-4784-acf9-ad21534c8337" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:54:39 user nova-compute[72239]: DEBUG nova.network.neutron [req-345104e5-1193-4b51-8dcb-e6a4c1489943 req-79eb64fe-8ece-481a-b21f-c7077bb08ccc service nova] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Refreshing network info cache for port b3ad3fcc-4893-4a8d-b571-56531232aa38 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:54:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:39 user nova-compute[72239]: DEBUG nova.network.neutron [req-345104e5-1193-4b51-8dcb-e6a4c1489943 req-79eb64fe-8ece-481a-b21f-c7077bb08ccc service nova] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Updated VIF entry in instance network info cache for port b3ad3fcc-4893-4a8d-b571-56531232aa38. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:54:39 user nova-compute[72239]: DEBUG nova.network.neutron [req-345104e5-1193-4b51-8dcb-e6a4c1489943 req-79eb64fe-8ece-481a-b21f-c7077bb08ccc service nova] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Updating instance_info_cache with network_info: [{"id": "b3ad3fcc-4893-4a8d-b571-56531232aa38", "address": "fa:16:3e:a6:c6:59", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ad3fcc-48", "ovs_interfaceid": "b3ad3fcc-4893-4a8d-b571-56531232aa38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:54:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-345104e5-1193-4b51-8dcb-e6a4c1489943 req-79eb64fe-8ece-481a-b21f-c7077bb08ccc service nova] Releasing lock "refresh_cache-87dd3b4b-c511-4784-acf9-ad21534c8337" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:54:41 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 14:54:41 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lsdIinAU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:54:41 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:54:41 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:54:41 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:54:41 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:54:41 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:54:41 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:54:41 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 14:54:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:41 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ebc6de-50ab-45aa-abbf-4501af3d321c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:54:41 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 14:54:41 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:54:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:41 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4955ac-efd7-417b-be61-a4ba369aa9b0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:54:41 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45] added
Jul 31 14:54:41 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:54:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:41 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e004303-0d31-499d-9907-b7e8a3cc3e70]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:54:41 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:54:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:41 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fd6348-38ac-4c2f-977e-bfce3fdf15fe]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:54:41 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:54:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lsdIinAU {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lsdIinAU" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:41 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae11223-5869-4775-bedd-69ebd6f841ee]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:54:41 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lsdIinAU'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:54:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:41 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f625dbd-a714-4c2f-9506-4591acccba67]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:54:41 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:54:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:41 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5a46ad-d57e-4f89-b0e2-734cb1cc1695]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:54:41 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:54:41 user nova-compute[72239]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:54:41 user nova-compute[72239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)
Jul 31 14:54:41 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:54:41 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:54:41 user nova-compute[72239]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:54:41 user nova-compute[72239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)
Jul 31 14:54:41 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:54:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ecd4a8-1b70-433b-870c-a1ac0bd934ba]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:54:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45, portal: 172.16.0.220,3260]
Jul 31 14:54:42 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45, portal: 172.16.0.220,3260] successful.
Jul 31 14:54:42 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:54:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1dfeb01-f877-4e27-9fb8-30c06b5b62e7]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:54:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:54:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fb3bf6-7b01-4257-bf4d-b2aad193c9f9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:54:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:54:42 user nova-compute[72239]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:54:42 user nova-compute[72239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)
Jul 31 14:54:42 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:54:42 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:54:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:54:42 user nova-compute[72239]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:54:42 user nova-compute[72239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)
Jul 31 14:54:42 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:54:42 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:54:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:54:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 14:54:42 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 14:54:42 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 14:54:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fb6933-8bc5-4a5e-8159-9ce4e01a7fa0]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:54:42 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: None {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:54:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "87dd3b4b-c511-4784-acf9-ad21534c8337" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:54:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "87dd3b4b-c511-4784-acf9-ad21534c8337" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:54:43 user nova-compute[72239]: DEBUG nova.objects.instance [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lazy-loading 'flavor' on Instance uuid 87dd3b4b-c511-4784-acf9-ad21534c8337 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:54:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "87dd3b4b-c511-4784-acf9-ad21534c8337" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:54:43 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:54:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lsdIinAU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 14:54:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:54:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '23861616336326237', 'path': '/dev/sdd'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:54:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861616336326237', 'path': '/dev/sdd'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 14:54:43 user nova-compute[72239]: DEBUG nova.objects.instance [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lazy-loading 'flavor' on Instance uuid 3559f541-ed61-41b2-9a9d-8b10e18f7375 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:54:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 14:54:43 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:54:43 user nova-compute[72239]:   <source dev="/dev/sdd"/>
Jul 31 14:54:43 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:54:43 user nova-compute[72239]:   <serial>a5f05c38-e6ce-44aa-afa6-92b1b1e72c45</serial>
Jul 31 14:54:43 user nova-compute[72239]: </disk>
Jul 31 14:54:43 user nova-compute[72239]:  {{(pid=72239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 14:54:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "87dd3b4b-c511-4784-acf9-ad21534c8337" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:54:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "87dd3b4b-c511-4784-acf9-ad21534c8337" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:54:43 user nova-compute[72239]: INFO nova.compute.manager [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Attaching volume e94914bb-15fa-4c61-9593-212f11b63b2b to /dev/vdb
Jul 31 14:54:43 user nova-compute[72239]: DEBUG os_brick.utils [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:54:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:43 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b485150-3dd4-4418-8877-91ab315ba718]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:54:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:43 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b33bb69-7ef1-499c-b8fd-4df17e8a8c4b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:54:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:43 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d09e07e-8193-4626-86f8-c7c2a74b7def]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:54:43 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f92c176-a25f-4b36-adfa-b95f6cdbd6bb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:54:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:54:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 14:54:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:54:43 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 14:54:43 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d69be6-c980-4b35-9e1c-0cb05cae3a6b]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:54:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 14:54:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 14:54:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 14:54:43 user nova-compute[72239]: DEBUG os_brick.utils [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:54:43 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Updating existing volume attachment record: 9cec9967-9e40-4c08-82a6-8d3ffecc98ef {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 14:54:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:54:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:54:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] No VIF found with MAC fa:16:3e:f5:e4:b4, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:54:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d872b33b-1aad-420e-a526-de9d4b5909bf tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "3559f541-ed61-41b2-9a9d-8b10e18f7375" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.901s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:54:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:45 user nova-compute[72239]: INFO nova.compute.manager [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Rescuing
Jul 31 14:54:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "refresh_cache-3559f541-ed61-41b2-9a9d-8b10e18f7375" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:54:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquired lock "refresh_cache-3559f541-ed61-41b2-9a9d-8b10e18f7375" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:54:45 user nova-compute[72239]: DEBUG nova.network.neutron [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:54:45 user nova-compute[72239]: DEBUG nova.network.neutron [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Updating instance_info_cache with network_info: [{"id": "a7009a29-6a23-4d7d-a2ff-046c040e5b73", "address": "fa:16:3e:f5:e4:b4", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7009a29-6a", "ovs_interfaceid": "a7009a29-6a23-4d7d-a2ff-046c040e5b73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:54:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Releasing lock "refresh_cache-3559f541-ed61-41b2-9a9d-8b10e18f7375" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:54:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:45 user nova-compute[72239]: DEBUG nova.compute.manager [req-4254c755-41d6-44ec-b58c-9afd2ad15683 req-2ec92284-c035-4e8e-a56b-5341eb764f0a service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Received event network-vif-unplugged-a7009a29-6a23-4d7d-a2ff-046c040e5b73 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:54:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-4254c755-41d6-44ec-b58c-9afd2ad15683 req-2ec92284-c035-4e8e-a56b-5341eb764f0a service nova] Acquiring lock "3559f541-ed61-41b2-9a9d-8b10e18f7375-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:54:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-4254c755-41d6-44ec-b58c-9afd2ad15683 req-2ec92284-c035-4e8e-a56b-5341eb764f0a service nova] Lock "3559f541-ed61-41b2-9a9d-8b10e18f7375-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:54:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-4254c755-41d6-44ec-b58c-9afd2ad15683 req-2ec92284-c035-4e8e-a56b-5341eb764f0a service nova] Lock "3559f541-ed61-41b2-9a9d-8b10e18f7375-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:54:45 user nova-compute[72239]: DEBUG nova.compute.manager [req-4254c755-41d6-44ec-b58c-9afd2ad15683 req-2ec92284-c035-4e8e-a56b-5341eb764f0a service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] No waiting events found dispatching network-vif-unplugged-a7009a29-6a23-4d7d-a2ff-046c040e5b73 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:54:45 user nova-compute[72239]: WARNING nova.compute.manager [req-4254c755-41d6-44ec-b58c-9afd2ad15683 req-2ec92284-c035-4e8e-a56b-5341eb764f0a service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Received unexpected event network-vif-unplugged-a7009a29-6a23-4d7d-a2ff-046c040e5b73 for instance with vm_state active and task_state rescuing.
Jul 31 14:54:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:46 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Instance destroyed successfully.
Jul 31 14:54:46 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Attempting rescue
Jul 31 14:54:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72239) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 31 14:54:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Instance directory exists: not creating {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 31 14:54:46 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Creating image(s)
Jul 31 14:54:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "/opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:54:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "/opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:54:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "/opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:54:46 user nova-compute[72239]: DEBUG nova.objects.instance [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3559f541-ed61-41b2-9a9d-8b10e18f7375 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:54:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "ca449065000c92aac3b7b9fa685f9a7710929444" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:54:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:54:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.202s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk.rescue {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk.rescue" returned: 0 in 0.053s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:54:46 user nova-compute[72239]: DEBUG nova.objects.instance [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lazy-loading 'migration_context' on Instance uuid 3559f541-ed61-41b2-9a9d-8b10e18f7375 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:54:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 14:54:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Start _get_guest_xml network_info=[{"id": "a7009a29-6a23-4d7d-a2ff-046c040e5b73", "address": "fa:16:3e:f5:e4:b4", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "vif_mac": "fa:16:3e:f5:e4:b4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7009a29-6a", "ovs_interfaceid": "a7009a29-6a23-4d7d-a2ff-046c040e5b73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:54:46 user nova-compute[72239]: DEBUG nova.objects.instance [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lazy-loading 'resources' on Instance uuid 3559f541-ed61-41b2-9a9d-8b10e18f7375 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:54:46 user nova-compute[72239]: DEBUG nova.objects.instance [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lazy-loading 'numa_topology' on Instance uuid 3559f541-ed61-41b2-9a9d-8b10e18f7375 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:54:46 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:54:46 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:54:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:54:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:54:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:54:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:54:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:54:46 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:54:46 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:54:46 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:54:46 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:54:46 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:54:46 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:54:46 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:54:46 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:54:46 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:54:46 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:54:46 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:54:46 user nova-compute[72239]: DEBUG nova.objects.instance [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3559f541-ed61-41b2-9a9d-8b10e18f7375 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:54:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:52:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1636003015',display_name='tempest-ServerRescueNegativeTestJSON-server-1636003015',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1636003015',id=22,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK59e+d5JqumngaIMi1TV1wAIjY4qlZDueF8eTW9V/NagCSHh+6Q46Dd9TNXG9DTJ1/F9v1GrrnmsbG+Dt2W4Pc1Zib0fWf7ng2HzCNCWTnfv8Bn1MhOYVcWKw+442VpYA==',key_name='tempest-keypair-2040187038',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:52:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='959107d575f04ba2b0ac800ed2ef61fa',ramdisk_id='',reservation_id='r-jcl47agl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1296361049',owner_user_name='tempest-ServerRescueNegativeTestJSON-1296361049-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:52:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f10fd7b9c1d34ca5b37150f34ea09ffa',uuid=3559f541-ed61-41b2-9a9d-8b10e18f7375,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7009a29-6a23-4d7d-a2ff-046c040e5b73", "address": "fa:16:3e:f5:e4:b4", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "vif_mac": "fa:16:3e:f5:e4:b4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7009a29-6a", "ovs_interfaceid": "a7009a29-6a23-4d7d-a2ff-046c040e5b73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:54:46 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Converting VIF {"id": "a7009a29-6a23-4d7d-a2ff-046c040e5b73", "address": "fa:16:3e:f5:e4:b4", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "vif_mac": "fa:16:3e:f5:e4:b4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7009a29-6a", "ovs_interfaceid": "a7009a29-6a23-4d7d-a2ff-046c040e5b73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:54:46 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:e4:b4,bridge_name='br-int',has_traffic_filtering=True,id=a7009a29-6a23-4d7d-a2ff-046c040e5b73,network=Network(02dfd673-dd23-4768-9c30-291cdbecbb64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7009a29-6a') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:54:46 user nova-compute[72239]: DEBUG nova.objects.instance [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lazy-loading 'pci_devices' on Instance uuid 3559f541-ed61-41b2-9a9d-8b10e18f7375 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:54:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:54:46 user nova-compute[72239]:   <uuid>3559f541-ed61-41b2-9a9d-8b10e18f7375</uuid>
Jul 31 14:54:46 user nova-compute[72239]:   <name>instance-00000016</name>
Jul 31 14:54:46 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:54:46 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:54:46 user nova-compute[72239]:   <metadata>
Jul 31 14:54:46 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:54:46 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:54:46 user nova-compute[72239]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1636003015</nova:name>
Jul 31 14:54:46 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:54:46</nova:creationTime>
Jul 31 14:54:46 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:54:46 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:54:46 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:54:46 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:54:46 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:54:46 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:54:46 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:54:46 user nova-compute[72239]:       <nova:owner>
Jul 31 14:54:46 user nova-compute[72239]:         <nova:user uuid="f10fd7b9c1d34ca5b37150f34ea09ffa">tempest-ServerRescueNegativeTestJSON-1296361049-project-member</nova:user>
Jul 31 14:54:46 user nova-compute[72239]:         <nova:project uuid="959107d575f04ba2b0ac800ed2ef61fa">tempest-ServerRescueNegativeTestJSON-1296361049</nova:project>
Jul 31 14:54:46 user nova-compute[72239]:       </nova:owner>
Jul 31 14:54:46 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:54:46 user nova-compute[72239]:       <nova:ports>
Jul 31 14:54:46 user nova-compute[72239]:         <nova:port uuid="a7009a29-6a23-4d7d-a2ff-046c040e5b73">
Jul 31 14:54:46 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 31 14:54:46 user nova-compute[72239]:         </nova:port>
Jul 31 14:54:46 user nova-compute[72239]:       </nova:ports>
Jul 31 14:54:46 user nova-compute[72239]:     </nova:instance>
Jul 31 14:54:46 user nova-compute[72239]:   </metadata>
Jul 31 14:54:46 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:54:46 user nova-compute[72239]:     <system>
Jul 31 14:54:46 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:54:46 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:54:46 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:54:46 user nova-compute[72239]:       <entry name="serial">3559f541-ed61-41b2-9a9d-8b10e18f7375</entry>
Jul 31 14:54:46 user nova-compute[72239]:       <entry name="uuid">3559f541-ed61-41b2-9a9d-8b10e18f7375</entry>
Jul 31 14:54:46 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:54:46 user nova-compute[72239]:     </system>
Jul 31 14:54:46 user nova-compute[72239]:   </sysinfo>
Jul 31 14:54:46 user nova-compute[72239]:   <os>
Jul 31 14:54:46 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:54:46 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:54:46 user nova-compute[72239]:   </os>
Jul 31 14:54:46 user nova-compute[72239]:   <features>
Jul 31 14:54:46 user nova-compute[72239]:     <acpi/>
Jul 31 14:54:46 user nova-compute[72239]:     <apic/>
Jul 31 14:54:46 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:54:46 user nova-compute[72239]:   </features>
Jul 31 14:54:46 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:54:46 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:54:46 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:54:46 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:54:46 user nova-compute[72239]:   </clock>
Jul 31 14:54:46 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:54:46 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:54:46 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:54:46 user nova-compute[72239]:   </cpu>
Jul 31 14:54:46 user nova-compute[72239]:   <devices>
Jul 31 14:54:46 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:54:46 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:54:46 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk.rescue"/>
Jul 31 14:54:46 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:54:46 user nova-compute[72239]:     </disk>
Jul 31 14:54:46 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:54:46 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:54:46 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk"/>
Jul 31 14:54:46 user nova-compute[72239]:       <target dev="vdb" bus="virtio"/>
Jul 31 14:54:46 user nova-compute[72239]:     </disk>
Jul 31 14:54:46 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:54:46 user nova-compute[72239]:       <mac address="fa:16:3e:f5:e4:b4"/>
Jul 31 14:54:46 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:54:46 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:54:46 user nova-compute[72239]:       <target dev="tapa7009a29-6a"/>
Jul 31 14:54:46 user nova-compute[72239]:     </interface>
Jul 31 14:54:46 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:54:46 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/console.log" append="off"/>
Jul 31 14:54:46 user nova-compute[72239]:     </serial>
Jul 31 14:54:46 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:54:46 user nova-compute[72239]:     <video>
Jul 31 14:54:46 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:54:46 user nova-compute[72239]:     </video>
Jul 31 14:54:46 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:54:46 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:54:46 user nova-compute[72239]:     </rng>
Jul 31 14:54:46 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:54:46 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:54:46 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:54:46 user nova-compute[72239]:     </memballoon>
Jul 31 14:54:46 user nova-compute[72239]:   </devices>
Jul 31 14:54:46 user nova-compute[72239]: </domain>
Jul 31 14:54:46 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:54:46 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Instance destroyed successfully.
Jul 31 14:54:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:54:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:54:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] No VIF found with MAC fa:16:3e:f5:e4:b4, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:54:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:47 user nova-compute[72239]: DEBUG nova.compute.manager [req-28637df1-7a4d-4c8f-a59e-ca4d99e55f0c req-8ca7d0b8-be8b-4dab-9ca3-f9050728e4a0 service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Received event network-vif-plugged-a7009a29-6a23-4d7d-a2ff-046c040e5b73 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:54:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-28637df1-7a4d-4c8f-a59e-ca4d99e55f0c req-8ca7d0b8-be8b-4dab-9ca3-f9050728e4a0 service nova] Acquiring lock "3559f541-ed61-41b2-9a9d-8b10e18f7375-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:54:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-28637df1-7a4d-4c8f-a59e-ca4d99e55f0c req-8ca7d0b8-be8b-4dab-9ca3-f9050728e4a0 service nova] Lock "3559f541-ed61-41b2-9a9d-8b10e18f7375-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:54:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-28637df1-7a4d-4c8f-a59e-ca4d99e55f0c req-8ca7d0b8-be8b-4dab-9ca3-f9050728e4a0 service nova] Lock "3559f541-ed61-41b2-9a9d-8b10e18f7375-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:54:47 user nova-compute[72239]: DEBUG nova.compute.manager [req-28637df1-7a4d-4c8f-a59e-ca4d99e55f0c req-8ca7d0b8-be8b-4dab-9ca3-f9050728e4a0 service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] No waiting events found dispatching network-vif-plugged-a7009a29-6a23-4d7d-a2ff-046c040e5b73 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:54:47 user nova-compute[72239]: WARNING nova.compute.manager [req-28637df1-7a4d-4c8f-a59e-ca4d99e55f0c req-8ca7d0b8-be8b-4dab-9ca3-f9050728e4a0 service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Received unexpected event network-vif-plugged-a7009a29-6a23-4d7d-a2ff-046c040e5b73 for instance with vm_state active and task_state rescuing.
Jul 31 14:54:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:50 user nova-compute[72239]: DEBUG nova.compute.manager [req-21f5db51-52e4-4b1e-a3f1-3f1c0e92ff0b req-ff836ae2-1660-430f-9113-d9bac8345beb service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Received event network-vif-plugged-a7009a29-6a23-4d7d-a2ff-046c040e5b73 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:54:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-21f5db51-52e4-4b1e-a3f1-3f1c0e92ff0b req-ff836ae2-1660-430f-9113-d9bac8345beb service nova] Acquiring lock "3559f541-ed61-41b2-9a9d-8b10e18f7375-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:54:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-21f5db51-52e4-4b1e-a3f1-3f1c0e92ff0b req-ff836ae2-1660-430f-9113-d9bac8345beb service nova] Lock "3559f541-ed61-41b2-9a9d-8b10e18f7375-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:54:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-21f5db51-52e4-4b1e-a3f1-3f1c0e92ff0b req-ff836ae2-1660-430f-9113-d9bac8345beb service nova] Lock "3559f541-ed61-41b2-9a9d-8b10e18f7375-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:54:50 user nova-compute[72239]: DEBUG nova.compute.manager [req-21f5db51-52e4-4b1e-a3f1-3f1c0e92ff0b req-ff836ae2-1660-430f-9113-d9bac8345beb service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] No waiting events found dispatching network-vif-plugged-a7009a29-6a23-4d7d-a2ff-046c040e5b73 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:54:50 user nova-compute[72239]: WARNING nova.compute.manager [req-21f5db51-52e4-4b1e-a3f1-3f1c0e92ff0b req-ff836ae2-1660-430f-9113-d9bac8345beb service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Received unexpected event network-vif-plugged-a7009a29-6a23-4d7d-a2ff-046c040e5b73 for instance with vm_state active and task_state rescuing.
Jul 31 14:54:50 user nova-compute[72239]: DEBUG nova.compute.manager [req-21f5db51-52e4-4b1e-a3f1-3f1c0e92ff0b req-ff836ae2-1660-430f-9113-d9bac8345beb service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Received event network-vif-plugged-a7009a29-6a23-4d7d-a2ff-046c040e5b73 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:54:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-21f5db51-52e4-4b1e-a3f1-3f1c0e92ff0b req-ff836ae2-1660-430f-9113-d9bac8345beb service nova] Acquiring lock "3559f541-ed61-41b2-9a9d-8b10e18f7375-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:54:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-21f5db51-52e4-4b1e-a3f1-3f1c0e92ff0b req-ff836ae2-1660-430f-9113-d9bac8345beb service nova] Lock "3559f541-ed61-41b2-9a9d-8b10e18f7375-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:54:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-21f5db51-52e4-4b1e-a3f1-3f1c0e92ff0b req-ff836ae2-1660-430f-9113-d9bac8345beb service nova] Lock "3559f541-ed61-41b2-9a9d-8b10e18f7375-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:54:50 user nova-compute[72239]: DEBUG nova.compute.manager [req-21f5db51-52e4-4b1e-a3f1-3f1c0e92ff0b req-ff836ae2-1660-430f-9113-d9bac8345beb service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] No waiting events found dispatching network-vif-plugged-a7009a29-6a23-4d7d-a2ff-046c040e5b73 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:54:50 user nova-compute[72239]: WARNING nova.compute.manager [req-21f5db51-52e4-4b1e-a3f1-3f1c0e92ff0b req-ff836ae2-1660-430f-9113-d9bac8345beb service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Received unexpected event network-vif-plugged-a7009a29-6a23-4d7d-a2ff-046c040e5b73 for instance with vm_state active and task_state rescuing.
Jul 31 14:54:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Removed pending event for 3559f541-ed61-41b2-9a9d-8b10e18f7375 due to event {{(pid=72239) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 14:54:50 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815290.5216029, 3559f541-ed61-41b2-9a9d-8b10e18f7375 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:54:50 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] VM Resumed (Lifecycle Event)
Jul 31 14:54:50 user nova-compute[72239]: DEBUG nova.compute.manager [None req-39963f31-bdfc-4f29-a6d9-101e9ad5a29a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:54:50 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:54:50 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:54:50 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 31 14:54:50 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815290.52359, 3559f541-ed61-41b2-9a9d-8b10e18f7375 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:54:50 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] VM Started (Lifecycle Event)
Jul 31 14:54:50 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:54:50 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wLCVSXYM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:54:51 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:54:51 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:54:51 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:54:51 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:54:51 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 14:54:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af6fa14-621d-4882-8eb7-978eb820a628]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 14:54:51 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae9f13b-2903-41bb-81d1-5d517c27b388]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b] added
Jul 31 14:54:51 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7344a1b6-b49f-4120-ba68-e455aacb8f1e]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab631f49-a5dc-4ab4-85a9-0b5de74cc21e]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wLCVSXYM {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wLCVSXYM" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc5462b-816b-4107-a3d5-3d112dd1ba59]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wLCVSXYM'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f28960bc-5b6a-4b9d-b1e7-400cbbceee8a]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[75a8d8cb-c6bc-41a6-a221-9caeeadd9c8d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:54:51 user nova-compute[72239]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:54:51 user nova-compute[72239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)
Jul 31 14:54:51 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:54:51 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:54:51 user nova-compute[72239]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:54:51 user nova-compute[72239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)
Jul 31 14:54:51 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:54:51 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[48343142-e177-4ca1-9eef-6ed3026d75f6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b, portal: 172.16.0.220,3260]
Jul 31 14:54:51 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b, portal: 172.16.0.220,3260] successful.
Jul 31 14:54:51 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9455d895-b26d-4b6b-95f6-1f5a867b3f7d]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a06272-8424-4b07-a8b6-5344d686bbae]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:54:51 user nova-compute[72239]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:54:51 user nova-compute[72239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)
Jul 31 14:54:51 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:54:51 user nova-compute[72239]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)
Jul 31 14:54:51 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:54:51 user nova-compute[72239]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:54:51 user nova-compute[72239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)
Jul 31 14:54:51 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:54:51 user nova-compute[72239]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)
Jul 31 14:54:51 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddc68ad-ef74-472a-a8e9-587156e133ce]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:54:51 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: None {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:54:52 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:54:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wLCVSXYM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 14:54:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:54:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '23731336263343666', 'path': '/dev/sde'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:54:52 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23731336263343666', 'path': '/dev/sde'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 14:54:52 user nova-compute[72239]: DEBUG nova.objects.instance [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lazy-loading 'flavor' on Instance uuid 87dd3b4b-c511-4784-acf9-ad21534c8337 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:54:52 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 14:54:52 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:54:52 user nova-compute[72239]:   <source dev="/dev/sde"/>
Jul 31 14:54:52 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:54:52 user nova-compute[72239]:   <serial>e94914bb-15fa-4c61-9593-212f11b63b2b</serial>
Jul 31 14:54:52 user nova-compute[72239]: </disk>
Jul 31 14:54:52 user nova-compute[72239]:  {{(pid=72239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 14:54:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:52 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:54:52 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:54:52 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] No VIF found with MAC fa:16:3e:a6:c6:59, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:54:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9129eecc-68b8-49e7-a069-181757b77a5d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "87dd3b4b-c511-4784-acf9-ad21534c8337" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.751s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:54:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:54 user nova-compute[72239]: DEBUG nova.compute.manager [req-ebac06f2-4384-4832-8b6c-1161e117b4e9 req-941f1135-8854-4f86-b9ff-9133a1ff3fc2 service nova] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Received event network-changed-d4f1a9e6-e739-4938-acd2-8769845f2a63 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:54:54 user nova-compute[72239]: DEBUG nova.compute.manager [req-ebac06f2-4384-4832-8b6c-1161e117b4e9 req-941f1135-8854-4f86-b9ff-9133a1ff3fc2 service nova] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Refreshing instance network info cache due to event network-changed-d4f1a9e6-e739-4938-acd2-8769845f2a63. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:54:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ebac06f2-4384-4832-8b6c-1161e117b4e9 req-941f1135-8854-4f86-b9ff-9133a1ff3fc2 service nova] Acquiring lock "refresh_cache-99961538-dde9-4f3b-9c87-ceb07a10e7dc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:54:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ebac06f2-4384-4832-8b6c-1161e117b4e9 req-941f1135-8854-4f86-b9ff-9133a1ff3fc2 service nova] Acquired lock "refresh_cache-99961538-dde9-4f3b-9c87-ceb07a10e7dc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:54:54 user nova-compute[72239]: DEBUG nova.network.neutron [req-ebac06f2-4384-4832-8b6c-1161e117b4e9 req-941f1135-8854-4f86-b9ff-9133a1ff3fc2 service nova] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Refreshing network info cache for port d4f1a9e6-e739-4938-acd2-8769845f2a63 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:54:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Acquiring lock "99961538-dde9-4f3b-9c87-ceb07a10e7dc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:54:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "99961538-dde9-4f3b-9c87-ceb07a10e7dc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:54:55 user nova-compute[72239]: DEBUG nova.objects.instance [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lazy-loading 'flavor' on Instance uuid 99961538-dde9-4f3b-9c87-ceb07a10e7dc {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:54:55 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Ignoring supplied device name: /dev/vdb
Jul 31 14:54:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "99961538-dde9-4f3b-9c87-ceb07a10e7dc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:54:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Acquiring lock "99961538-dde9-4f3b-9c87-ceb07a10e7dc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:54:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "99961538-dde9-4f3b-9c87-ceb07a10e7dc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:54:55 user nova-compute[72239]: INFO nova.compute.manager [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Attaching volume b8a712ef-2340-495b-b2e6-78bc39fc8031 to /dev/vdb
Jul 31 14:54:55 user nova-compute[72239]: DEBUG os_brick.utils [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:54:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:55 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2de53a-bac6-47e2-92d4-9e5d51c7e565]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:54:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:55 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[590cdc8f-d365-452a-821a-158b4ca84a09]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:54:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:55 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6031dbc0-6d1d-45fe-8f00-88967d60dafc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:54:55 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[581620e3-16c2-4590-89ef-d6fb6d7edf48]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:54:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:54:55 user nova-compute[72239]: DEBUG nova.network.neutron [req-ebac06f2-4384-4832-8b6c-1161e117b4e9 req-941f1135-8854-4f86-b9ff-9133a1ff3fc2 service nova] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Updated VIF entry in instance network info cache for port d4f1a9e6-e739-4938-acd2-8769845f2a63. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:54:55 user nova-compute[72239]: DEBUG nova.network.neutron [req-ebac06f2-4384-4832-8b6c-1161e117b4e9 req-941f1135-8854-4f86-b9ff-9133a1ff3fc2 service nova] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Updating instance_info_cache with network_info: [{"id": "d4f1a9e6-e739-4938-acd2-8769845f2a63", "address": "fa:16:3e:31:ea:2f", "network": {"id": "807530ad-b1c8-4426-9036-a796ba7dee91", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-277511856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d888450f903d41c5b6fde5de0b513a84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f1a9e6-e7", "ovs_interfaceid": "d4f1a9e6-e739-4938-acd2-8769845f2a63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:54:55 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 14:54:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ebac06f2-4384-4832-8b6c-1161e117b4e9 req-941f1135-8854-4f86-b9ff-9133a1ff3fc2 service nova] Releasing lock "refresh_cache-99961538-dde9-4f3b-9c87-ceb07a10e7dc" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:54:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:54:55 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 14:54:55 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d6ba287-1d48-49c4-96ce-46ceb8dcbaf6]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:54:55 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 14:54:55 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 14:54:55 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 14:54:55 user nova-compute[72239]: DEBUG os_brick.utils [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:54:55 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Updating existing volume attachment record: 6333f9c1-1f3c-4d68-98a6-90dd68c8af76 {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 14:54:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "91c2d1cf-ffdb-47a3-b754-57a328947e10" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:54:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "91c2d1cf-ffdb-47a3-b754-57a328947e10" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:54:58 user nova-compute[72239]: DEBUG nova.compute.manager [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 14:54:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:54:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:54:58 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 14:54:58 user nova-compute[72239]: INFO nova.compute.claims [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Claim successful on node user
Jul 31 14:54:58 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:54:58 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:54:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.534s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:54:58 user nova-compute[72239]: DEBUG nova.compute.manager [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 14:54:59 user nova-compute[72239]: DEBUG nova.compute.manager [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 14:54:59 user nova-compute[72239]: DEBUG nova.network.neutron [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 14:54:59 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 14:54:59 user nova-compute[72239]: DEBUG nova.compute.manager [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 14:54:59 user nova-compute[72239]: DEBUG nova.compute.manager [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 14:54:59 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 14:54:59 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Creating image(s)
Jul 31 14:54:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "/opt/stack/data/nova/instances/91c2d1cf-ffdb-47a3-b754-57a328947e10/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:54:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "/opt/stack/data/nova/instances/91c2d1cf-ffdb-47a3-b754-57a328947e10/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:54:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "/opt/stack/data/nova/instances/91c2d1cf-ffdb-47a3-b754-57a328947e10/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:54:59 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:59 user nova-compute[72239]: DEBUG nova.policy [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99f609389e884d5490ba160d9fff28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e4fe9e81724b9cb6b9d73748f9bdee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 14:54:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:54:59 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.320s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "ca449065000c92aac3b7b9fa685f9a7710929444" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:54:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:54:59 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:59 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.150s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:59 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/91c2d1cf-ffdb-47a3-b754-57a328947e10/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:59 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/91c2d1cf-ffdb-47a3-b754-57a328947e10/disk 1073741824" returned: 0 in 0.053s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:54:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:54:59 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:54:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b4768b39-dcf7-4002-9075-da9b18d9605a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:54:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b4768b39-dcf7-4002-9075-da9b18d9605a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:55:00 user nova-compute[72239]: INFO nova.compute.manager [None req-b4768b39-dcf7-4002-9075-da9b18d9605a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Detaching volume 96e3e2e1-1942-4ccc-ad2c-33aa63817e79
Jul 31 14:55:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.439s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Checking if we can resize image /opt/stack/data/nova/instances/91c2d1cf-ffdb-47a3-b754-57a328947e10/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c2d1cf-ffdb-47a3-b754-57a328947e10/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG nova.network.neutron [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Successfully created port: 3b15bbc2-ce0e-4595-b7c6-543727b06b00 {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:55:00 user nova-compute[72239]: INFO nova.virt.block_device [None req-b4768b39-dcf7-4002-9075-da9b18d9605a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Attempting to driver detach volume 96e3e2e1-1942-4ccc-ad2c-33aa63817e79 from mountpoint /dev/vdb
Jul 31 14:55:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b4768b39-dcf7-4002-9075-da9b18d9605a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Attempting to detach device vdb from instance db15ad45-8f28-4e0c-8d7e-7db75f33fe92 from the persistent domain config. {{(pid=72239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-b4768b39-dcf7-4002-9075-da9b18d9605a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 14:55:00 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:55:00 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 14:55:00 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:55:00 user nova-compute[72239]:   <serial>96e3e2e1-1942-4ccc-ad2c-33aa63817e79</serial>
Jul 31 14:55:00 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 31 14:55:00 user nova-compute[72239]: </disk>
Jul 31 14:55:00 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 14:55:00 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-b4768b39-dcf7-4002-9075-da9b18d9605a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Successfully detached device vdb from instance db15ad45-8f28-4e0c-8d7e-7db75f33fe92 from the persistent domain config.
Jul 31 14:55:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b4768b39-dcf7-4002-9075-da9b18d9605a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance db15ad45-8f28-4e0c-8d7e-7db75f33fe92 from the live domain config. {{(pid=72239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-b4768b39-dcf7-4002-9075-da9b18d9605a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 14:55:00 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:55:00 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 14:55:00 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:55:00 user nova-compute[72239]:   <serial>96e3e2e1-1942-4ccc-ad2c-33aa63817e79</serial>
Jul 31 14:55:00 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 31 14:55:00 user nova-compute[72239]: </disk>
Jul 31 14:55:00 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c2d1cf-ffdb-47a3-b754-57a328947e10/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Cannot resize image /opt/stack/data/nova/instances/91c2d1cf-ffdb-47a3-b754-57a328947e10/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG nova.objects.instance [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lazy-loading 'migration_context' on Instance uuid 91c2d1cf-ffdb-47a3-b754-57a328947e10 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Ensure instance console log exists: /opt/stack/data/nova/instances/91c2d1cf-ffdb-47a3-b754-57a328947e10/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Received event <DeviceRemovedEvent: 1690815300.788343, db15ad45-8f28-4e0c-8d7e-7db75f33fe92 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72239) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b4768b39-dcf7-4002-9075-da9b18d9605a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance db15ad45-8f28-4e0c-8d7e-7db75f33fe92 {{(pid=72239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 14:55:00 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-b4768b39-dcf7-4002-9075-da9b18d9605a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Successfully detached device vdb from instance db15ad45-8f28-4e0c-8d7e-7db75f33fe92 from the live domain config.
Jul 31 14:55:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4768b39-dcf7-4002-9075-da9b18d9605a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4768b39-dcf7-4002-9075-da9b18d9605a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UYFEHIBJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:55:00 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-b4768b39-dcf7-4002-9075-da9b18d9605a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:55:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-b4768b39-dcf7-4002-9075-da9b18d9605a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-b4768b39-dcf7-4002-9075-da9b18d9605a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4768b39-dcf7-4002-9075-da9b18d9605a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c6e4ba-861c-48a2-9765-776bca747342]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[055311ff-60bd-465a-8fb8-0577fa6fd253]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4768b39-dcf7-4002-9075-da9b18d9605a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:55:00 user nova-compute[72239]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:55:00 user nova-compute[72239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)
Jul 31 14:55:00 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:55:00 user nova-compute[72239]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)
Jul 31 14:55:00 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4768b39-dcf7-4002-9075-da9b18d9605a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:55:00 user nova-compute[72239]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 (non-flash)
Jul 31 14:55:00 user nova-compute[72239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)
Jul 31 14:55:00 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:55:00 user nova-compute[72239]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)
Jul 31 14:55:00 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4768b39-dcf7-4002-9075-da9b18d9605a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41182d70a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79'): ({'sdb'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-b4768b39-dcf7-4002-9075-da9b18d9605a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Removing single pathed devices sdb {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe3658ce-7ef6-4f06-8f0b-da3b8cc1bcfc]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1770ff19-2b6b-405a-bbd6-2e7433b8c7df]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-b4768b39-dcf7-4002-9075-da9b18d9605a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Flushing IO for device /dev/sdb {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc186310-6e9c-4984-a299-a02863f2a8c0]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-b4768b39-dcf7-4002-9075-da9b18d9605a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2104fc90-b33d-4d00-8dc4-9b1f2f1bceb8]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-b4768b39-dcf7-4002-9075-da9b18d9605a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-b4768b39-dcf7-4002-9075-da9b18d9605a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4768b39-dcf7-4002-9075-da9b18d9605a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 14:55:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02ee2b7-a4f1-4be2-b2be-ae2169e0aeff]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4768b39-dcf7-4002-9075-da9b18d9605a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4836071-30c3-4a26-9f56-91a8e284f4dd]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4768b39-dcf7-4002-9075-da9b18d9605a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79, portal: 172.16.0.220,3260]
Jul 31 14:55:01 user nova-compute[72239]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79, portal: 172.16.0.220,3260] successful.
Jul 31 14:55:01 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG nova.network.neutron [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Successfully updated port: 3b15bbc2-ce0e-4595-b7c6-543727b06b00 {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:96e3e2e1-1942-4ccc-ad2c-33aa63817e79 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde22e1d-7580-4b47-bf55-772aeeea6a90]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4768b39-dcf7-4002-9075-da9b18d9605a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-b4768b39-dcf7-4002-9075-da9b18d9605a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b4768b39-dcf7-4002-9075-da9b18d9605a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] <== disconnect_volume: return (330ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b4768b39-dcf7-4002-9075-da9b18d9605a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "refresh_cache-91c2d1cf-ffdb-47a3-b754-57a328947e10" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquired lock "refresh_cache-91c2d1cf-ffdb-47a3-b754-57a328947e10" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG nova.network.neutron [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG nova.compute.manager [req-38712fae-69b0-45e1-859f-c76f2664ba1f req-48e48f87-4e09-4819-aae7-a9ab5451417f service nova] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Received event network-changed-3b15bbc2-ce0e-4595-b7c6-543727b06b00 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG nova.compute.manager [req-38712fae-69b0-45e1-859f-c76f2664ba1f req-48e48f87-4e09-4819-aae7-a9ab5451417f service nova] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Refreshing instance network info cache due to event network-changed-3b15bbc2-ce0e-4595-b7c6-543727b06b00. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-38712fae-69b0-45e1-859f-c76f2664ba1f req-48e48f87-4e09-4819-aae7-a9ab5451417f service nova] Acquiring lock "refresh_cache-91c2d1cf-ffdb-47a3-b754-57a328947e10" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG nova.network.neutron [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG nova.network.neutron [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Updating instance_info_cache with network_info: [{"id": "3b15bbc2-ce0e-4595-b7c6-543727b06b00", "address": "fa:16:3e:00:f4:01", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b15bbc2-ce", "ovs_interfaceid": "3b15bbc2-ce0e-4595-b7c6-543727b06b00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Releasing lock "refresh_cache-91c2d1cf-ffdb-47a3-b754-57a328947e10" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG nova.compute.manager [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Instance network_info: |[{"id": "3b15bbc2-ce0e-4595-b7c6-543727b06b00", "address": "fa:16:3e:00:f4:01", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b15bbc2-ce", "ovs_interfaceid": "3b15bbc2-ce0e-4595-b7c6-543727b06b00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-38712fae-69b0-45e1-859f-c76f2664ba1f req-48e48f87-4e09-4819-aae7-a9ab5451417f service nova] Acquired lock "refresh_cache-91c2d1cf-ffdb-47a3-b754-57a328947e10" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG nova.network.neutron [req-38712fae-69b0-45e1-859f-c76f2664ba1f req-48e48f87-4e09-4819-aae7-a9ab5451417f service nova] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Refreshing network info cache for port 3b15bbc2-ce0e-4595-b7c6-543727b06b00 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Start _get_guest_xml network_info=[{"id": "3b15bbc2-ce0e-4595-b7c6-543727b06b00", "address": "fa:16:3e:00:f4:01", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b15bbc2-ce", "ovs_interfaceid": "3b15bbc2-ce0e-4595-b7c6-543727b06b00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:55:01 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:55:01 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:55:01 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:54:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-48566919',display_name='tempest-AttachVolumeNegativeTest-server-48566919',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-48566919',id=27,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZPvYKsFOXQ+KDy6rhzCiyMIIZb07f11JgBADL//XRqqIqzIx8cOB+TfPwTzYPtpYvqcy7NpwivCE/oj3OgN+KNiWRrr61H0Xw4f72CG1Js19z+ckNRdRZsHSjL9PNEvA==',key_name='tempest-keypair-315615031',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48e4fe9e81724b9cb6b9d73748f9bdee',ramdisk_id='',reservation_id='r-16i04039',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-620954585',owner_user_name='tempest-AttachVolumeNegativeTest-620954585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:54:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99f609389e884d5490ba160d9fff28e3',uuid=91c2d1cf-ffdb-47a3-b754-57a328947e10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b15bbc2-ce0e-4595-b7c6-543727b06b00", "address": "fa:16:3e:00:f4:01", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b15bbc2-ce", "ovs_interfaceid": "3b15bbc2-ce0e-4595-b7c6-543727b06b00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Converting VIF {"id": "3b15bbc2-ce0e-4595-b7c6-543727b06b00", "address": "fa:16:3e:00:f4:01", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b15bbc2-ce", "ovs_interfaceid": "3b15bbc2-ce0e-4595-b7c6-543727b06b00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:f4:01,bridge_name='br-int',has_traffic_filtering=True,id=3b15bbc2-ce0e-4595-b7c6-543727b06b00,network=Network(f83cfb34-b1ca-4a7c-9a36-3654372585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b15bbc2-ce') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG nova.objects.instance [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lazy-loading 'pci_devices' on Instance uuid 91c2d1cf-ffdb-47a3-b754-57a328947e10 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:55:01 user nova-compute[72239]:   <uuid>91c2d1cf-ffdb-47a3-b754-57a328947e10</uuid>
Jul 31 14:55:01 user nova-compute[72239]:   <name>instance-0000001b</name>
Jul 31 14:55:01 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:55:01 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:55:01 user nova-compute[72239]:   <metadata>
Jul 31 14:55:01 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:55:01 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:55:01 user nova-compute[72239]:       <nova:name>tempest-AttachVolumeNegativeTest-server-48566919</nova:name>
Jul 31 14:55:01 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:55:01</nova:creationTime>
Jul 31 14:55:01 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:55:01 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:55:01 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:55:01 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:55:01 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:55:01 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:55:01 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:55:01 user nova-compute[72239]:       <nova:owner>
Jul 31 14:55:01 user nova-compute[72239]:         <nova:user uuid="99f609389e884d5490ba160d9fff28e3">tempest-AttachVolumeNegativeTest-620954585-project-member</nova:user>
Jul 31 14:55:01 user nova-compute[72239]:         <nova:project uuid="48e4fe9e81724b9cb6b9d73748f9bdee">tempest-AttachVolumeNegativeTest-620954585</nova:project>
Jul 31 14:55:01 user nova-compute[72239]:       </nova:owner>
Jul 31 14:55:01 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:55:01 user nova-compute[72239]:       <nova:ports>
Jul 31 14:55:01 user nova-compute[72239]:         <nova:port uuid="3b15bbc2-ce0e-4595-b7c6-543727b06b00">
Jul 31 14:55:01 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 31 14:55:01 user nova-compute[72239]:         </nova:port>
Jul 31 14:55:01 user nova-compute[72239]:       </nova:ports>
Jul 31 14:55:01 user nova-compute[72239]:     </nova:instance>
Jul 31 14:55:01 user nova-compute[72239]:   </metadata>
Jul 31 14:55:01 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:55:01 user nova-compute[72239]:     <system>
Jul 31 14:55:01 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:55:01 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:55:01 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:55:01 user nova-compute[72239]:       <entry name="serial">91c2d1cf-ffdb-47a3-b754-57a328947e10</entry>
Jul 31 14:55:01 user nova-compute[72239]:       <entry name="uuid">91c2d1cf-ffdb-47a3-b754-57a328947e10</entry>
Jul 31 14:55:01 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:55:01 user nova-compute[72239]:     </system>
Jul 31 14:55:01 user nova-compute[72239]:   </sysinfo>
Jul 31 14:55:01 user nova-compute[72239]:   <os>
Jul 31 14:55:01 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:55:01 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:55:01 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:55:01 user nova-compute[72239]:   </os>
Jul 31 14:55:01 user nova-compute[72239]:   <features>
Jul 31 14:55:01 user nova-compute[72239]:     <acpi/>
Jul 31 14:55:01 user nova-compute[72239]:     <apic/>
Jul 31 14:55:01 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:55:01 user nova-compute[72239]:   </features>
Jul 31 14:55:01 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:55:01 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:55:01 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:55:01 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:55:01 user nova-compute[72239]:   </clock>
Jul 31 14:55:01 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:55:01 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:55:01 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:55:01 user nova-compute[72239]:   </cpu>
Jul 31 14:55:01 user nova-compute[72239]:   <devices>
Jul 31 14:55:01 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:55:01 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:55:01 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/91c2d1cf-ffdb-47a3-b754-57a328947e10/disk"/>
Jul 31 14:55:01 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:55:01 user nova-compute[72239]:     </disk>
Jul 31 14:55:01 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:55:01 user nova-compute[72239]:       <mac address="fa:16:3e:00:f4:01"/>
Jul 31 14:55:01 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:55:01 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:55:01 user nova-compute[72239]:       <target dev="tap3b15bbc2-ce"/>
Jul 31 14:55:01 user nova-compute[72239]:     </interface>
Jul 31 14:55:01 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:55:01 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/91c2d1cf-ffdb-47a3-b754-57a328947e10/console.log" append="off"/>
Jul 31 14:55:01 user nova-compute[72239]:     </serial>
Jul 31 14:55:01 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:55:01 user nova-compute[72239]:     <video>
Jul 31 14:55:01 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:55:01 user nova-compute[72239]:     </video>
Jul 31 14:55:01 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:55:01 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:55:01 user nova-compute[72239]:     </rng>
Jul 31 14:55:01 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:55:01 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:55:01 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:55:01 user nova-compute[72239]:     </memballoon>
Jul 31 14:55:01 user nova-compute[72239]:   </devices>
Jul 31 14:55:01 user nova-compute[72239]: </domain>
Jul 31 14:55:01 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:54:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-48566919',display_name='tempest-AttachVolumeNegativeTest-server-48566919',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-48566919',id=27,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZPvYKsFOXQ+KDy6rhzCiyMIIZb07f11JgBADL//XRqqIqzIx8cOB+TfPwTzYPtpYvqcy7NpwivCE/oj3OgN+KNiWRrr61H0Xw4f72CG1Js19z+ckNRdRZsHSjL9PNEvA==',key_name='tempest-keypair-315615031',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48e4fe9e81724b9cb6b9d73748f9bdee',ramdisk_id='',reservation_id='r-16i04039',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-620954585',owner_user_name='tempest-AttachVolumeNegativeTest-620954585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:54:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99f609389e884d5490ba160d9fff28e3',uuid=91c2d1cf-ffdb-47a3-b754-57a328947e10,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b15bbc2-ce0e-4595-b7c6-543727b06b00", "address": "fa:16:3e:00:f4:01", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b15bbc2-ce", "ovs_interfaceid": "3b15bbc2-ce0e-4595-b7c6-543727b06b00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Converting VIF {"id": "3b15bbc2-ce0e-4595-b7c6-543727b06b00", "address": "fa:16:3e:00:f4:01", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b15bbc2-ce", "ovs_interfaceid": "3b15bbc2-ce0e-4595-b7c6-543727b06b00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:f4:01,bridge_name='br-int',has_traffic_filtering=True,id=3b15bbc2-ce0e-4595-b7c6-543727b06b00,network=Network(f83cfb34-b1ca-4a7c-9a36-3654372585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b15bbc2-ce') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG os_vif [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:f4:01,bridge_name='br-int',has_traffic_filtering=True,id=3b15bbc2-ce0e-4595-b7c6-543727b06b00,network=Network(f83cfb34-b1ca-4a7c-9a36-3654372585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b15bbc2-ce') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b15bbc2-ce, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3b15bbc2-ce, col_values=(('external_ids', {'iface-id': '3b15bbc2-ce0e-4595-b7c6-543727b06b00', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:00:f4:01', 'vm-uuid': '91c2d1cf-ffdb-47a3-b754-57a328947e10'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:01 user nova-compute[72239]: INFO os_vif [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:f4:01,bridge_name='br-int',has_traffic_filtering=True,id=3b15bbc2-ce0e-4595-b7c6-543727b06b00,network=Network(f83cfb34-b1ca-4a7c-9a36-3654372585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b15bbc2-ce')
Jul 31 14:55:01 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:55:01 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] No VIF found with MAC fa:16:3e:00:f4:01, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:55:02 user nova-compute[72239]: DEBUG nova.network.neutron [req-38712fae-69b0-45e1-859f-c76f2664ba1f req-48e48f87-4e09-4819-aae7-a9ab5451417f service nova] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Updated VIF entry in instance network info cache for port 3b15bbc2-ce0e-4595-b7c6-543727b06b00. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:55:02 user nova-compute[72239]: DEBUG nova.network.neutron [req-38712fae-69b0-45e1-859f-c76f2664ba1f req-48e48f87-4e09-4819-aae7-a9ab5451417f service nova] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Updating instance_info_cache with network_info: [{"id": "3b15bbc2-ce0e-4595-b7c6-543727b06b00", "address": "fa:16:3e:00:f4:01", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b15bbc2-ce", "ovs_interfaceid": "3b15bbc2-ce0e-4595-b7c6-543727b06b00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:55:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-38712fae-69b0-45e1-859f-c76f2664ba1f req-48e48f87-4e09-4819-aae7-a9ab5451417f service nova] Releasing lock "refresh_cache-91c2d1cf-ffdb-47a3-b754-57a328947e10" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:55:02 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:55:03 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:03 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:03 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:03 user nova-compute[72239]: DEBUG nova.compute.manager [req-a0ad941d-660f-44d0-a6a8-222f416676c5 req-419177b0-608e-4eff-a64d-ba8a405d1aef service nova] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Received event network-vif-plugged-3b15bbc2-ce0e-4595-b7c6-543727b06b00 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:55:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a0ad941d-660f-44d0-a6a8-222f416676c5 req-419177b0-608e-4eff-a64d-ba8a405d1aef service nova] Acquiring lock "91c2d1cf-ffdb-47a3-b754-57a328947e10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:55:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a0ad941d-660f-44d0-a6a8-222f416676c5 req-419177b0-608e-4eff-a64d-ba8a405d1aef service nova] Lock "91c2d1cf-ffdb-47a3-b754-57a328947e10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:55:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a0ad941d-660f-44d0-a6a8-222f416676c5 req-419177b0-608e-4eff-a64d-ba8a405d1aef service nova] Lock "91c2d1cf-ffdb-47a3-b754-57a328947e10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:55:03 user nova-compute[72239]: DEBUG nova.compute.manager [req-a0ad941d-660f-44d0-a6a8-222f416676c5 req-419177b0-608e-4eff-a64d-ba8a405d1aef service nova] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] No waiting events found dispatching network-vif-plugged-3b15bbc2-ce0e-4595-b7c6-543727b06b00 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:55:03 user nova-compute[72239]: WARNING nova.compute.manager [req-a0ad941d-660f-44d0-a6a8-222f416676c5 req-419177b0-608e-4eff-a64d-ba8a405d1aef service nova] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Received unexpected event network-vif-plugged-3b15bbc2-ce0e-4595-b7c6-543727b06b00 for instance with vm_state building and task_state spawning.
Jul 31 14:55:03 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:03 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG nova.objects.instance [None req-b4768b39-dcf7-4002-9075-da9b18d9605a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lazy-loading 'flavor' on Instance uuid db15ad45-8f28-4e0c-8d7e-7db75f33fe92 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b4768b39-dcf7-4002-9075-da9b18d9605a tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.543s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IpcbhBYu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:55:04 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:55:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:55:04 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:55:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:55:04 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 14:55:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031 -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[367b2359-cf6a-4799-8409-d9ed802c3d8e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 14:55:04 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031 -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-07fd5384-4d5e-4b86-9af6-febd0cdc5d8e tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-07fd5384-4d5e-4b86-9af6-febd0cdc5d8e tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG nova.compute.manager [None req-07fd5384-4d5e-4b86-9af6-febd0cdc5d8e tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG nova.compute.manager [None req-07fd5384-4d5e-4b86-9af6-febd0cdc5d8e tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=72239) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG nova.objects.instance [None req-07fd5384-4d5e-4b86-9af6-febd0cdc5d8e tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lazy-loading 'flavor' on Instance uuid db15ad45-8f28-4e0c-8d7e-7db75f33fe92 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[da87d89e-eb29-4682-be93-11335b3a38ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031] added
Jul 31 14:55:04 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4840adb3-a8dd-4393-b7a6-2d76216807e7]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42b840e-ba3f-4ad5-8325-4f32ccc32e09]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IpcbhBYu {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IpcbhBYu" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[da98c6da-0dcd-4a39-8caf-f5eb1eb45d8c]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IpcbhBYu'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-78ff8b77-c608-46eb-9971-58325f8e2b3b tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Acquiring lock "fb09290d-4200-465f-8090-f062572b2e05" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-78ff8b77-c608-46eb-9971-58325f8e2b3b tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Lock "fb09290d-4200-465f-8090-f062572b2e05" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-78ff8b77-c608-46eb-9971-58325f8e2b3b tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Acquiring lock "fb09290d-4200-465f-8090-f062572b2e05-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-78ff8b77-c608-46eb-9971-58325f8e2b3b tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Lock "fb09290d-4200-465f-8090-f062572b2e05-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-78ff8b77-c608-46eb-9971-58325f8e2b3b tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Lock "fb09290d-4200-465f-8090-f062572b2e05-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:55:04 user nova-compute[72239]: INFO nova.compute.manager [None req-78ff8b77-c608-46eb-9971-58325f8e2b3b tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: fb09290d-4200-465f-8090-f062572b2e05] Terminating instance
Jul 31 14:55:04 user nova-compute[72239]: DEBUG nova.compute.manager [None req-78ff8b77-c608-46eb-9971-58325f8e2b3b tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: fb09290d-4200-465f-8090-f062572b2e05] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f376373f-2f2f-4b6b-bebe-b9df9dfc9f5d]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d1edf7-fbe8-41bb-8492-edfd7fdde455]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:55:04 user nova-compute[72239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)
Jul 31 14:55:04 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:55:04 user nova-compute[72239]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)
Jul 31 14:55:04 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:55:04 user nova-compute[72239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)
Jul 31 14:55:04 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:55:04 user nova-compute[72239]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)
Jul 31 14:55:04 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031 -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f47be8-0322-48d5-a466-c7054a6e9e52]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031, portal: 172.16.0.220,3260]
Jul 31 14:55:04 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031, portal: 172.16.0.220,3260] successful.
Jul 31 14:55:04 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8a1563b-a3bf-4bc3-8804-64d3f4e39be8]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9966485-47c3-44b9-9a8f-ce864cb44253]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:55:04 user nova-compute[72239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)
Jul 31 14:55:04 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:55:04 user nova-compute[72239]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)
Jul 31 14:55:04 user nova-compute[72239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031 (non-flash)
Jul 31 14:55:04 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:55:04 user nova-compute[72239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)
Jul 31 14:55:04 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:55:04 user nova-compute[72239]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)
Jul 31 14:55:04 user nova-compute[72239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031 (non-flash)
Jul 31 14:55:04 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 14:55:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a6efe4-5521-40a6-8a64-f7fc87b5f2a6]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IpcbhBYu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG nova.compute.manager [req-72d1599f-18ed-421f-9566-199162fd9fb8 req-58d9a330-c3e1-43e9-92bf-5fa9d881fa3d service nova] [instance: fb09290d-4200-465f-8090-f062572b2e05] Received event network-vif-unplugged-2f5911fe-ab67-43db-b108-a8a97eca6bbc {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-72d1599f-18ed-421f-9566-199162fd9fb8 req-58d9a330-c3e1-43e9-92bf-5fa9d881fa3d service nova] Acquiring lock "fb09290d-4200-465f-8090-f062572b2e05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-72d1599f-18ed-421f-9566-199162fd9fb8 req-58d9a330-c3e1-43e9-92bf-5fa9d881fa3d service nova] Lock "fb09290d-4200-465f-8090-f062572b2e05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-72d1599f-18ed-421f-9566-199162fd9fb8 req-58d9a330-c3e1-43e9-92bf-5fa9d881fa3d service nova] Lock "fb09290d-4200-465f-8090-f062572b2e05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG nova.compute.manager [req-72d1599f-18ed-421f-9566-199162fd9fb8 req-58d9a330-c3e1-43e9-92bf-5fa9d881fa3d service nova] [instance: fb09290d-4200-465f-8090-f062572b2e05] No waiting events found dispatching network-vif-unplugged-2f5911fe-ab67-43db-b108-a8a97eca6bbc {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG nova.compute.manager [req-72d1599f-18ed-421f-9566-199162fd9fb8 req-58d9a330-c3e1-43e9-92bf-5fa9d881fa3d service nova] [instance: fb09290d-4200-465f-8090-f062572b2e05] Received event network-vif-unplugged-2f5911fe-ab67-43db-b108-a8a97eca6bbc for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815305.2993953, 91c2d1cf-ffdb-47a3-b754-57a328947e10 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:55:05 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] VM Resumed (Lifecycle Event)
Jul 31 14:55:05 user nova-compute[72239]: DEBUG nova.compute.manager [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 14:55:05 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Instance spawned successfully.
Jul 31 14:55:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG nova.compute.manager [req-94f0e888-274a-44f0-b504-f80f67352c0f req-2422f9cc-84d5-4c5c-affd-def18f903504 service nova] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Received event network-vif-plugged-3b15bbc2-ce0e-4595-b7c6-543727b06b00 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-94f0e888-274a-44f0-b504-f80f67352c0f req-2422f9cc-84d5-4c5c-affd-def18f903504 service nova] Acquiring lock "91c2d1cf-ffdb-47a3-b754-57a328947e10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-94f0e888-274a-44f0-b504-f80f67352c0f req-2422f9cc-84d5-4c5c-affd-def18f903504 service nova] Lock "91c2d1cf-ffdb-47a3-b754-57a328947e10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-94f0e888-274a-44f0-b504-f80f67352c0f req-2422f9cc-84d5-4c5c-affd-def18f903504 service nova] Lock "91c2d1cf-ffdb-47a3-b754-57a328947e10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG nova.compute.manager [req-94f0e888-274a-44f0-b504-f80f67352c0f req-2422f9cc-84d5-4c5c-affd-def18f903504 service nova] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] No waiting events found dispatching network-vif-plugged-3b15bbc2-ce0e-4595-b7c6-543727b06b00 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:55:05 user nova-compute[72239]: WARNING nova.compute.manager [req-94f0e888-274a-44f0-b504-f80f67352c0f req-2422f9cc-84d5-4c5c-affd-def18f903504 service nova] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Received unexpected event network-vif-plugged-3b15bbc2-ce0e-4595-b7c6-543727b06b00 for instance with vm_state building and task_state spawning.
Jul 31 14:55:05 user nova-compute[72239]: DEBUG nova.compute.manager [req-94f0e888-274a-44f0-b504-f80f67352c0f req-2422f9cc-84d5-4c5c-affd-def18f903504 service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Received event network-vif-unplugged-4a60ced2-5c35-4f83-9734-e812bce6fad2 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-94f0e888-274a-44f0-b504-f80f67352c0f req-2422f9cc-84d5-4c5c-affd-def18f903504 service nova] Acquiring lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-94f0e888-274a-44f0-b504-f80f67352c0f req-2422f9cc-84d5-4c5c-affd-def18f903504 service nova] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-94f0e888-274a-44f0-b504-f80f67352c0f req-2422f9cc-84d5-4c5c-affd-def18f903504 service nova] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG nova.compute.manager [req-94f0e888-274a-44f0-b504-f80f67352c0f req-2422f9cc-84d5-4c5c-affd-def18f903504 service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] No waiting events found dispatching network-vif-unplugged-4a60ced2-5c35-4f83-9734-e812bce6fad2 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:55:05 user nova-compute[72239]: WARNING nova.compute.manager [req-94f0e888-274a-44f0-b504-f80f67352c0f req-2422f9cc-84d5-4c5c-affd-def18f903504 service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Received unexpected event network-vif-unplugged-4a60ced2-5c35-4f83-9734-e812bce6fad2 for instance with vm_state active and task_state powering-off.
Jul 31 14:55:05 user nova-compute[72239]: DEBUG nova.compute.manager [req-94f0e888-274a-44f0-b504-f80f67352c0f req-2422f9cc-84d5-4c5c-affd-def18f903504 service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Received event network-vif-plugged-4a60ced2-5c35-4f83-9734-e812bce6fad2 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-94f0e888-274a-44f0-b504-f80f67352c0f req-2422f9cc-84d5-4c5c-affd-def18f903504 service nova] Acquiring lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-94f0e888-274a-44f0-b504-f80f67352c0f req-2422f9cc-84d5-4c5c-affd-def18f903504 service nova] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-94f0e888-274a-44f0-b504-f80f67352c0f req-2422f9cc-84d5-4c5c-affd-def18f903504 service nova] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG nova.compute.manager [req-94f0e888-274a-44f0-b504-f80f67352c0f req-2422f9cc-84d5-4c5c-affd-def18f903504 service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] No waiting events found dispatching network-vif-plugged-4a60ced2-5c35-4f83-9734-e812bce6fad2 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:55:05 user nova-compute[72239]: WARNING nova.compute.manager [req-94f0e888-274a-44f0-b504-f80f67352c0f req-2422f9cc-84d5-4c5c-affd-def18f903504 service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Received unexpected event network-vif-plugged-4a60ced2-5c35-4f83-9734-e812bce6fad2 for instance with vm_state active and task_state powering-off.
Jul 31 14:55:05 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:55:05 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815305.3002248, 91c2d1cf-ffdb-47a3-b754-57a328947e10 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:55:05 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] VM Started (Lifecycle Event)
Jul 31 14:55:05 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:55:05 user nova-compute[72239]: INFO nova.compute.manager [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Took 6.24 seconds to spawn the instance on the hypervisor.
Jul 31 14:55:05 user nova-compute[72239]: DEBUG nova.compute.manager [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:55:05 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:55:05 user nova-compute[72239]: INFO nova.compute.manager [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Took 7.15 seconds to build instance.
Jul 31 14:55:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-197d9c24-08ea-44c7-9d12-24d1bc72dc8d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "91c2d1cf-ffdb-47a3-b754-57a328947e10" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.247s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:05 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Instance destroyed successfully.
Jul 31 14:55:05 user nova-compute[72239]: DEBUG nova.compute.manager [None req-07fd5384-4d5e-4b86-9af6-febd0cdc5d8e tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:55:05 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: fb09290d-4200-465f-8090-f062572b2e05] Instance destroyed successfully.
Jul 31 14:55:05 user nova-compute[72239]: DEBUG nova.objects.instance [None req-78ff8b77-c608-46eb-9971-58325f8e2b3b tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Lazy-loading 'resources' on Instance uuid fb09290d-4200-465f-8090-f062572b2e05 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-78ff8b77-c608-46eb-9971-58325f8e2b3b tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:53:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-887893133',display_name='tempest-VolumesActionsTest-instance-887893133',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-887893133',id=25,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:53:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a74501c9a7e4063b3f84e4bf0f15559',ramdisk_id='',reservation_id='r-4x6n09p1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-200342881',owner_user_name='tempest-VolumesActionsTest-200342881-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:53:22Z,user_data=None,user_id='fb45b0c1b7404ad2835ebab1ca3b4ff6',uuid=fb09290d-4200-465f-8090-f062572b2e05,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f5911fe-ab67-43db-b108-a8a97eca6bbc", "address": "fa:16:3e:45:61:6c", "network": {"id": "bcfa9b25-4156-49df-8aa7-70f499ea3479", "bridge": "br-int", "label": "tempest-VolumesActionsTest-203290973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a74501c9a7e4063b3f84e4bf0f15559", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5911fe-ab", "ovs_interfaceid": "2f5911fe-ab67-43db-b108-a8a97eca6bbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-78ff8b77-c608-46eb-9971-58325f8e2b3b tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Converting VIF {"id": "2f5911fe-ab67-43db-b108-a8a97eca6bbc", "address": "fa:16:3e:45:61:6c", "network": {"id": "bcfa9b25-4156-49df-8aa7-70f499ea3479", "bridge": "br-int", "label": "tempest-VolumesActionsTest-203290973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a74501c9a7e4063b3f84e4bf0f15559", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f5911fe-ab", "ovs_interfaceid": "2f5911fe-ab67-43db-b108-a8a97eca6bbc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-78ff8b77-c608-46eb-9971-58325f8e2b3b tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:61:6c,bridge_name='br-int',has_traffic_filtering=True,id=2f5911fe-ab67-43db-b108-a8a97eca6bbc,network=Network(bcfa9b25-4156-49df-8aa7-70f499ea3479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f5911fe-ab') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG os_vif [None req-78ff8b77-c608-46eb-9971-58325f8e2b3b tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:61:6c,bridge_name='br-int',has_traffic_filtering=True,id=2f5911fe-ab67-43db-b108-a8a97eca6bbc,network=Network(bcfa9b25-4156-49df-8aa7-70f499ea3479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f5911fe-ab') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f5911fe-ab, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:05 user nova-compute[72239]: INFO os_vif [None req-78ff8b77-c608-46eb-9971-58325f8e2b3b tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:61:6c,bridge_name='br-int',has_traffic_filtering=True,id=2f5911fe-ab67-43db-b108-a8a97eca6bbc,network=Network(bcfa9b25-4156-49df-8aa7-70f499ea3479),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f5911fe-ab')
Jul 31 14:55:05 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-78ff8b77-c608-46eb-9971-58325f8e2b3b tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: fb09290d-4200-465f-8090-f062572b2e05] Deleting instance files /opt/stack/data/nova/instances/fb09290d-4200-465f-8090-f062572b2e05_del
Jul 31 14:55:05 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-78ff8b77-c608-46eb-9971-58325f8e2b3b tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: fb09290d-4200-465f-8090-f062572b2e05] Deletion of /opt/stack/data/nova/instances/fb09290d-4200-465f-8090-f062572b2e05_del complete
Jul 31 14:55:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-07fd5384-4d5e-4b86-9af6-febd0cdc5d8e tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.285s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:55:05 user nova-compute[72239]: INFO nova.compute.manager [None req-78ff8b77-c608-46eb-9971-58325f8e2b3b tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] [instance: fb09290d-4200-465f-8090-f062572b2e05] Took 1.21 seconds to destroy the instance on the hypervisor.
Jul 31 14:55:05 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-78ff8b77-c608-46eb-9971-58325f8e2b3b tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: fb09290d-4200-465f-8090-f062572b2e05] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 14:55:05 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: fb09290d-4200-465f-8090-f062572b2e05] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 14:55:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:55:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '23436643639333339', 'path': '/dev/sdb'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:55:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436643639333339', 'path': '/dev/sdb'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 14:55:06 user nova-compute[72239]: DEBUG nova.objects.instance [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lazy-loading 'flavor' on Instance uuid 99961538-dde9-4f3b-9c87-ceb07a10e7dc {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:55:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 14:55:06 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:55:06 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 14:55:06 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:55:06 user nova-compute[72239]:   <serial>b8a712ef-2340-495b-b2e6-78bc39fc8031</serial>
Jul 31 14:55:06 user nova-compute[72239]: </disk>
Jul 31 14:55:06 user nova-compute[72239]:  {{(pid=72239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 14:55:06 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:55:06 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 14:55:06 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:06 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:55:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:55:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] No VIF found with MAC fa:16:3e:31:ea:2f, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:55:06 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:06 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-2f11022e-a007-4d4c-adc1-b54ea59b9e6a" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:55:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-2f11022e-a007-4d4c-adc1-b54ea59b9e6a" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:55:06 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 14:55:06 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:06 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9a46db9c-d7c5-4150-8ad2-30e1ad2c0529 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "99961538-dde9-4f3b-9c87-ceb07a10e7dc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.217s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:55:06 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: fb09290d-4200-465f-8090-f062572b2e05] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:55:06 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: fb09290d-4200-465f-8090-f062572b2e05] Took 0.79 seconds to deallocate network for instance.
Jul 31 14:55:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-78ff8b77-c608-46eb-9971-58325f8e2b3b tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:55:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-78ff8b77-c608-46eb-9971-58325f8e2b3b tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Updating instance_info_cache with network_info: [{"id": "91cadad3-732b-4fed-af92-b54692837973", "address": "fa:16:3e:44:72:66", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91cadad3-73", "ovs_interfaceid": "91cadad3-732b-4fed-af92-b54692837973", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-2f11022e-a007-4d4c-adc1-b54ea59b9e6a" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Cleaning up deleted instances {{(pid=72239) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] There are 0 instances to clean {{(pid=72239) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG nova.compute.manager [req-7c4bf5fe-c172-4c87-840c-823272d3b386 req-1d31a023-cdb4-422c-baca-26f3858e981c service nova] [instance: fb09290d-4200-465f-8090-f062572b2e05] Received event network-vif-plugged-2f5911fe-ab67-43db-b108-a8a97eca6bbc {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7c4bf5fe-c172-4c87-840c-823272d3b386 req-1d31a023-cdb4-422c-baca-26f3858e981c service nova] Acquiring lock "fb09290d-4200-465f-8090-f062572b2e05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7c4bf5fe-c172-4c87-840c-823272d3b386 req-1d31a023-cdb4-422c-baca-26f3858e981c service nova] Lock "fb09290d-4200-465f-8090-f062572b2e05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7c4bf5fe-c172-4c87-840c-823272d3b386 req-1d31a023-cdb4-422c-baca-26f3858e981c service nova] Lock "fb09290d-4200-465f-8090-f062572b2e05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG nova.compute.manager [req-7c4bf5fe-c172-4c87-840c-823272d3b386 req-1d31a023-cdb4-422c-baca-26f3858e981c service nova] [instance: fb09290d-4200-465f-8090-f062572b2e05] No waiting events found dispatching network-vif-plugged-2f5911fe-ab67-43db-b108-a8a97eca6bbc {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:55:07 user nova-compute[72239]: WARNING nova.compute.manager [req-7c4bf5fe-c172-4c87-840c-823272d3b386 req-1d31a023-cdb4-422c-baca-26f3858e981c service nova] [instance: fb09290d-4200-465f-8090-f062572b2e05] Received unexpected event network-vif-plugged-2f5911fe-ab67-43db-b108-a8a97eca6bbc for instance with vm_state deleted and task_state None.
Jul 31 14:55:07 user nova-compute[72239]: DEBUG nova.compute.manager [req-7c4bf5fe-c172-4c87-840c-823272d3b386 req-1d31a023-cdb4-422c-baca-26f3858e981c service nova] [instance: fb09290d-4200-465f-8090-f062572b2e05] Received event network-vif-plugged-2f5911fe-ab67-43db-b108-a8a97eca6bbc {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7c4bf5fe-c172-4c87-840c-823272d3b386 req-1d31a023-cdb4-422c-baca-26f3858e981c service nova] Acquiring lock "fb09290d-4200-465f-8090-f062572b2e05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7c4bf5fe-c172-4c87-840c-823272d3b386 req-1d31a023-cdb4-422c-baca-26f3858e981c service nova] Lock "fb09290d-4200-465f-8090-f062572b2e05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7c4bf5fe-c172-4c87-840c-823272d3b386 req-1d31a023-cdb4-422c-baca-26f3858e981c service nova] Lock "fb09290d-4200-465f-8090-f062572b2e05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG nova.compute.manager [req-7c4bf5fe-c172-4c87-840c-823272d3b386 req-1d31a023-cdb4-422c-baca-26f3858e981c service nova] [instance: fb09290d-4200-465f-8090-f062572b2e05] No waiting events found dispatching network-vif-plugged-2f5911fe-ab67-43db-b108-a8a97eca6bbc {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:55:07 user nova-compute[72239]: WARNING nova.compute.manager [req-7c4bf5fe-c172-4c87-840c-823272d3b386 req-1d31a023-cdb4-422c-baca-26f3858e981c service nova] [instance: fb09290d-4200-465f-8090-f062572b2e05] Received unexpected event network-vif-plugged-2f5911fe-ab67-43db-b108-a8a97eca6bbc for instance with vm_state deleted and task_state None.
Jul 31 14:55:07 user nova-compute[72239]: DEBUG nova.compute.manager [req-7c4bf5fe-c172-4c87-840c-823272d3b386 req-1d31a023-cdb4-422c-baca-26f3858e981c service nova] [instance: fb09290d-4200-465f-8090-f062572b2e05] Received event network-vif-plugged-2f5911fe-ab67-43db-b108-a8a97eca6bbc {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7c4bf5fe-c172-4c87-840c-823272d3b386 req-1d31a023-cdb4-422c-baca-26f3858e981c service nova] Acquiring lock "fb09290d-4200-465f-8090-f062572b2e05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7c4bf5fe-c172-4c87-840c-823272d3b386 req-1d31a023-cdb4-422c-baca-26f3858e981c service nova] Lock "fb09290d-4200-465f-8090-f062572b2e05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7c4bf5fe-c172-4c87-840c-823272d3b386 req-1d31a023-cdb4-422c-baca-26f3858e981c service nova] Lock "fb09290d-4200-465f-8090-f062572b2e05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG nova.compute.manager [req-7c4bf5fe-c172-4c87-840c-823272d3b386 req-1d31a023-cdb4-422c-baca-26f3858e981c service nova] [instance: fb09290d-4200-465f-8090-f062572b2e05] No waiting events found dispatching network-vif-plugged-2f5911fe-ab67-43db-b108-a8a97eca6bbc {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:55:07 user nova-compute[72239]: WARNING nova.compute.manager [req-7c4bf5fe-c172-4c87-840c-823272d3b386 req-1d31a023-cdb4-422c-baca-26f3858e981c service nova] [instance: fb09290d-4200-465f-8090-f062572b2e05] Received unexpected event network-vif-plugged-2f5911fe-ab67-43db-b108-a8a97eca6bbc for instance with vm_state deleted and task_state None.
Jul 31 14:55:07 user nova-compute[72239]: DEBUG nova.compute.manager [req-7c4bf5fe-c172-4c87-840c-823272d3b386 req-1d31a023-cdb4-422c-baca-26f3858e981c service nova] [instance: fb09290d-4200-465f-8090-f062572b2e05] Received event network-vif-unplugged-2f5911fe-ab67-43db-b108-a8a97eca6bbc {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7c4bf5fe-c172-4c87-840c-823272d3b386 req-1d31a023-cdb4-422c-baca-26f3858e981c service nova] Acquiring lock "fb09290d-4200-465f-8090-f062572b2e05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7c4bf5fe-c172-4c87-840c-823272d3b386 req-1d31a023-cdb4-422c-baca-26f3858e981c service nova] Lock "fb09290d-4200-465f-8090-f062572b2e05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7c4bf5fe-c172-4c87-840c-823272d3b386 req-1d31a023-cdb4-422c-baca-26f3858e981c service nova] Lock "fb09290d-4200-465f-8090-f062572b2e05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG nova.compute.manager [req-7c4bf5fe-c172-4c87-840c-823272d3b386 req-1d31a023-cdb4-422c-baca-26f3858e981c service nova] [instance: fb09290d-4200-465f-8090-f062572b2e05] No waiting events found dispatching network-vif-unplugged-2f5911fe-ab67-43db-b108-a8a97eca6bbc {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:55:07 user nova-compute[72239]: WARNING nova.compute.manager [req-7c4bf5fe-c172-4c87-840c-823272d3b386 req-1d31a023-cdb4-422c-baca-26f3858e981c service nova] [instance: fb09290d-4200-465f-8090-f062572b2e05] Received unexpected event network-vif-unplugged-2f5911fe-ab67-43db-b108-a8a97eca6bbc for instance with vm_state deleted and task_state None.
Jul 31 14:55:07 user nova-compute[72239]: DEBUG nova.compute.manager [req-7c4bf5fe-c172-4c87-840c-823272d3b386 req-1d31a023-cdb4-422c-baca-26f3858e981c service nova] [instance: fb09290d-4200-465f-8090-f062572b2e05] Received event network-vif-plugged-2f5911fe-ab67-43db-b108-a8a97eca6bbc {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7c4bf5fe-c172-4c87-840c-823272d3b386 req-1d31a023-cdb4-422c-baca-26f3858e981c service nova] Acquiring lock "fb09290d-4200-465f-8090-f062572b2e05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7c4bf5fe-c172-4c87-840c-823272d3b386 req-1d31a023-cdb4-422c-baca-26f3858e981c service nova] Lock "fb09290d-4200-465f-8090-f062572b2e05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7c4bf5fe-c172-4c87-840c-823272d3b386 req-1d31a023-cdb4-422c-baca-26f3858e981c service nova] Lock "fb09290d-4200-465f-8090-f062572b2e05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG nova.compute.manager [req-7c4bf5fe-c172-4c87-840c-823272d3b386 req-1d31a023-cdb4-422c-baca-26f3858e981c service nova] [instance: fb09290d-4200-465f-8090-f062572b2e05] No waiting events found dispatching network-vif-plugged-2f5911fe-ab67-43db-b108-a8a97eca6bbc {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:55:07 user nova-compute[72239]: WARNING nova.compute.manager [req-7c4bf5fe-c172-4c87-840c-823272d3b386 req-1d31a023-cdb4-422c-baca-26f3858e981c service nova] [instance: fb09290d-4200-465f-8090-f062572b2e05] Received unexpected event network-vif-plugged-2f5911fe-ab67-43db-b108-a8a97eca6bbc for instance with vm_state deleted and task_state None.
Jul 31 14:55:07 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-78ff8b77-c608-46eb-9971-58325f8e2b3b tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-78ff8b77-c608-46eb-9971-58325f8e2b3b tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-78ff8b77-c608-46eb-9971-58325f8e2b3b tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.500s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:55:07 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-78ff8b77-c608-46eb-9971-58325f8e2b3b tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Deleted allocations for instance fb09290d-4200-465f-8090-f062572b2e05
Jul 31 14:55:07 user nova-compute[72239]: DEBUG nova.compute.manager [req-317d41d8-68b1-4ca9-9727-3d10c9ba5428 req-2249a7be-78bb-4dcf-80da-6c2e25a8c1cb service nova] [instance: fb09290d-4200-465f-8090-f062572b2e05] Received event network-vif-deleted-2f5911fe-ab67-43db-b108-a8a97eca6bbc {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-78ff8b77-c608-46eb-9971-58325f8e2b3b tempest-VolumesActionsTest-200342881 tempest-VolumesActionsTest-200342881-project-member] Lock "fb09290d-4200-465f-8090-f062572b2e05" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.688s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk.rescue --force-share --output=json" returned: 0 in 0.160s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk (vdb) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:55:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99961538-dde9-4f3b-9c87-ceb07a10e7dc/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99961538-dde9-4f3b-9c87-ceb07a10e7dc/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99961538-dde9-4f3b-9c87-ceb07a10e7dc/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/99961538-dde9-4f3b-9c87-ceb07a10e7dc/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:08 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:55:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:08 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:55:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json" returned: 0 in 0.144s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:55:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dcd718a-280f-4b0e-b54f-616ee983ad16/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dcd718a-280f-4b0e-b54f-616ee983ad16/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dcd718a-280f-4b0e-b54f-616ee983ad16/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dcd718a-280f-4b0e-b54f-616ee983ad16/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json" returned: 0 in 0.307s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c2d1cf-ffdb-47a3-b754-57a328947e10/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c2d1cf-ffdb-47a3-b754-57a328947e10/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c2d1cf-ffdb-47a3-b754-57a328947e10/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c2d1cf-ffdb-47a3-b754-57a328947e10/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87dd3b4b-c511-4784-acf9-ad21534c8337/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87dd3b4b-c511-4784-acf9-ad21534c8337/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87dd3b4b-c511-4784-acf9-ad21534c8337/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87dd3b4b-c511-4784-acf9-ad21534c8337/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:55:11 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:55:11 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:55:11 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=7286MB free_disk=25.152111053466797GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 14:55:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:55:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:55:12 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 20abf743-de5b-4122-aad0-e2124c7804b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:55:12 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 7d81b881-b44e-4fb3-8245-9dea634bdec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:55:12 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 079a5ed7-ee25-495b-a2a4-924d830a670a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:55:12 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 2f11022e-a007-4d4c-adc1-b54ea59b9e6a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:55:12 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance c10918e9-9731-48ea-860e-8a02cb6a0ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:55:12 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance db15ad45-8f28-4e0c-8d7e-7db75f33fe92 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:55:12 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance c2b3c85b-e939-41d0-8bf0-3a7f650177b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:55:12 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 3559f541-ed61-41b2-9a9d-8b10e18f7375 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:55:12 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 87dd3b4b-c511-4784-acf9-ad21534c8337 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:55:12 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 99961538-dde9-4f3b-9c87-ceb07a10e7dc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:55:12 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 7dcd718a-280f-4b0e-b54f-616ee983ad16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:55:12 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 91c2d1cf-ffdb-47a3-b754-57a328947e10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:55:12 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 14:55:12 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 14:55:12 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Refreshing inventories for resource provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 14:55:12 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Updating ProviderTree inventory for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 14:55:12 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Updating inventory in ProviderTree for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 14:55:12 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Refreshing aggregate associations for resource provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e, aggregates: None {{(pid=72239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 14:55:12 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Refreshing trait associations for resource provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI {{(pid=72239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 14:55:12 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:55:12 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:55:12 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 14:55:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.688s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:55:12 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:55:12 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Cleaning up deleted instances with incomplete migration  {{(pid=72239) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 14:55:13 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:55:13 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 14:55:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:20 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690815305.7967556, db15ad45-8f28-4e0c-8d7e-7db75f33fe92 => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:55:20 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] VM Stopped (Lifecycle Event)
Jul 31 14:55:20 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690815305.8044386, fb09290d-4200-465f-8090-f062572b2e05 => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:55:20 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: fb09290d-4200-465f-8090-f062572b2e05] VM Stopped (Lifecycle Event)
Jul 31 14:55:20 user nova-compute[72239]: DEBUG nova.compute.manager [None req-007d34c7-94b9-4e06-a727-143732f2961a None None] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:55:20 user nova-compute[72239]: DEBUG nova.compute.manager [None req-36e58acd-5392-4b80-ba33-4797f46100e7 None None] [instance: fb09290d-4200-465f-8090-f062572b2e05] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:55:20 user nova-compute[72239]: DEBUG nova.compute.manager [None req-007d34c7-94b9-4e06-a727-143732f2961a None None] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:55:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:24 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a208f443-b0f6-4e0c-9e5d-5165e7faa486 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Acquiring lock "99961538-dde9-4f3b-9c87-ceb07a10e7dc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a208f443-b0f6-4e0c-9e5d-5165e7faa486 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "99961538-dde9-4f3b-9c87-ceb07a10e7dc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:55:26 user nova-compute[72239]: INFO nova.compute.manager [None req-a208f443-b0f6-4e0c-9e5d-5165e7faa486 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Detaching volume b8a712ef-2340-495b-b2e6-78bc39fc8031
Jul 31 14:55:26 user nova-compute[72239]: INFO nova.virt.block_device [None req-a208f443-b0f6-4e0c-9e5d-5165e7faa486 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Attempting to driver detach volume b8a712ef-2340-495b-b2e6-78bc39fc8031 from mountpoint /dev/vdb
Jul 31 14:55:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a208f443-b0f6-4e0c-9e5d-5165e7faa486 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Attempting to detach device vdb from instance 99961538-dde9-4f3b-9c87-ceb07a10e7dc from the persistent domain config. {{(pid=72239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-a208f443-b0f6-4e0c-9e5d-5165e7faa486 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 14:55:26 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:55:26 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 14:55:26 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:55:26 user nova-compute[72239]:   <serial>b8a712ef-2340-495b-b2e6-78bc39fc8031</serial>
Jul 31 14:55:26 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 14:55:26 user nova-compute[72239]: </disk>
Jul 31 14:55:26 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 14:55:26 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-a208f443-b0f6-4e0c-9e5d-5165e7faa486 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Successfully detached device vdb from instance 99961538-dde9-4f3b-9c87-ceb07a10e7dc from the persistent domain config.
Jul 31 14:55:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a208f443-b0f6-4e0c-9e5d-5165e7faa486 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 99961538-dde9-4f3b-9c87-ceb07a10e7dc from the live domain config. {{(pid=72239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-a208f443-b0f6-4e0c-9e5d-5165e7faa486 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 14:55:26 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:55:26 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 14:55:26 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:55:26 user nova-compute[72239]:   <serial>b8a712ef-2340-495b-b2e6-78bc39fc8031</serial>
Jul 31 14:55:26 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 14:55:26 user nova-compute[72239]: </disk>
Jul 31 14:55:26 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0d506489-79d4-482e-aeae-01747ef618fd tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Acquiring lock "99961538-dde9-4f3b-9c87-ceb07a10e7dc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Received event <DeviceRemovedEvent: 1690815326.6468341, 99961538-dde9-4f3b-9c87-ceb07a10e7dc => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72239) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a208f443-b0f6-4e0c-9e5d-5165e7faa486 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 99961538-dde9-4f3b-9c87-ceb07a10e7dc {{(pid=72239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 14:55:26 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-a208f443-b0f6-4e0c-9e5d-5165e7faa486 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Successfully detached device vdb from instance 99961538-dde9-4f3b-9c87-ceb07a10e7dc from the live domain config.
Jul 31 14:55:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a208f443-b0f6-4e0c-9e5d-5165e7faa486 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a208f443-b0f6-4e0c-9e5d-5165e7faa486 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IpcbhBYu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:55:26 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-a208f443-b0f6-4e0c-9e5d-5165e7faa486 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:55:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-a208f443-b0f6-4e0c-9e5d-5165e7faa486 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-a208f443-b0f6-4e0c-9e5d-5165e7faa486 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a208f443-b0f6-4e0c-9e5d-5165e7faa486 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21f1872-aa9c-420f-abab-a8bb39499b8b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3912f386-0e79-4084-8cc6-3f1d49f91efe]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a208f443-b0f6-4e0c-9e5d-5165e7faa486 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:55:26 user nova-compute[72239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)
Jul 31 14:55:26 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:55:26 user nova-compute[72239]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)
Jul 31 14:55:26 user nova-compute[72239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031 (non-flash)
Jul 31 14:55:26 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a208f443-b0f6-4e0c-9e5d-5165e7faa486 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:55:26 user nova-compute[72239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)
Jul 31 14:55:26 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:55:26 user nova-compute[72239]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)
Jul 31 14:55:26 user nova-compute[72239]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031 (non-flash)
Jul 31 14:55:26 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a208f443-b0f6-4e0c-9e5d-5165e7faa486 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4126ac9750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031'): ({'sdb'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-a208f443-b0f6-4e0c-9e5d-5165e7faa486 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Removing single pathed devices sdb {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[be194048-5f59-417a-b31d-7e209afc005f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17de39e-9400-4e25-a27a-ad9ed85459c2]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-a208f443-b0f6-4e0c-9e5d-5165e7faa486 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Flushing IO for device /dev/sdb {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecead557-535f-4ea3-8aed-a8f3b96ffda1]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-a208f443-b0f6-4e0c-9e5d-5165e7faa486 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0be255-eb2b-4e64-bfdd-2b4cc8bb3fbd]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-a208f443-b0f6-4e0c-9e5d-5165e7faa486 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-a208f443-b0f6-4e0c-9e5d-5165e7faa486 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a208f443-b0f6-4e0c-9e5d-5165e7faa486 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[798d0ba8-0a91-471b-896e-d7baebae6e4d]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a208f443-b0f6-4e0c-9e5d-5165e7faa486 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031 -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031 -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[40197e60-75ba-473e-94ca-d7bf6e18420d]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a208f443-b0f6-4e0c-9e5d-5165e7faa486 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031, portal: 172.16.0.220,3260]
Jul 31 14:55:26 user nova-compute[72239]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031, portal: 172.16.0.220,3260] successful.
Jul 31 14:55:26 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031 -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1c67c4-28d8-4d6d-9eb3-a8b3051d57d6]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a208f443-b0f6-4e0c-9e5d-5165e7faa486 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-a208f443-b0f6-4e0c-9e5d-5165e7faa486 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a208f443-b0f6-4e0c-9e5d-5165e7faa486 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] <== disconnect_volume: return (297ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:55:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a208f443-b0f6-4e0c-9e5d-5165e7faa486 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 14:55:27 user nova-compute[72239]: DEBUG nova.objects.instance [None req-a208f443-b0f6-4e0c-9e5d-5165e7faa486 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lazy-loading 'flavor' on Instance uuid 99961538-dde9-4f3b-9c87-ceb07a10e7dc {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:55:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a208f443-b0f6-4e0c-9e5d-5165e7faa486 tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "99961538-dde9-4f3b-9c87-ceb07a10e7dc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.631s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:55:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0d506489-79d4-482e-aeae-01747ef618fd tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "99961538-dde9-4f3b-9c87-ceb07a10e7dc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.487s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:55:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0d506489-79d4-482e-aeae-01747ef618fd tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Acquiring lock "99961538-dde9-4f3b-9c87-ceb07a10e7dc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:55:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0d506489-79d4-482e-aeae-01747ef618fd tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "99961538-dde9-4f3b-9c87-ceb07a10e7dc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:55:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0d506489-79d4-482e-aeae-01747ef618fd tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "99961538-dde9-4f3b-9c87-ceb07a10e7dc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:55:27 user nova-compute[72239]: INFO nova.compute.manager [None req-0d506489-79d4-482e-aeae-01747ef618fd tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Terminating instance
Jul 31 14:55:27 user nova-compute[72239]: DEBUG nova.compute.manager [None req-0d506489-79d4-482e-aeae-01747ef618fd tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 14:55:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG nova.compute.manager [req-10a990eb-b7d4-45b6-9464-db429a9a1834 req-87bc93f6-c95a-4dd2-9a52-ed8a8908298f service nova] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Received event network-vif-unplugged-d4f1a9e6-e739-4938-acd2-8769845f2a63 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-10a990eb-b7d4-45b6-9464-db429a9a1834 req-87bc93f6-c95a-4dd2-9a52-ed8a8908298f service nova] Acquiring lock "99961538-dde9-4f3b-9c87-ceb07a10e7dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-10a990eb-b7d4-45b6-9464-db429a9a1834 req-87bc93f6-c95a-4dd2-9a52-ed8a8908298f service nova] Lock "99961538-dde9-4f3b-9c87-ceb07a10e7dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-10a990eb-b7d4-45b6-9464-db429a9a1834 req-87bc93f6-c95a-4dd2-9a52-ed8a8908298f service nova] Lock "99961538-dde9-4f3b-9c87-ceb07a10e7dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG nova.compute.manager [req-10a990eb-b7d4-45b6-9464-db429a9a1834 req-87bc93f6-c95a-4dd2-9a52-ed8a8908298f service nova] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] No waiting events found dispatching network-vif-unplugged-d4f1a9e6-e739-4938-acd2-8769845f2a63 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG nova.compute.manager [req-10a990eb-b7d4-45b6-9464-db429a9a1834 req-87bc93f6-c95a-4dd2-9a52-ed8a8908298f service nova] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Received event network-vif-unplugged-d4f1a9e6-e739-4938-acd2-8769845f2a63 for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG nova.compute.manager [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 14:55:28 user nova-compute[72239]: INFO nova.compute.claims [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Claim successful on node user
Jul 31 14:55:28 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Instance destroyed successfully.
Jul 31 14:55:28 user nova-compute[72239]: DEBUG nova.objects.instance [None req-0d506489-79d4-482e-aeae-01747ef618fd tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lazy-loading 'resources' on Instance uuid 99961538-dde9-4f3b-9c87-ceb07a10e7dc {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-0d506489-79d4-482e-aeae-01747ef618fd tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:53:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-2014230836',display_name='tempest-VolumesSnapshotTestJSON-instance-2014230836',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-2014230836',id=24,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBITKrPqlRlMHUn+c7c7MiwVi26siELl57cI9X/uLcDzFnH4B2WNXU45YGhJHX/Swj2Jl+FX57hnaGdF3W9OOo+tfLb/hGwkAaatct74oUi/o27VHALGXcvOWJNZaxVua1w==',key_name='tempest-keypair-404801197',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:53:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d888450f903d41c5b6fde5de0b513a84',ramdisk_id='',reservation_id='r-vlccrbzr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-2087706080',owner_user_name='tempest-VolumesSnapshotTestJSON-2087706080-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:53:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3c842cf4052f4822948614bb63072812',uuid=99961538-dde9-4f3b-9c87-ceb07a10e7dc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d4f1a9e6-e739-4938-acd2-8769845f2a63", "address": "fa:16:3e:31:ea:2f", "network": {"id": "807530ad-b1c8-4426-9036-a796ba7dee91", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-277511856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d888450f903d41c5b6fde5de0b513a84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f1a9e6-e7", "ovs_interfaceid": "d4f1a9e6-e739-4938-acd2-8769845f2a63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-0d506489-79d4-482e-aeae-01747ef618fd tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Converting VIF {"id": "d4f1a9e6-e739-4938-acd2-8769845f2a63", "address": "fa:16:3e:31:ea:2f", "network": {"id": "807530ad-b1c8-4426-9036-a796ba7dee91", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-277511856-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d888450f903d41c5b6fde5de0b513a84", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd4f1a9e6-e7", "ovs_interfaceid": "d4f1a9e6-e739-4938-acd2-8769845f2a63", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-0d506489-79d4-482e-aeae-01747ef618fd tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:ea:2f,bridge_name='br-int',has_traffic_filtering=True,id=d4f1a9e6-e739-4938-acd2-8769845f2a63,network=Network(807530ad-b1c8-4426-9036-a796ba7dee91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4f1a9e6-e7') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG os_vif [None req-0d506489-79d4-482e-aeae-01747ef618fd tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:ea:2f,bridge_name='br-int',has_traffic_filtering=True,id=d4f1a9e6-e739-4938-acd2-8769845f2a63,network=Network(807530ad-b1c8-4426-9036-a796ba7dee91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4f1a9e6-e7') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd4f1a9e6-e7, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:28 user nova-compute[72239]: INFO os_vif [None req-0d506489-79d4-482e-aeae-01747ef618fd tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:ea:2f,bridge_name='br-int',has_traffic_filtering=True,id=d4f1a9e6-e739-4938-acd2-8769845f2a63,network=Network(807530ad-b1c8-4426-9036-a796ba7dee91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd4f1a9e6-e7')
Jul 31 14:55:28 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d506489-79d4-482e-aeae-01747ef618fd tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d506489-79d4-482e-aeae-01747ef618fd tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IpcbhBYu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:55:28 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-0d506489-79d4-482e-aeae-01747ef618fd tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:55:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-0d506489-79d4-482e-aeae-01747ef618fd tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-0d506489-79d4-482e-aeae-01747ef618fd tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d506489-79d4-482e-aeae-01747ef618fd tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b8a712ef-2340-495b-b2e6-78bc39fc8031', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[af749ee5-bfde-4873-a1d3-1f44992ebb92]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9deb1c5-6444-4bdb-93a6-5d2d38bced0a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d506489-79d4-482e-aeae-01747ef618fd tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:55:28 user nova-compute[72239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)
Jul 31 14:55:28 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:55:28 user nova-compute[72239]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)
Jul 31 14:55:28 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d506489-79d4-482e-aeae-01747ef618fd tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:55:28 user nova-compute[72239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)
Jul 31 14:55:28 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:55:28 user nova-compute[72239]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)
Jul 31 14:55:28 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d506489-79d4-482e-aeae-01747ef618fd tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4120258f70>, {}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d506489-79d4-482e-aeae-01747ef618fd tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Disconnecting from: [] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-0d506489-79d4-482e-aeae-01747ef618fd tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.051s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d506489-79d4-482e-aeae-01747ef618fd tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] <== disconnect_volume: return (52ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d506489-79d4-482e-aeae-01747ef618fd tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 14:55:28 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-0d506489-79d4-482e-aeae-01747ef618fd tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Deleting instance files /opt/stack/data/nova/instances/99961538-dde9-4f3b-9c87-ceb07a10e7dc_del
Jul 31 14:55:28 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-0d506489-79d4-482e-aeae-01747ef618fd tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Deletion of /opt/stack/data/nova/instances/99961538-dde9-4f3b-9c87-ceb07a10e7dc_del complete
Jul 31 14:55:28 user nova-compute[72239]: INFO nova.compute.manager [None req-0d506489-79d4-482e-aeae-01747ef618fd tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Took 0.94 seconds to destroy the instance on the hypervisor.
Jul 31 14:55:28 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-0d506489-79d4-482e-aeae-01747ef618fd tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG nova.compute.manager [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG nova.compute.manager [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 14:55:28 user nova-compute[72239]: DEBUG nova.network.neutron [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 14:55:28 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 14:55:28 user nova-compute[72239]: DEBUG nova.compute.manager [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 14:55:28 user nova-compute[72239]: INFO nova.virt.block_device [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Booting with volume-backed-image c6afbfe5-0fbc-464d-978f-d1243b0a6ba8 at /dev/vda
Jul 31 14:55:28 user nova-compute[72239]: DEBUG nova.policy [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '94ab9298205143d489f678b28be5b085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d8281237f9c417a9685e55826911e1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 14:55:29 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:55:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:29 user nova-compute[72239]: DEBUG nova.compute.manager [req-011c0e7c-cd09-4720-97dd-9f341a824133 req-0ed9a683-6dd3-4e27-aa7f-102c9492fb2e service nova] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Received event network-vif-deleted-d4f1a9e6-e739-4938-acd2-8769845f2a63 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:55:29 user nova-compute[72239]: INFO nova.compute.manager [req-011c0e7c-cd09-4720-97dd-9f341a824133 req-0ed9a683-6dd3-4e27-aa7f-102c9492fb2e service nova] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Neutron deleted interface d4f1a9e6-e739-4938-acd2-8769845f2a63; detaching it from the instance and deleting it from the info cache
Jul 31 14:55:29 user nova-compute[72239]: DEBUG nova.network.neutron [req-011c0e7c-cd09-4720-97dd-9f341a824133 req-0ed9a683-6dd3-4e27-aa7f-102c9492fb2e service nova] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:55:29 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Took 0.81 seconds to deallocate network for instance.
Jul 31 14:55:29 user nova-compute[72239]: DEBUG nova.compute.manager [req-011c0e7c-cd09-4720-97dd-9f341a824133 req-0ed9a683-6dd3-4e27-aa7f-102c9492fb2e service nova] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Detach interface failed, port_id=d4f1a9e6-e739-4938-acd2-8769845f2a63, reason: Instance 99961538-dde9-4f3b-9c87-ceb07a10e7dc could not be found. {{(pid=72239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 14:55:29 user nova-compute[72239]: WARNING nova.volume.cinder [None req-0d506489-79d4-482e-aeae-01747ef618fd tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Attachment 6333f9c1-1f3c-4d68-98a6-90dd68c8af76 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 6333f9c1-1f3c-4d68-98a6-90dd68c8af76. (HTTP 404) (Request-ID: req-ec15417c-b730-4edf-aa7f-e3e12a0cf12b)
Jul 31 14:55:29 user nova-compute[72239]: INFO nova.compute.manager [None req-0d506489-79d4-482e-aeae-01747ef618fd tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Took 0.03 seconds to detach 1 volumes for instance.
Jul 31 14:55:29 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0d506489-79d4-482e-aeae-01747ef618fd tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:55:29 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0d506489-79d4-482e-aeae-01747ef618fd tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:55:29 user nova-compute[72239]: DEBUG nova.network.neutron [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Successfully created port: 5c7f836e-274b-4a20-915a-d28d7e70d2a3 {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:55:29 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-0d506489-79d4-482e-aeae-01747ef618fd tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:55:29 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-0d506489-79d4-482e-aeae-01747ef618fd tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:55:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0d506489-79d4-482e-aeae-01747ef618fd tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.427s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:55:30 user nova-compute[72239]: DEBUG nova.compute.manager [req-5fac5971-9ea7-4d1d-9924-553e6d72170f req-67bfee53-dc24-4335-b46f-a2d827130487 service nova] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Received event network-vif-plugged-d4f1a9e6-e739-4938-acd2-8769845f2a63 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:55:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5fac5971-9ea7-4d1d-9924-553e6d72170f req-67bfee53-dc24-4335-b46f-a2d827130487 service nova] Acquiring lock "99961538-dde9-4f3b-9c87-ceb07a10e7dc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:55:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5fac5971-9ea7-4d1d-9924-553e6d72170f req-67bfee53-dc24-4335-b46f-a2d827130487 service nova] Lock "99961538-dde9-4f3b-9c87-ceb07a10e7dc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:55:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5fac5971-9ea7-4d1d-9924-553e6d72170f req-67bfee53-dc24-4335-b46f-a2d827130487 service nova] Lock "99961538-dde9-4f3b-9c87-ceb07a10e7dc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:55:30 user nova-compute[72239]: DEBUG nova.compute.manager [req-5fac5971-9ea7-4d1d-9924-553e6d72170f req-67bfee53-dc24-4335-b46f-a2d827130487 service nova] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] No waiting events found dispatching network-vif-plugged-d4f1a9e6-e739-4938-acd2-8769845f2a63 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:55:30 user nova-compute[72239]: WARNING nova.compute.manager [req-5fac5971-9ea7-4d1d-9924-553e6d72170f req-67bfee53-dc24-4335-b46f-a2d827130487 service nova] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Received unexpected event network-vif-plugged-d4f1a9e6-e739-4938-acd2-8769845f2a63 for instance with vm_state deleted and task_state None.
Jul 31 14:55:30 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-0d506489-79d4-482e-aeae-01747ef618fd tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Deleted allocations for instance 99961538-dde9-4f3b-9c87-ceb07a10e7dc
Jul 31 14:55:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0d506489-79d4-482e-aeae-01747ef618fd tempest-VolumesSnapshotTestJSON-2087706080 tempest-VolumesSnapshotTestJSON-2087706080-project-member] Lock "99961538-dde9-4f3b-9c87-ceb07a10e7dc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.406s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:55:30 user nova-compute[72239]: DEBUG nova.network.neutron [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Successfully updated port: 5c7f836e-274b-4a20-915a-d28d7e70d2a3 {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:55:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "refresh_cache-e6f6d85d-ffa0-4d72-b521-e855afa23a09" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:55:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquired lock "refresh_cache-e6f6d85d-ffa0-4d72-b521-e855afa23a09" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:55:30 user nova-compute[72239]: DEBUG nova.network.neutron [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:55:30 user nova-compute[72239]: DEBUG nova.compute.manager [req-dc6a99ef-7981-4955-9c82-b595bc29ef56 req-3ef03bcb-306b-4c8e-9384-ee5a6a3f30de service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Received event network-changed-5c7f836e-274b-4a20-915a-d28d7e70d2a3 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:55:30 user nova-compute[72239]: DEBUG nova.compute.manager [req-dc6a99ef-7981-4955-9c82-b595bc29ef56 req-3ef03bcb-306b-4c8e-9384-ee5a6a3f30de service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Refreshing instance network info cache due to event network-changed-5c7f836e-274b-4a20-915a-d28d7e70d2a3. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:55:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-dc6a99ef-7981-4955-9c82-b595bc29ef56 req-3ef03bcb-306b-4c8e-9384-ee5a6a3f30de service nova] Acquiring lock "refresh_cache-e6f6d85d-ffa0-4d72-b521-e855afa23a09" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:55:30 user nova-compute[72239]: DEBUG nova.network.neutron [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:55:30 user nova-compute[72239]: DEBUG nova.network.neutron [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Updating instance_info_cache with network_info: [{"id": "5c7f836e-274b-4a20-915a-d28d7e70d2a3", "address": "fa:16:3e:78:53:e9", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7f836e-27", "ovs_interfaceid": "5c7f836e-274b-4a20-915a-d28d7e70d2a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:55:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Releasing lock "refresh_cache-e6f6d85d-ffa0-4d72-b521-e855afa23a09" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:55:30 user nova-compute[72239]: DEBUG nova.compute.manager [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Instance network_info: |[{"id": "5c7f836e-274b-4a20-915a-d28d7e70d2a3", "address": "fa:16:3e:78:53:e9", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7f836e-27", "ovs_interfaceid": "5c7f836e-274b-4a20-915a-d28d7e70d2a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 14:55:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-dc6a99ef-7981-4955-9c82-b595bc29ef56 req-3ef03bcb-306b-4c8e-9384-ee5a6a3f30de service nova] Acquired lock "refresh_cache-e6f6d85d-ffa0-4d72-b521-e855afa23a09" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:55:30 user nova-compute[72239]: DEBUG nova.network.neutron [req-dc6a99ef-7981-4955-9c82-b595bc29ef56 req-3ef03bcb-306b-4c8e-9384-ee5a6a3f30de service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Refreshing network info cache for port 5c7f836e-274b-4a20-915a-d28d7e70d2a3 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:55:31 user nova-compute[72239]: DEBUG nova.network.neutron [req-dc6a99ef-7981-4955-9c82-b595bc29ef56 req-3ef03bcb-306b-4c8e-9384-ee5a6a3f30de service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Updated VIF entry in instance network info cache for port 5c7f836e-274b-4a20-915a-d28d7e70d2a3. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:55:31 user nova-compute[72239]: DEBUG nova.network.neutron [req-dc6a99ef-7981-4955-9c82-b595bc29ef56 req-3ef03bcb-306b-4c8e-9384-ee5a6a3f30de service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Updating instance_info_cache with network_info: [{"id": "5c7f836e-274b-4a20-915a-d28d7e70d2a3", "address": "fa:16:3e:78:53:e9", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7f836e-27", "ovs_interfaceid": "5c7f836e-274b-4a20-915a-d28d7e70d2a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:55:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-dc6a99ef-7981-4955-9c82-b595bc29ef56 req-3ef03bcb-306b-4c8e-9384-ee5a6a3f30de service nova] Releasing lock "refresh_cache-e6f6d85d-ffa0-4d72-b521-e855afa23a09" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:55:33 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "14653984-6c32-4ddd-bc0b-203a670c2b4e" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "14653984-6c32-4ddd-bc0b-203a670c2b4e" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:55:34 user nova-compute[72239]: INFO nova.compute.manager [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Unshelving
Jul 31 14:55:34 user nova-compute[72239]: INFO nova.virt.block_device [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Booting with volume b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd at /dev/vdc
Jul 31 14:55:34 user nova-compute[72239]: DEBUG os_brick.utils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f11deb-d6c7-4ecf-bc8e-6978c6542244]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0ffd6a-3e03-438b-a736-aaf09a449d19]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48d8ea7-8a70-4da6-a1f0-23201a56f89e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a326e9-8267-4e14-8259-50153aa04704]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:55:34 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 14:55:34 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a705f4-13c9-4c72-9c21-ed1197079be5]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG os_brick.utils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Updating existing volume attachment record: f29137ce-a6a7-4420-a1f4-2e77e4560e06 {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG os_brick.utils [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6240fb-f5e9-45a5-85da-805b98367c54]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a62cca1-d4cf-4f35-a6db-36d4220b50ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6c43ee-395e-4efa-8932-a7048f598347]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5a5774-d9ec-4aec-8dee-861b9b467b32]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:55:34 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 14:55:34 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc8f9bd-43ad-4b4f-b180-855e42eb1f85]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG os_brick.utils [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:55:34 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Updating existing volume attachment record: c5cc8cd8-05ef-4a05-88a4-09add22fb5b9 {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 14:55:38 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:55:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:55:41 user nova-compute[72239]: DEBUG nova.objects.instance [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lazy-loading 'pci_requests' on Instance uuid 14653984-6c32-4ddd-bc0b-203a670c2b4e {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:55:41 user nova-compute[72239]: DEBUG nova.objects.instance [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lazy-loading 'numa_topology' on Instance uuid 14653984-6c32-4ddd-bc0b-203a670c2b4e {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:55:41 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 14:55:41 user nova-compute[72239]: INFO nova.compute.claims [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Claim successful on node user
Jul 31 14:55:42 user nova-compute[72239]: DEBUG nova.compute.manager [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 14:55:42 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Creating image(s)
Jul 31 14:55:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Did not create local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Ensure instance console log exists: /opt/stack/data/nova/instances/e6f6d85d-ffa0-4d72-b521-e855afa23a09/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Start _get_guest_xml network_info=[{"id": "5c7f836e-274b-4a20-915a-d28d7e70d2a3", "address": "fa:16:3e:78:53:e9", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7f836e-27", "ovs_interfaceid": "5c7f836e-274b-4a20-915a-d28d7e70d2a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'c5cc8cd8-05ef-4a05-88a4-09add22fb5b9', 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kPyhpOjt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e6f6d85d-ffa0-4d72-b521-e855afa23a09', 'attached_at': '', 'detached_at': '', 'volume_id': '084e3707-fde6-425e-bb74-cc8b96e427ae', 'serial': '084e3707-fde6-425e-bb74-cc8b96e427ae'}, 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:55:42 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:55:42 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:55:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kPyhpOjt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:55:42 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:55:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:55:42 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:55:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:55:42 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 14:55:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c114ca4-075b-4af6-a0ba-64a70fd07545]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 14:55:42 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[712b8941-ce00-4875-a683-d5323e2dc11e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae] added
Jul 31 14:55:42 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb2a359-5273-449f-97cf-4087ce108b54]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2964dd-9abb-4168-b87d-445de7516414]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kPyhpOjt {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kPyhpOjt" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b49ea701-0083-4308-90a6-c15679c424f2]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kPyhpOjt'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.592s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48b13e4-4da0-446a-a56d-bb5a1b5686be]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc3bc4c4-eb9b-4607-a3a8-805a86cb74d8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:55:42 user nova-compute[72239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)
Jul 31 14:55:42 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:55:42 user nova-compute[72239]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)
Jul 31 14:55:42 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:55:42 user nova-compute[72239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)
Jul 31 14:55:42 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:55:42 user nova-compute[72239]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)
Jul 31 14:55:42 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:42 user nova-compute[72239]: INFO nova.network.neutron [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Updating port b1b01e63-209d-4388-a81d-eb17afdf0db4 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fc8c61-d877-4ca5-9ec7-08dac418fa4c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae, portal: 172.16.0.220,3260]
Jul 31 14:55:42 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae, portal: 172.16.0.220,3260] successful.
Jul 31 14:55:42 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[629deaab-b063-45b0-bdb1-0fc98429e2f1]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4d5db2-2a54-4d37-9742-0a1d0a577ee3]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:55:42 user nova-compute[72239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)
Jul 31 14:55:42 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:55:42 user nova-compute[72239]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)
Jul 31 14:55:42 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 14:55:42 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:55:42 user nova-compute[72239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)
Jul 31 14:55:42 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:55:42 user nova-compute[72239]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)
Jul 31 14:55:42 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 14:55:42 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3286ca-7efe-462d-8f62-064536a0c63b]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:55:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kPyhpOjt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 14:55:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "refresh_cache-14653984-6c32-4ddd-bc0b-203a670c2b4e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:55:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquired lock "refresh_cache-14653984-6c32-4ddd-bc0b-203a670c2b4e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:55:43 user nova-compute[72239]: DEBUG nova.network.neutron [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:55:43 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690815328.516926, 99961538-dde9-4f3b-9c87-ceb07a10e7dc => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:55:43 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] VM Stopped (Lifecycle Event)
Jul 31 14:55:43 user nova-compute[72239]: DEBUG nova.compute.manager [req-fed78033-dfd5-426f-932a-0b828b163c67 req-0b7d912a-4d21-455b-ac1d-03303c0e3907 service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Received event network-changed-b1b01e63-209d-4388-a81d-eb17afdf0db4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:55:43 user nova-compute[72239]: DEBUG nova.compute.manager [req-fed78033-dfd5-426f-932a-0b828b163c67 req-0b7d912a-4d21-455b-ac1d-03303c0e3907 service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Refreshing instance network info cache due to event network-changed-b1b01e63-209d-4388-a81d-eb17afdf0db4. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:55:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-fed78033-dfd5-426f-932a-0b828b163c67 req-0b7d912a-4d21-455b-ac1d-03303c0e3907 service nova] Acquiring lock "refresh_cache-14653984-6c32-4ddd-bc0b-203a670c2b4e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:55:43 user nova-compute[72239]: DEBUG nova.compute.manager [None req-aa4e2329-d692-4490-9c90-47b84075312f None None] [instance: 99961538-dde9-4f3b-9c87-ceb07a10e7dc] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:55:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:55:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '26331343864356530', 'path': '/dev/sdb'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:55:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331343864356530', 'path': '/dev/sdb'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 14:55:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:55:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-714375545',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-714375545',id=28,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d8281237f9c417a9685e55826911e1b',ramdisk_id='',reservation_id='r-a0hy000h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-148379254',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:55:29Z,user_data=None,user_id='94ab9298205143d489f678b28be5b085',uuid=e6f6d85d-ffa0-4d72-b521-e855afa23a09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c7f836e-274b-4a20-915a-d28d7e70d2a3", "address": "fa:16:3e:78:53:e9", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7f836e-27", "ovs_interfaceid": "5c7f836e-274b-4a20-915a-d28d7e70d2a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:55:43 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Converting VIF {"id": "5c7f836e-274b-4a20-915a-d28d7e70d2a3", "address": "fa:16:3e:78:53:e9", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7f836e-27", "ovs_interfaceid": "5c7f836e-274b-4a20-915a-d28d7e70d2a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:55:43 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:53:e9,bridge_name='br-int',has_traffic_filtering=True,id=5c7f836e-274b-4a20-915a-d28d7e70d2a3,network=Network(172fb80f-4bbe-4706-91cf-60540fbceb2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c7f836e-27') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:55:43 user nova-compute[72239]: DEBUG nova.objects.instance [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lazy-loading 'pci_devices' on Instance uuid e6f6d85d-ffa0-4d72-b521-e855afa23a09 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:55:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:55:43 user nova-compute[72239]:   <uuid>e6f6d85d-ffa0-4d72-b521-e855afa23a09</uuid>
Jul 31 14:55:43 user nova-compute[72239]:   <name>instance-0000001c</name>
Jul 31 14:55:43 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:55:43 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:55:43 user nova-compute[72239]:   <metadata>
Jul 31 14:55:43 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:55:43 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:55:43 user nova-compute[72239]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-714375545</nova:name>
Jul 31 14:55:43 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:55:42</nova:creationTime>
Jul 31 14:55:43 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:55:43 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:55:43 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:55:43 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:55:43 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:55:43 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:55:43 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:55:43 user nova-compute[72239]:       <nova:owner>
Jul 31 14:55:43 user nova-compute[72239]:         <nova:user uuid="94ab9298205143d489f678b28be5b085">tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member</nova:user>
Jul 31 14:55:43 user nova-compute[72239]:         <nova:project uuid="1d8281237f9c417a9685e55826911e1b">tempest-ServerBootFromVolumeStableRescueTest-148379254</nova:project>
Jul 31 14:55:43 user nova-compute[72239]:       </nova:owner>
Jul 31 14:55:43 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:55:43 user nova-compute[72239]:       <nova:ports>
Jul 31 14:55:43 user nova-compute[72239]:         <nova:port uuid="5c7f836e-274b-4a20-915a-d28d7e70d2a3">
Jul 31 14:55:43 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 31 14:55:43 user nova-compute[72239]:         </nova:port>
Jul 31 14:55:43 user nova-compute[72239]:       </nova:ports>
Jul 31 14:55:43 user nova-compute[72239]:     </nova:instance>
Jul 31 14:55:43 user nova-compute[72239]:   </metadata>
Jul 31 14:55:43 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:55:43 user nova-compute[72239]:     <system>
Jul 31 14:55:43 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:55:43 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:55:43 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:55:43 user nova-compute[72239]:       <entry name="serial">e6f6d85d-ffa0-4d72-b521-e855afa23a09</entry>
Jul 31 14:55:43 user nova-compute[72239]:       <entry name="uuid">e6f6d85d-ffa0-4d72-b521-e855afa23a09</entry>
Jul 31 14:55:43 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:55:43 user nova-compute[72239]:     </system>
Jul 31 14:55:43 user nova-compute[72239]:   </sysinfo>
Jul 31 14:55:43 user nova-compute[72239]:   <os>
Jul 31 14:55:43 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:55:43 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:55:43 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:55:43 user nova-compute[72239]:   </os>
Jul 31 14:55:43 user nova-compute[72239]:   <features>
Jul 31 14:55:43 user nova-compute[72239]:     <acpi/>
Jul 31 14:55:43 user nova-compute[72239]:     <apic/>
Jul 31 14:55:43 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:55:43 user nova-compute[72239]:   </features>
Jul 31 14:55:43 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:55:43 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:55:43 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:55:43 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:55:43 user nova-compute[72239]:   </clock>
Jul 31 14:55:43 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:55:43 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:55:43 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:55:43 user nova-compute[72239]:   </cpu>
Jul 31 14:55:43 user nova-compute[72239]:   <devices>
Jul 31 14:55:43 user nova-compute[72239]:     <disk type="block" device="disk">
Jul 31 14:55:43 user nova-compute[72239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:55:43 user nova-compute[72239]:       <source dev="/dev/sdb"/>
Jul 31 14:55:43 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:55:43 user nova-compute[72239]:       <serial>084e3707-fde6-425e-bb74-cc8b96e427ae</serial>
Jul 31 14:55:43 user nova-compute[72239]:     </disk>
Jul 31 14:55:43 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:55:43 user nova-compute[72239]:       <mac address="fa:16:3e:78:53:e9"/>
Jul 31 14:55:43 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:55:43 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:55:43 user nova-compute[72239]:       <target dev="tap5c7f836e-27"/>
Jul 31 14:55:43 user nova-compute[72239]:     </interface>
Jul 31 14:55:43 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:55:43 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/e6f6d85d-ffa0-4d72-b521-e855afa23a09/console.log" append="off"/>
Jul 31 14:55:43 user nova-compute[72239]:     </serial>
Jul 31 14:55:43 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:55:43 user nova-compute[72239]:     <video>
Jul 31 14:55:43 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:55:43 user nova-compute[72239]:     </video>
Jul 31 14:55:43 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:55:43 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:55:43 user nova-compute[72239]:     </rng>
Jul 31 14:55:43 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:55:43 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:55:43 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:55:43 user nova-compute[72239]:     </memballoon>
Jul 31 14:55:43 user nova-compute[72239]:   </devices>
Jul 31 14:55:43 user nova-compute[72239]: </domain>
Jul 31 14:55:43 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:55:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:55:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-714375545',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-714375545',id=28,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d8281237f9c417a9685e55826911e1b',ramdisk_id='',reservation_id='r-a0hy000h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-148379254',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:55:29Z,user_data=None,user_id='94ab9298205143d489f678b28be5b085',uuid=e6f6d85d-ffa0-4d72-b521-e855afa23a09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5c7f836e-274b-4a20-915a-d28d7e70d2a3", "address": "fa:16:3e:78:53:e9", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7f836e-27", "ovs_interfaceid": "5c7f836e-274b-4a20-915a-d28d7e70d2a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:55:43 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Converting VIF {"id": "5c7f836e-274b-4a20-915a-d28d7e70d2a3", "address": "fa:16:3e:78:53:e9", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7f836e-27", "ovs_interfaceid": "5c7f836e-274b-4a20-915a-d28d7e70d2a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:55:43 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:53:e9,bridge_name='br-int',has_traffic_filtering=True,id=5c7f836e-274b-4a20-915a-d28d7e70d2a3,network=Network(172fb80f-4bbe-4706-91cf-60540fbceb2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c7f836e-27') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:55:43 user nova-compute[72239]: DEBUG os_vif [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:53:e9,bridge_name='br-int',has_traffic_filtering=True,id=5c7f836e-274b-4a20-915a-d28d7e70d2a3,network=Network(172fb80f-4bbe-4706-91cf-60540fbceb2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c7f836e-27') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:55:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:55:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:55:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5c7f836e-27, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:55:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5c7f836e-27, col_values=(('external_ids', {'iface-id': '5c7f836e-274b-4a20-915a-d28d7e70d2a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:53:e9', 'vm-uuid': 'e6f6d85d-ffa0-4d72-b521-e855afa23a09'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:55:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:55:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:43 user nova-compute[72239]: INFO os_vif [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:53:e9,bridge_name='br-int',has_traffic_filtering=True,id=5c7f836e-274b-4a20-915a-d28d7e70d2a3,network=Network(172fb80f-4bbe-4706-91cf-60540fbceb2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c7f836e-27')
Jul 31 14:55:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:55:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] No VIF found with MAC fa:16:3e:78:53:e9, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:55:44 user nova-compute[72239]: DEBUG nova.network.neutron [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Updating instance_info_cache with network_info: [{"id": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "address": "fa:16:3e:5e:e5:b2", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b01e63-20", "ovs_interfaceid": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:55:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Releasing lock "refresh_cache-14653984-6c32-4ddd-bc0b-203a670c2b4e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:55:44 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 14:55:44 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Creating image(s)
Jul 31 14:55:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "/opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:55:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "/opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:55:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "/opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:55:44 user nova-compute[72239]: DEBUG nova.objects.instance [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lazy-loading 'trusted_certs' on Instance uuid 14653984-6c32-4ddd-bc0b-203a670c2b4e {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:55:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-fed78033-dfd5-426f-932a-0b828b163c67 req-0b7d912a-4d21-455b-ac1d-03303c0e3907 service nova] Acquired lock "refresh_cache-14653984-6c32-4ddd-bc0b-203a670c2b4e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:55:44 user nova-compute[72239]: DEBUG nova.network.neutron [req-fed78033-dfd5-426f-932a-0b828b163c67 req-0b7d912a-4d21-455b-ac1d-03303c0e3907 service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Refreshing network info cache for port b1b01e63-209d-4388-a81d-eb17afdf0db4 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:55:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "0eb4f05eba9a32015c8b83592d2056a96eb7efc9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:55:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "0eb4f05eba9a32015c8b83592d2056a96eb7efc9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:55:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0eb4f05eba9a32015c8b83592d2056a96eb7efc9.part --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0eb4f05eba9a32015c8b83592d2056a96eb7efc9.part --force-share --output=json" returned: 0 in 0.159s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:45 user nova-compute[72239]: DEBUG nova.virt.images [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] e9ca2aa9-f324-4640-9fe3-c8839494aed1 was qcow2, converting to raw {{(pid=72239) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 31 14:55:45 user nova-compute[72239]: DEBUG nova.privsep.utils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72239) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 14:55:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0eb4f05eba9a32015c8b83592d2056a96eb7efc9.part /opt/stack/data/nova/instances/_base/0eb4f05eba9a32015c8b83592d2056a96eb7efc9.converted {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:45 user nova-compute[72239]: DEBUG nova.compute.manager [req-a4dd14b2-e610-4633-a627-2549aac98dc7 req-6ce5d879-af98-49b0-a35b-69738f9b2647 service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Received event network-vif-plugged-5c7f836e-274b-4a20-915a-d28d7e70d2a3 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:55:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a4dd14b2-e610-4633-a627-2549aac98dc7 req-6ce5d879-af98-49b0-a35b-69738f9b2647 service nova] Acquiring lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:55:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a4dd14b2-e610-4633-a627-2549aac98dc7 req-6ce5d879-af98-49b0-a35b-69738f9b2647 service nova] Lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:55:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a4dd14b2-e610-4633-a627-2549aac98dc7 req-6ce5d879-af98-49b0-a35b-69738f9b2647 service nova] Lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:55:45 user nova-compute[72239]: DEBUG nova.compute.manager [req-a4dd14b2-e610-4633-a627-2549aac98dc7 req-6ce5d879-af98-49b0-a35b-69738f9b2647 service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] No waiting events found dispatching network-vif-plugged-5c7f836e-274b-4a20-915a-d28d7e70d2a3 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:55:45 user nova-compute[72239]: WARNING nova.compute.manager [req-a4dd14b2-e610-4633-a627-2549aac98dc7 req-6ce5d879-af98-49b0-a35b-69738f9b2647 service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Received unexpected event network-vif-plugged-5c7f836e-274b-4a20-915a-d28d7e70d2a3 for instance with vm_state building and task_state spawning.
Jul 31 14:55:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0eb4f05eba9a32015c8b83592d2056a96eb7efc9.part /opt/stack/data/nova/instances/_base/0eb4f05eba9a32015c8b83592d2056a96eb7efc9.converted" returned: 0 in 0.247s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0eb4f05eba9a32015c8b83592d2056a96eb7efc9.converted --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:45 user nova-compute[72239]: DEBUG nova.network.neutron [req-fed78033-dfd5-426f-932a-0b828b163c67 req-0b7d912a-4d21-455b-ac1d-03303c0e3907 service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Updated VIF entry in instance network info cache for port b1b01e63-209d-4388-a81d-eb17afdf0db4. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:55:45 user nova-compute[72239]: DEBUG nova.network.neutron [req-fed78033-dfd5-426f-932a-0b828b163c67 req-0b7d912a-4d21-455b-ac1d-03303c0e3907 service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Updating instance_info_cache with network_info: [{"id": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "address": "fa:16:3e:5e:e5:b2", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b01e63-20", "ovs_interfaceid": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:55:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-fed78033-dfd5-426f-932a-0b828b163c67 req-0b7d912a-4d21-455b-ac1d-03303c0e3907 service nova] Releasing lock "refresh_cache-14653984-6c32-4ddd-bc0b-203a670c2b4e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:55:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0eb4f05eba9a32015c8b83592d2056a96eb7efc9.converted --force-share --output=json" returned: 0 in 0.140s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "0eb4f05eba9a32015c8b83592d2056a96eb7efc9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.307s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:55:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0eb4f05eba9a32015c8b83592d2056a96eb7efc9 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0eb4f05eba9a32015c8b83592d2056a96eb7efc9 --force-share --output=json" returned: 0 in 0.136s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "0eb4f05eba9a32015c8b83592d2056a96eb7efc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:55:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "0eb4f05eba9a32015c8b83592d2056a96eb7efc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:55:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0eb4f05eba9a32015c8b83592d2056a96eb7efc9 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0eb4f05eba9a32015c8b83592d2056a96eb7efc9 --force-share --output=json" returned: 0 in 0.131s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0eb4f05eba9a32015c8b83592d2056a96eb7efc9,backing_fmt=raw /opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0eb4f05eba9a32015c8b83592d2056a96eb7efc9,backing_fmt=raw /opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/disk 1073741824" returned: 0 in 0.052s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "0eb4f05eba9a32015c8b83592d2056a96eb7efc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:55:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0eb4f05eba9a32015c8b83592d2056a96eb7efc9 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0eb4f05eba9a32015c8b83592d2056a96eb7efc9 --force-share --output=json" returned: 0 in 0.135s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:46 user nova-compute[72239]: DEBUG nova.objects.instance [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lazy-loading 'migration_context' on Instance uuid 14653984-6c32-4ddd-bc0b-203a670c2b4e {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:55:46 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Rebasing disk image.
Jul 31 14:55:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.134s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:46 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 -F raw /opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/disk {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:47 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815347.252903, e6f6d85d-ffa0-4d72-b521-e855afa23a09 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:55:47 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] VM Resumed (Lifecycle Event)
Jul 31 14:55:47 user nova-compute[72239]: DEBUG nova.compute.manager [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:55:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 14:55:47 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Instance spawned successfully.
Jul 31 14:55:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 14:55:47 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:55:47 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:55:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:55:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:55:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:55:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:55:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:55:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:55:47 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:55:47 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815347.2613153, e6f6d85d-ffa0-4d72-b521-e855afa23a09 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:55:47 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] VM Started (Lifecycle Event)
Jul 31 14:55:47 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:55:47 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:55:47 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:55:47 user nova-compute[72239]: INFO nova.compute.manager [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Took 5.03 seconds to spawn the instance on the hypervisor.
Jul 31 14:55:47 user nova-compute[72239]: DEBUG nova.compute.manager [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:55:47 user nova-compute[72239]: DEBUG nova.compute.manager [req-5ff801ba-88e3-4fdf-b454-ba1c4083a79a req-7a78bd3f-6bc0-4df5-be47-62730949b1e2 service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Received event network-vif-plugged-5c7f836e-274b-4a20-915a-d28d7e70d2a3 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:55:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5ff801ba-88e3-4fdf-b454-ba1c4083a79a req-7a78bd3f-6bc0-4df5-be47-62730949b1e2 service nova] Acquiring lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:55:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5ff801ba-88e3-4fdf-b454-ba1c4083a79a req-7a78bd3f-6bc0-4df5-be47-62730949b1e2 service nova] Lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:55:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5ff801ba-88e3-4fdf-b454-ba1c4083a79a req-7a78bd3f-6bc0-4df5-be47-62730949b1e2 service nova] Lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:55:47 user nova-compute[72239]: DEBUG nova.compute.manager [req-5ff801ba-88e3-4fdf-b454-ba1c4083a79a req-7a78bd3f-6bc0-4df5-be47-62730949b1e2 service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] No waiting events found dispatching network-vif-plugged-5c7f836e-274b-4a20-915a-d28d7e70d2a3 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:55:47 user nova-compute[72239]: WARNING nova.compute.manager [req-5ff801ba-88e3-4fdf-b454-ba1c4083a79a req-7a78bd3f-6bc0-4df5-be47-62730949b1e2 service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Received unexpected event network-vif-plugged-5c7f836e-274b-4a20-915a-d28d7e70d2a3 for instance with vm_state building and task_state spawning.
Jul 31 14:55:47 user nova-compute[72239]: INFO nova.compute.manager [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Took 19.24 seconds to build instance.
Jul 31 14:55:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6e4593ef-a854-47a1-94db-726a2f30a187 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.390s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 -F raw /opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/disk" returned: 0 in 2.139s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Ensure instance console log exists: /opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Start _get_guest_xml network_info=[{"id": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "address": "fa:16:3e:5e:e5:b2", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b01e63-20", "ovs_interfaceid": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='6a56642109839d7e065226eb9cc6d849',container_format='bare',created_at=2023-07-31T14:53:42Z,direct_url=<?>,disk_format='qcow2',id=e9ca2aa9-f324-4640-9fe3-c8839494aed1,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-236697822-shelved',owner='5a6715a7ff38401d844b620cb8d8769e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-31T14:53:46Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': 'f29137ce-a6a7-4420-a1f4-2e77e4560e06', 'device_type': 'disk', 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lVoGimpb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '14653984-6c32-4ddd-bc0b-203a670c2b4e', 'attached_at': '', 'detached_at': '', 'volume_id': 'b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd', 'serial': 'b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd'}, 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:55:48 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:55:48 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:55:48 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='6a56642109839d7e065226eb9cc6d849',container_format='bare',created_at=2023-07-31T14:53:42Z,direct_url=<?>,disk_format='qcow2',id=e9ca2aa9-f324-4640-9fe3-c8839494aed1,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-236697822-shelved',owner='5a6715a7ff38401d844b620cb8d8769e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-31T14:53:46Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG nova.objects.instance [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lazy-loading 'vcpu_model' on Instance uuid 14653984-6c32-4ddd-bc0b-203a670c2b4e {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lVoGimpb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:55:48 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:55:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:55:48 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:55:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:55:48 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 14:55:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee33ee5-c733-4b1e-a6ae-e4f848f6b024]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 14:55:48 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60980b6-dd6a-482e-9f71-ffecf6a3a61a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd] added
Jul 31 14:55:48 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbea54e2-c76c-442b-a060-aeba5297522b]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7da1b3b8-00a9-4011-a2d4-aa1f0ed0fa37]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lVoGimpb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lVoGimpb" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d37d530-e626-41b8-91ab-394d69f4d212]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lVoGimpb'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ef1c774-d0eb-4f9e-954b-ad8a24aac829]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6b8a63-90a6-4d83-b303-4d4ba0dda972]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:55:48 user nova-compute[72239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)
Jul 31 14:55:48 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:55:48 user nova-compute[72239]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)
Jul 31 14:55:48 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 14:55:48 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:55:48 user nova-compute[72239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)
Jul 31 14:55:48 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:55:48 user nova-compute[72239]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)
Jul 31 14:55:48 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 14:55:48 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eeed052-864e-4c29-b1bb-675be2fb9965]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd, portal: 172.16.0.220,3260]
Jul 31 14:55:48 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd, portal: 172.16.0.220,3260] successful.
Jul 31 14:55:48 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fff2141-2688-4ed6-820e-82391fb71c98]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c02c1e-34de-4b1c-badf-e858fe9e5684]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:55:48 user nova-compute[72239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)
Jul 31 14:55:48 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:55:48 user nova-compute[72239]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)
Jul 31 14:55:48 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 14:55:48 user nova-compute[72239]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd (non-flash)
Jul 31 14:55:48 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:55:48 user nova-compute[72239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)
Jul 31 14:55:48 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:55:48 user nova-compute[72239]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)
Jul 31 14:55:48 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 14:55:48 user nova-compute[72239]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd (non-flash)
Jul 31 14:55:48 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] HCTL ('37', '-', '-', 0) found on session 33 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9abc5e-e871-467a-9969-b61b46c3c61f]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Searching for a device in session 33 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:55:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lVoGimpb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 14:55:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:55:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23232343837633738', 'path': '/dev/sdf'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:55:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232343837633738', 'path': '/dev/sdf'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 14:55:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T14:51:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-236697822',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-236697822',id=20,image_ref='e9ca2aa9-f324-4640-9fe3-c8839494aed1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1016500460',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:51:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5a6715a7ff38401d844b620cb8d8769e',ramdisk_id='',reservation_id='r-m9hzvwfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-599528407',owner_user_name='tempest-AttachVolumeShelveTestJSON-599528407-project-member',shelved_at='2023-07-31T14:53:45.991835',shelved_host='user',shelved_image_id='e9ca2aa9-f324-4640-9fe3-c8839494aed1'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:55:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70c6001a7ac5434fbc5ac7d003edd4eb',uuid=14653984-6c32-4ddd-bc0b-203a670c2b4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "address": "fa:16:3e:5e:e5:b2", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b01e63-20", "ovs_interfaceid": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:55:49 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Converting VIF {"id": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "address": "fa:16:3e:5e:e5:b2", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b01e63-20", "ovs_interfaceid": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:55:49 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:e5:b2,bridge_name='br-int',has_traffic_filtering=True,id=b1b01e63-209d-4388-a81d-eb17afdf0db4,network=Network(37a946a3-d20a-4694-8647-73e84d2b0cb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1b01e63-20') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:55:49 user nova-compute[72239]: DEBUG nova.objects.instance [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lazy-loading 'pci_devices' on Instance uuid 14653984-6c32-4ddd-bc0b-203a670c2b4e {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:55:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:55:49 user nova-compute[72239]:   <uuid>14653984-6c32-4ddd-bc0b-203a670c2b4e</uuid>
Jul 31 14:55:49 user nova-compute[72239]:   <name>instance-00000014</name>
Jul 31 14:55:49 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:55:49 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:55:49 user nova-compute[72239]:   <metadata>
Jul 31 14:55:49 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:55:49 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:55:49 user nova-compute[72239]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-236697822</nova:name>
Jul 31 14:55:49 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:55:48</nova:creationTime>
Jul 31 14:55:49 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:55:49 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:55:49 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:55:49 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:55:49 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:55:49 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:55:49 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:55:49 user nova-compute[72239]:       <nova:owner>
Jul 31 14:55:49 user nova-compute[72239]:         <nova:user uuid="70c6001a7ac5434fbc5ac7d003edd4eb">tempest-AttachVolumeShelveTestJSON-599528407-project-member</nova:user>
Jul 31 14:55:49 user nova-compute[72239]:         <nova:project uuid="5a6715a7ff38401d844b620cb8d8769e">tempest-AttachVolumeShelveTestJSON-599528407</nova:project>
Jul 31 14:55:49 user nova-compute[72239]:       </nova:owner>
Jul 31 14:55:49 user nova-compute[72239]:       <nova:root type="image" uuid="e9ca2aa9-f324-4640-9fe3-c8839494aed1"/>
Jul 31 14:55:49 user nova-compute[72239]:       <nova:ports>
Jul 31 14:55:49 user nova-compute[72239]:         <nova:port uuid="b1b01e63-209d-4388-a81d-eb17afdf0db4">
Jul 31 14:55:49 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 31 14:55:49 user nova-compute[72239]:         </nova:port>
Jul 31 14:55:49 user nova-compute[72239]:       </nova:ports>
Jul 31 14:55:49 user nova-compute[72239]:     </nova:instance>
Jul 31 14:55:49 user nova-compute[72239]:   </metadata>
Jul 31 14:55:49 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:55:49 user nova-compute[72239]:     <system>
Jul 31 14:55:49 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:55:49 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:55:49 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:55:49 user nova-compute[72239]:       <entry name="serial">14653984-6c32-4ddd-bc0b-203a670c2b4e</entry>
Jul 31 14:55:49 user nova-compute[72239]:       <entry name="uuid">14653984-6c32-4ddd-bc0b-203a670c2b4e</entry>
Jul 31 14:55:49 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:55:49 user nova-compute[72239]:     </system>
Jul 31 14:55:49 user nova-compute[72239]:   </sysinfo>
Jul 31 14:55:49 user nova-compute[72239]:   <os>
Jul 31 14:55:49 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:55:49 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:55:49 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:55:49 user nova-compute[72239]:   </os>
Jul 31 14:55:49 user nova-compute[72239]:   <features>
Jul 31 14:55:49 user nova-compute[72239]:     <acpi/>
Jul 31 14:55:49 user nova-compute[72239]:     <apic/>
Jul 31 14:55:49 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:55:49 user nova-compute[72239]:   </features>
Jul 31 14:55:49 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:55:49 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:55:49 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:55:49 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:55:49 user nova-compute[72239]:   </clock>
Jul 31 14:55:49 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:55:49 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:55:49 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:55:49 user nova-compute[72239]:   </cpu>
Jul 31 14:55:49 user nova-compute[72239]:   <devices>
Jul 31 14:55:49 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:55:49 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:55:49 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/disk"/>
Jul 31 14:55:49 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:55:49 user nova-compute[72239]:     </disk>
Jul 31 14:55:49 user nova-compute[72239]:     <disk type="block" device="disk">
Jul 31 14:55:49 user nova-compute[72239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:55:49 user nova-compute[72239]:       <source dev="/dev/sdf"/>
Jul 31 14:55:49 user nova-compute[72239]:       <target dev="vdc" bus="virtio"/>
Jul 31 14:55:49 user nova-compute[72239]:       <serial>b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd</serial>
Jul 31 14:55:49 user nova-compute[72239]:     </disk>
Jul 31 14:55:49 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:55:49 user nova-compute[72239]:       <mac address="fa:16:3e:5e:e5:b2"/>
Jul 31 14:55:49 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:55:49 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:55:49 user nova-compute[72239]:       <target dev="tapb1b01e63-20"/>
Jul 31 14:55:49 user nova-compute[72239]:     </interface>
Jul 31 14:55:49 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:55:49 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/console.log" append="off"/>
Jul 31 14:55:49 user nova-compute[72239]:     </serial>
Jul 31 14:55:49 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:55:49 user nova-compute[72239]:     <video>
Jul 31 14:55:49 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:55:49 user nova-compute[72239]:     </video>
Jul 31 14:55:49 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:55:49 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:55:49 user nova-compute[72239]:     </rng>
Jul 31 14:55:49 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:55:49 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:55:49 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:55:49 user nova-compute[72239]:     </memballoon>
Jul 31 14:55:49 user nova-compute[72239]:   </devices>
Jul 31 14:55:49 user nova-compute[72239]: </domain>
Jul 31 14:55:49 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:55:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T14:51:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-236697822',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-236697822',id=20,image_ref='e9ca2aa9-f324-4640-9fe3-c8839494aed1',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1016500460',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:51:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5a6715a7ff38401d844b620cb8d8769e',ramdisk_id='',reservation_id='r-m9hzvwfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-599528407',owner_user_name='tempest-AttachVolumeShelveTestJSON-599528407-project-member',shelved_at='2023-07-31T14:53:45.991835',shelved_host='user',shelved_image_id='e9ca2aa9-f324-4640-9fe3-c8839494aed1'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:55:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70c6001a7ac5434fbc5ac7d003edd4eb',uuid=14653984-6c32-4ddd-bc0b-203a670c2b4e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "address": "fa:16:3e:5e:e5:b2", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b01e63-20", "ovs_interfaceid": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:55:49 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Converting VIF {"id": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "address": "fa:16:3e:5e:e5:b2", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b01e63-20", "ovs_interfaceid": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:55:49 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:e5:b2,bridge_name='br-int',has_traffic_filtering=True,id=b1b01e63-209d-4388-a81d-eb17afdf0db4,network=Network(37a946a3-d20a-4694-8647-73e84d2b0cb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1b01e63-20') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:55:49 user nova-compute[72239]: DEBUG os_vif [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:e5:b2,bridge_name='br-int',has_traffic_filtering=True,id=b1b01e63-209d-4388-a81d-eb17afdf0db4,network=Network(37a946a3-d20a-4694-8647-73e84d2b0cb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1b01e63-20') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:55:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:55:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:55:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb1b01e63-20, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:55:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb1b01e63-20, col_values=(('external_ids', {'iface-id': 'b1b01e63-209d-4388-a81d-eb17afdf0db4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:e5:b2', 'vm-uuid': '14653984-6c32-4ddd-bc0b-203a670c2b4e'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:55:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:55:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:49 user nova-compute[72239]: INFO os_vif [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:e5:b2,bridge_name='br-int',has_traffic_filtering=True,id=b1b01e63-209d-4388-a81d-eb17afdf0db4,network=Network(37a946a3-d20a-4694-8647-73e84d2b0cb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1b01e63-20')
Jul 31 14:55:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:55:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:55:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] No VIF found with MAC fa:16:3e:5e:e5:b2, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:55:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:51 user nova-compute[72239]: DEBUG nova.compute.manager [req-aeac7916-ed96-41b3-8d0f-b51cbd606b4c req-a0f36474-7a1c-4873-8c8a-62846bfcb21c service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Received event network-vif-plugged-b1b01e63-209d-4388-a81d-eb17afdf0db4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:55:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-aeac7916-ed96-41b3-8d0f-b51cbd606b4c req-a0f36474-7a1c-4873-8c8a-62846bfcb21c service nova] Acquiring lock "14653984-6c32-4ddd-bc0b-203a670c2b4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:55:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-aeac7916-ed96-41b3-8d0f-b51cbd606b4c req-a0f36474-7a1c-4873-8c8a-62846bfcb21c service nova] Lock "14653984-6c32-4ddd-bc0b-203a670c2b4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:55:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-aeac7916-ed96-41b3-8d0f-b51cbd606b4c req-a0f36474-7a1c-4873-8c8a-62846bfcb21c service nova] Lock "14653984-6c32-4ddd-bc0b-203a670c2b4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:55:51 user nova-compute[72239]: DEBUG nova.compute.manager [req-aeac7916-ed96-41b3-8d0f-b51cbd606b4c req-a0f36474-7a1c-4873-8c8a-62846bfcb21c service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] No waiting events found dispatching network-vif-plugged-b1b01e63-209d-4388-a81d-eb17afdf0db4 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:55:51 user nova-compute[72239]: WARNING nova.compute.manager [req-aeac7916-ed96-41b3-8d0f-b51cbd606b4c req-a0f36474-7a1c-4873-8c8a-62846bfcb21c service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Received unexpected event network-vif-plugged-b1b01e63-209d-4388-a81d-eb17afdf0db4 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 31 14:55:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:53 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815353.6208885, 14653984-6c32-4ddd-bc0b-203a670c2b4e => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:55:53 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] VM Resumed (Lifecycle Event)
Jul 31 14:55:53 user nova-compute[72239]: DEBUG nova.compute.manager [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:55:53 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 14:55:53 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Instance spawned successfully.
Jul 31 14:55:53 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:55:53 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:55:53 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:55:53 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815353.6221085, 14653984-6c32-4ddd-bc0b-203a670c2b4e => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:55:53 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] VM Started (Lifecycle Event)
Jul 31 14:55:53 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:55:53 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:55:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c86a7c2f-1245-4ac7-9782-db57b14597d7 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:55:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c86a7c2f-1245-4ac7-9782-db57b14597d7 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:55:53 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:55:53 user nova-compute[72239]: INFO nova.compute.manager [None req-c86a7c2f-1245-4ac7-9782-db57b14597d7 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Detaching volume dc2112e3-a3ce-416f-ab29-be87255daa36
Jul 31 14:55:53 user nova-compute[72239]: DEBUG nova.compute.manager [req-b0fc87d0-3ed0-457e-a9eb-a517b06ec196 req-ff69fb63-b297-47f9-aa72-22f3d6bffd20 service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Received event network-vif-plugged-b1b01e63-209d-4388-a81d-eb17afdf0db4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:55:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b0fc87d0-3ed0-457e-a9eb-a517b06ec196 req-ff69fb63-b297-47f9-aa72-22f3d6bffd20 service nova] Acquiring lock "14653984-6c32-4ddd-bc0b-203a670c2b4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:55:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b0fc87d0-3ed0-457e-a9eb-a517b06ec196 req-ff69fb63-b297-47f9-aa72-22f3d6bffd20 service nova] Lock "14653984-6c32-4ddd-bc0b-203a670c2b4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:55:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b0fc87d0-3ed0-457e-a9eb-a517b06ec196 req-ff69fb63-b297-47f9-aa72-22f3d6bffd20 service nova] Lock "14653984-6c32-4ddd-bc0b-203a670c2b4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:55:53 user nova-compute[72239]: DEBUG nova.compute.manager [req-b0fc87d0-3ed0-457e-a9eb-a517b06ec196 req-ff69fb63-b297-47f9-aa72-22f3d6bffd20 service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] No waiting events found dispatching network-vif-plugged-b1b01e63-209d-4388-a81d-eb17afdf0db4 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:55:53 user nova-compute[72239]: WARNING nova.compute.manager [req-b0fc87d0-3ed0-457e-a9eb-a517b06ec196 req-ff69fb63-b297-47f9-aa72-22f3d6bffd20 service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Received unexpected event network-vif-plugged-b1b01e63-209d-4388-a81d-eb17afdf0db4 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 31 14:55:53 user nova-compute[72239]: INFO nova.virt.block_device [None req-c86a7c2f-1245-4ac7-9782-db57b14597d7 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Attempting to driver detach volume dc2112e3-a3ce-416f-ab29-be87255daa36 from mountpoint /dev/vdb
Jul 31 14:55:53 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-c86a7c2f-1245-4ac7-9782-db57b14597d7 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Attempting to detach device vdb from instance c10918e9-9731-48ea-860e-8a02cb6a0ad9 from the persistent domain config. {{(pid=72239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 14:55:53 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-c86a7c2f-1245-4ac7-9782-db57b14597d7 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 14:55:53 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:55:53 user nova-compute[72239]:   <source dev="/dev/sdc"/>
Jul 31 14:55:53 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:55:53 user nova-compute[72239]:   <serial>dc2112e3-a3ce-416f-ab29-be87255daa36</serial>
Jul 31 14:55:53 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 31 14:55:53 user nova-compute[72239]: </disk>
Jul 31 14:55:53 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 14:55:53 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-c86a7c2f-1245-4ac7-9782-db57b14597d7 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Successfully detached device vdb from instance c10918e9-9731-48ea-860e-8a02cb6a0ad9 from the persistent domain config.
Jul 31 14:55:53 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-c86a7c2f-1245-4ac7-9782-db57b14597d7 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c10918e9-9731-48ea-860e-8a02cb6a0ad9 from the live domain config. {{(pid=72239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 14:55:53 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-c86a7c2f-1245-4ac7-9782-db57b14597d7 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 14:55:53 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:55:53 user nova-compute[72239]:   <source dev="/dev/sdc"/>
Jul 31 14:55:53 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:55:53 user nova-compute[72239]:   <serial>dc2112e3-a3ce-416f-ab29-be87255daa36</serial>
Jul 31 14:55:53 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 31 14:55:53 user nova-compute[72239]: </disk>
Jul 31 14:55:53 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 14:55:53 user nova-compute[72239]: DEBUG nova.compute.manager [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-24e02d00-6c48-4187-9fee-27442f89a09b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "14653984-6c32-4ddd-bc0b-203a670c2b4e" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 19.992s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Received event <DeviceRemovedEvent: 1690815354.3468983, c10918e9-9731-48ea-860e-8a02cb6a0ad9 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72239) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-c86a7c2f-1245-4ac7-9782-db57b14597d7 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c10918e9-9731-48ea-860e-8a02cb6a0ad9 {{(pid=72239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 14:55:54 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-c86a7c2f-1245-4ac7-9782-db57b14597d7 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Successfully detached device vdb from instance c10918e9-9731-48ea-860e-8a02cb6a0ad9 from the live domain config.
Jul 31 14:55:54 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c86a7c2f-1245-4ac7-9782-db57b14597d7 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86a7c2f-1245-4ac7-9782-db57b14597d7 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NWHqjgwZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:55:54 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-c86a7c2f-1245-4ac7-9782-db57b14597d7 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:55:54 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-c86a7c2f-1245-4ac7-9782-db57b14597d7 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-c86a7c2f-1245-4ac7-9782-db57b14597d7 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86a7c2f-1245-4ac7-9782-db57b14597d7 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[05037107-d68d-484a-b513-5a1663c57413]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c766ccd-8a87-4d6c-8646-489536afc602]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86a7c2f-1245-4ac7-9782-db57b14597d7 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:55:54 user nova-compute[72239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)
Jul 31 14:55:54 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:55:54 user nova-compute[72239]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)
Jul 31 14:55:54 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 14:55:54 user nova-compute[72239]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd (non-flash)
Jul 31 14:55:54 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86a7c2f-1245-4ac7-9782-db57b14597d7 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:55:54 user nova-compute[72239]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 (non-flash)
Jul 31 14:55:54 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:55:54 user nova-compute[72239]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)
Jul 31 14:55:54 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 14:55:54 user nova-compute[72239]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd (non-flash)
Jul 31 14:55:54 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86a7c2f-1245-4ac7-9782-db57b14597d7 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f412057b6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36'): ({'sdc'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-c86a7c2f-1245-4ac7-9782-db57b14597d7 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Removing single pathed devices sdc {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d39fd4-c25f-4f59-93d8-520a184e9372]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f203b38-c88b-40d2-a146-e4fdefcdab3e]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-c86a7c2f-1245-4ac7-9782-db57b14597d7 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Flushing IO for device /dev/sdc {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab62b561-bdf9-41e0-ac8f-7c765043df5d]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-c86a7c2f-1245-4ac7-9782-db57b14597d7 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.048s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fb93b5-146d-4657-aa33-d11f7e584a0c]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-c86a7c2f-1245-4ac7-9782-db57b14597d7 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-c86a7c2f-1245-4ac7-9782-db57b14597d7 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] SCSI volumes sdc have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86a7c2f-1245-4ac7-9782-db57b14597d7 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09b9e92-c9ba-4722-832f-a782025ff0cb]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86a7c2f-1245-4ac7-9782-db57b14597d7 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49561bf-3cdd-4444-8488-d973b9f0711d]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86a7c2f-1245-4ac7-9782-db57b14597d7 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36, portal: 172.16.0.220,3260]
Jul 31 14:55:54 user nova-compute[72239]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36, portal: 172.16.0.220,3260] successful.
Jul 31 14:55:54 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dc2112e3-a3ce-416f-ab29-be87255daa36 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46e74d4-2617-42e8-8978-4b9f23a17090]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86a7c2f-1245-4ac7-9782-db57b14597d7 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-c86a7c2f-1245-4ac7-9782-db57b14597d7 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c86a7c2f-1245-4ac7-9782-db57b14597d7 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] <== disconnect_volume: return (299ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c86a7c2f-1245-4ac7-9782-db57b14597d7 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 14:55:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:55:55 user nova-compute[72239]: DEBUG nova.objects.instance [None req-c86a7c2f-1245-4ac7-9782-db57b14597d7 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lazy-loading 'flavor' on Instance uuid c10918e9-9731-48ea-860e-8a02cb6a0ad9 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:55:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c86a7c2f-1245-4ac7-9782-db57b14597d7 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.778s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:55:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:56:00 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:56:00 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:56:00 user nova-compute[72239]: DEBUG nova.compute.manager [req-04fbe243-6514-426a-ad8c-dc9f8e4d3731 req-e948d1e0-5aa9-405a-948a-98bab3f57969 service nova] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Received event network-changed-3f2a8e6b-1b4c-4382-a093-865fc8151290 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:56:00 user nova-compute[72239]: DEBUG nova.compute.manager [req-04fbe243-6514-426a-ad8c-dc9f8e4d3731 req-e948d1e0-5aa9-405a-948a-98bab3f57969 service nova] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Refreshing instance network info cache due to event network-changed-3f2a8e6b-1b4c-4382-a093-865fc8151290. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:56:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-04fbe243-6514-426a-ad8c-dc9f8e4d3731 req-e948d1e0-5aa9-405a-948a-98bab3f57969 service nova] Acquiring lock "refresh_cache-7dcd718a-280f-4b0e-b54f-616ee983ad16" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:56:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-04fbe243-6514-426a-ad8c-dc9f8e4d3731 req-e948d1e0-5aa9-405a-948a-98bab3f57969 service nova] Acquired lock "refresh_cache-7dcd718a-280f-4b0e-b54f-616ee983ad16" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:56:00 user nova-compute[72239]: DEBUG nova.network.neutron [req-04fbe243-6514-426a-ad8c-dc9f8e4d3731 req-e948d1e0-5aa9-405a-948a-98bab3f57969 service nova] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Refreshing network info cache for port 3f2a8e6b-1b4c-4382-a093-865fc8151290 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:56:00 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:01 user nova-compute[72239]: DEBUG nova.network.neutron [req-04fbe243-6514-426a-ad8c-dc9f8e4d3731 req-e948d1e0-5aa9-405a-948a-98bab3f57969 service nova] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Updated VIF entry in instance network info cache for port 3f2a8e6b-1b4c-4382-a093-865fc8151290. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:56:01 user nova-compute[72239]: DEBUG nova.network.neutron [req-04fbe243-6514-426a-ad8c-dc9f8e4d3731 req-e948d1e0-5aa9-405a-948a-98bab3f57969 service nova] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Updating instance_info_cache with network_info: [{"id": "3f2a8e6b-1b4c-4382-a093-865fc8151290", "address": "fa:16:3e:fe:06:0d", "network": {"id": "ef3b3133-c6fe-4492-84f9-211f520dd339", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-428761984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0fbc9073ba94f6e93d8491accb42231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2a8e6b-1b", "ovs_interfaceid": "3f2a8e6b-1b4c-4382-a093-865fc8151290", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:56:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-04fbe243-6514-426a-ad8c-dc9f8e4d3731 req-e948d1e0-5aa9-405a-948a-98bab3f57969 service nova] Releasing lock "refresh_cache-7dcd718a-280f-4b0e-b54f-616ee983ad16" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:56:02 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:56:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:05 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:56:05 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:56:07 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:56:07 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:56:07 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 14:56:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-c10918e9-9731-48ea-860e-8a02cb6a0ad9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:56:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-c10918e9-9731-48ea-860e-8a02cb6a0ad9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:56:07 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 14:56:08 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Updating instance_info_cache with network_info: [{"id": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "address": "fa:16:3e:56:1c:d6", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8307e7-0d", "ovs_interfaceid": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:56:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-c10918e9-9731-48ea-860e-8a02cb6a0ad9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:56:08 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 14:56:08 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:56:09 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:56:09 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 14:56:09 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:56:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:56:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:56:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:56:09 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 14:56:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk (vdb) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:56:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:56:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json" returned: 0 in 0.154s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:10 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:56:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Acquiring lock "12c719bf-b770-4e41-b1f4-314eed1180c3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:56:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "12c719bf-b770-4e41-b1f4-314eed1180c3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:56:11 user nova-compute[72239]: DEBUG nova.compute.manager [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 14:56:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:56:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dcd718a-280f-4b0e-b54f-616ee983ad16/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:56:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:56:11 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 14:56:11 user nova-compute[72239]: INFO nova.compute.claims [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Claim successful on node user
Jul 31 14:56:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dcd718a-280f-4b0e-b54f-616ee983ad16/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dcd718a-280f-4b0e-b54f-616ee983ad16/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dcd718a-280f-4b0e-b54f-616ee983ad16/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:12 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:56:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:12 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:56:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.843s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:56:12 user nova-compute[72239]: DEBUG nova.compute.manager [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 14:56:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c2d1cf-ffdb-47a3-b754-57a328947e10/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:12 user nova-compute[72239]: DEBUG nova.compute.manager [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 14:56:12 user nova-compute[72239]: DEBUG nova.network.neutron [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 14:56:12 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 14:56:12 user nova-compute[72239]: DEBUG nova.compute.manager [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 14:56:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c2d1cf-ffdb-47a3-b754-57a328947e10/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c2d1cf-ffdb-47a3-b754-57a328947e10/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:13 user nova-compute[72239]: DEBUG nova.policy [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '946df3f784544702b6b057e66e23a97d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0fbc9073ba94f6e93d8491accb42231', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 14:56:13 user nova-compute[72239]: INFO nova.virt.block_device [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Booting with volume 0fa80825-8675-4494-a7fe-82e943c2e2a9 at /dev/vda
Jul 31 14:56:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91c2d1cf-ffdb-47a3-b754-57a328947e10/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:13 user nova-compute[72239]: DEBUG os_brick.utils [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:56:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87dd3b4b-c511-4784-acf9-ad21534c8337/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[487248bc-a707-4eec-b971-66a095fbbcde]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:56:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.044s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96654fe-4d95-4353-9e2d-b90c71c05497]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:56:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.041s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab4a648-67dd-4daa-912c-19daa4fd71a8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:56:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[712af956-6da3-4c6f-b796-009a1e08bab9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:56:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:56:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 14:56:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87dd3b4b-c511-4784-acf9-ad21534c8337/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87dd3b4b-c511-4784-acf9-ad21534c8337/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:56:13 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 14:56:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b650d609-3228-4d60-bcae-58b712f5ab90]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:56:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 14:56:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 14:56:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 14:56:13 user nova-compute[72239]: DEBUG os_brick.utils [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] <== get_connector_properties: return (257ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:56:13 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Updating existing volume attachment record: 35b81ab4-5e48-4e98-b140-254b12e88701 {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 14:56:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87dd3b4b-c511-4784-acf9-ad21534c8337/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:56:14 user nova-compute[72239]: DEBUG nova.network.neutron [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Successfully created port: b00e3e0f-7501-4350-a065-d15b1d9e760a {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:56:14 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:56:14 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:56:14 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=7159MB free_disk=25.123329162597656GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 14:56:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:56:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:56:14 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 20abf743-de5b-4122-aad0-e2124c7804b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:56:14 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 7d81b881-b44e-4fb3-8245-9dea634bdec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:56:14 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 079a5ed7-ee25-495b-a2a4-924d830a670a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:56:14 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 2f11022e-a007-4d4c-adc1-b54ea59b9e6a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:56:14 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance c10918e9-9731-48ea-860e-8a02cb6a0ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:56:14 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance db15ad45-8f28-4e0c-8d7e-7db75f33fe92 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:56:14 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance c2b3c85b-e939-41d0-8bf0-3a7f650177b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:56:14 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 3559f541-ed61-41b2-9a9d-8b10e18f7375 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:56:14 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 87dd3b4b-c511-4784-acf9-ad21534c8337 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:56:14 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 7dcd718a-280f-4b0e-b54f-616ee983ad16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:56:14 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 91c2d1cf-ffdb-47a3-b754-57a328947e10 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:56:14 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance e6f6d85d-ffa0-4d72-b521-e855afa23a09 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:56:14 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 14653984-6c32-4ddd-bc0b-203a670c2b4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:56:14 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 12c719bf-b770-4e41-b1f4-314eed1180c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:56:14 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 14:56:14 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 14:56:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:14 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:56:14 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:56:14 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 14:56:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.710s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:56:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:15 user nova-compute[72239]: DEBUG nova.network.neutron [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Successfully updated port: b00e3e0f-7501-4350-a065-d15b1d9e760a {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:56:15 user nova-compute[72239]: DEBUG nova.compute.manager [req-f1ef4c4a-7696-4829-8957-a64e80ecf035 req-df3f1e0e-b1b9-4b6b-8014-0dc4ef139cdf service nova] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Received event network-changed-b00e3e0f-7501-4350-a065-d15b1d9e760a {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:56:15 user nova-compute[72239]: DEBUG nova.compute.manager [req-f1ef4c4a-7696-4829-8957-a64e80ecf035 req-df3f1e0e-b1b9-4b6b-8014-0dc4ef139cdf service nova] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Refreshing instance network info cache due to event network-changed-b00e3e0f-7501-4350-a065-d15b1d9e760a. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:56:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-f1ef4c4a-7696-4829-8957-a64e80ecf035 req-df3f1e0e-b1b9-4b6b-8014-0dc4ef139cdf service nova] Acquiring lock "refresh_cache-12c719bf-b770-4e41-b1f4-314eed1180c3" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:56:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-f1ef4c4a-7696-4829-8957-a64e80ecf035 req-df3f1e0e-b1b9-4b6b-8014-0dc4ef139cdf service nova] Acquired lock "refresh_cache-12c719bf-b770-4e41-b1f4-314eed1180c3" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:56:15 user nova-compute[72239]: DEBUG nova.network.neutron [req-f1ef4c4a-7696-4829-8957-a64e80ecf035 req-df3f1e0e-b1b9-4b6b-8014-0dc4ef139cdf service nova] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Refreshing network info cache for port b00e3e0f-7501-4350-a065-d15b1d9e760a {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:56:15 user nova-compute[72239]: DEBUG nova.network.neutron [req-f1ef4c4a-7696-4829-8957-a64e80ecf035 req-df3f1e0e-b1b9-4b6b-8014-0dc4ef139cdf service nova] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:56:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Acquiring lock "refresh_cache-12c719bf-b770-4e41-b1f4-314eed1180c3" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:56:15 user nova-compute[72239]: DEBUG nova.network.neutron [req-f1ef4c4a-7696-4829-8957-a64e80ecf035 req-df3f1e0e-b1b9-4b6b-8014-0dc4ef139cdf service nova] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:56:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-f1ef4c4a-7696-4829-8957-a64e80ecf035 req-df3f1e0e-b1b9-4b6b-8014-0dc4ef139cdf service nova] Releasing lock "refresh_cache-12c719bf-b770-4e41-b1f4-314eed1180c3" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:56:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Acquired lock "refresh_cache-12c719bf-b770-4e41-b1f4-314eed1180c3" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:56:15 user nova-compute[72239]: DEBUG nova.network.neutron [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:56:15 user nova-compute[72239]: DEBUG nova.network.neutron [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:56:15 user nova-compute[72239]: DEBUG nova.network.neutron [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Updating instance_info_cache with network_info: [{"id": "b00e3e0f-7501-4350-a065-d15b1d9e760a", "address": "fa:16:3e:ce:de:f0", "network": {"id": "ef3b3133-c6fe-4492-84f9-211f520dd339", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-428761984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0fbc9073ba94f6e93d8491accb42231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00e3e0f-75", "ovs_interfaceid": "b00e3e0f-7501-4350-a065-d15b1d9e760a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:56:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Releasing lock "refresh_cache-12c719bf-b770-4e41-b1f4-314eed1180c3" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:56:15 user nova-compute[72239]: DEBUG nova.compute.manager [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Instance network_info: |[{"id": "b00e3e0f-7501-4350-a065-d15b1d9e760a", "address": "fa:16:3e:ce:de:f0", "network": {"id": "ef3b3133-c6fe-4492-84f9-211f520dd339", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-428761984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0fbc9073ba94f6e93d8491accb42231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00e3e0f-75", "ovs_interfaceid": "b00e3e0f-7501-4350-a065-d15b1d9e760a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 14:56:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:22 user nova-compute[72239]: DEBUG nova.compute.manager [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 14:56:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 14:56:22 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Creating image(s)
Jul 31 14:56:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Did not create local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 14:56:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Ensure instance console log exists: /opt/stack/data/nova/instances/12c719bf-b770-4e41-b1f4-314eed1180c3/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 14:56:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:56:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:56:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:56:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Start _get_guest_xml network_info=[{"id": "b00e3e0f-7501-4350-a065-d15b1d9e760a", "address": "fa:16:3e:ce:de:f0", "network": {"id": "ef3b3133-c6fe-4492-84f9-211f520dd339", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-428761984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0fbc9073ba94f6e93d8491accb42231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00e3e0f-75", "ovs_interfaceid": "b00e3e0f-7501-4350-a065-d15b1d9e760a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '35b81ab4-5e48-4e98-b140-254b12e88701', 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BsxrcqOj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '12c719bf-b770-4e41-b1f4-314eed1180c3', 'attached_at': '', 'detached_at': '', 'volume_id': '0fa80825-8675-4494-a7fe-82e943c2e2a9', 'serial': '0fa80825-8675-4494-a7fe-82e943c2e2a9'}, 'delete_on_termination': True, 'guest_format': None, 'volume_type': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:56:22 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:56:22 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:56:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:56:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:56:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:56:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:56:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:56:22 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:56:22 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:56:22 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:56:22 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:56:22 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:56:22 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:56:22 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:56:22 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:56:22 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:56:22 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:56:22 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:56:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 14:56:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BsxrcqOj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:56:22 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:56:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:56:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.241s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:56:23 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:56:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:56:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:56:23 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 14:56:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260" returned: 21 in 1.074s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[388e0037-a3d3-474e-a569-984751f95736]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 14:56:24 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b162b049-7941-4afb-ba87-2a97feb32139]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9] added
Jul 31 14:56:24 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9caebd8b-84a3-4dea-a07e-688f11961e0a]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ac3f11-4035-407b-a4f7-f3b5c9c3bfed]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BsxrcqOj {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BsxrcqOj" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2c7399-f019-465e-be37-5465b4e76c5e]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BsxrcqOj'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7116f661-223f-4b18-8eb2-67147c08f06a]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4bc959-af7b-4a4f-a14b-3b7d08ee2906]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf08475d-c2b0-4ac8-af6b-632850355bae (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:56:24 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:56:24 user nova-compute[72239]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)
Jul 31 14:56:24 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 14:56:24 user nova-compute[72239]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd (non-flash)
Jul 31 14:56:24 user nova-compute[72239]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf08475d-c2b0-4ac8-af6b-632850355bae (non-flash)
Jul 31 14:56:24 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:56:24 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:56:24 user nova-compute[72239]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)
Jul 31 14:56:24 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 14:56:24 user nova-compute[72239]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd (non-flash)
Jul 31 14:56:24 user nova-compute[72239]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf08475d-c2b0-4ac8-af6b-632850355bae (non-flash)
Jul 31 14:56:24 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3737506f-ebf9-4208-a14d-164018e87911]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9, portal: 172.16.0.220,3260]
Jul 31 14:56:24 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9, portal: 172.16.0.220,3260] successful.
Jul 31 14:56:24 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04e592b-b034-497d-aaef-3a1101919c2c]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf68eea-7070-477b-8486-d6fd4603fac1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf08475d-c2b0-4ac8-af6b-632850355bae (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:56:24 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:56:24 user nova-compute[72239]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)
Jul 31 14:56:24 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 14:56:24 user nova-compute[72239]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd (non-flash)
Jul 31 14:56:24 user nova-compute[72239]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf08475d-c2b0-4ac8-af6b-632850355bae (non-flash)
Jul 31 14:56:24 user nova-compute[72239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 (non-flash)
Jul 31 14:56:24 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:56:24 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:56:24 user nova-compute[72239]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)
Jul 31 14:56:24 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 14:56:24 user nova-compute[72239]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd (non-flash)
Jul 31 14:56:24 user nova-compute[72239]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cf08475d-c2b0-4ac8-af6b-632850355bae (non-flash)
Jul 31 14:56:24 user nova-compute[72239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 (non-flash)
Jul 31 14:56:24 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.405s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] HCTL ('38', '-', '-', 0) found on session 35 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.026s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0b726c-83d3-44f7-a1b6-65917973857a]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Searching for a device in session 35 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BsxrcqOj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 14:56:24 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:25 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.452s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:56:25 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] <== connect_volume: return (2693ms) {'type': 'block', 'scsi_wwn': '23764376533323537', 'path': '/dev/sdg'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:56:25 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764376533323537', 'path': '/dev/sdg'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 14:56:25 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1158607357',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1158607357',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOefbRzMHFRHe/taYVNRZdQ1lM3IwZrqbCHgRPaUWK30x1oz/dcn1gnm5m9yHdPFwXBxgCljdwQcUohfGqXNL+C58VJsKHYKFOGAUE4NcwzQ4SM+cFj8p3SAcs0gkt76tw==',key_name='tempest-keypair-1078194837',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0fbc9073ba94f6e93d8491accb42231',ramdisk_id='',reservation_id='r-ovcgrtjz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-339927996',owner_user_name='tempest-ServerActionsV293TestJSON-339927996-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:56:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='946df3f784544702b6b057e66e23a97d',uuid=12c719bf-b770-4e41-b1f4-314eed1180c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b00e3e0f-7501-4350-a065-d15b1d9e760a", "address": "fa:16:3e:ce:de:f0", "network": {"id": "ef3b3133-c6fe-4492-84f9-211f520dd339", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-428761984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0fbc9073ba94f6e93d8491accb42231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00e3e0f-75", "ovs_interfaceid": "b00e3e0f-7501-4350-a065-d15b1d9e760a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:56:25 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Converting VIF {"id": "b00e3e0f-7501-4350-a065-d15b1d9e760a", "address": "fa:16:3e:ce:de:f0", "network": {"id": "ef3b3133-c6fe-4492-84f9-211f520dd339", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-428761984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0fbc9073ba94f6e93d8491accb42231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00e3e0f-75", "ovs_interfaceid": "b00e3e0f-7501-4350-a065-d15b1d9e760a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:56:25 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:de:f0,bridge_name='br-int',has_traffic_filtering=True,id=b00e3e0f-7501-4350-a065-d15b1d9e760a,network=Network(ef3b3133-c6fe-4492-84f9-211f520dd339),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00e3e0f-75') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:56:25 user nova-compute[72239]: DEBUG nova.objects.instance [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lazy-loading 'pci_devices' on Instance uuid 12c719bf-b770-4e41-b1f4-314eed1180c3 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:56:25 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:56:25 user nova-compute[72239]:   <uuid>12c719bf-b770-4e41-b1f4-314eed1180c3</uuid>
Jul 31 14:56:25 user nova-compute[72239]:   <name>instance-0000001d</name>
Jul 31 14:56:25 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:56:25 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:56:25 user nova-compute[72239]:   <metadata>
Jul 31 14:56:25 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:56:25 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:56:25 user nova-compute[72239]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1158607357</nova:name>
Jul 31 14:56:25 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:56:22</nova:creationTime>
Jul 31 14:56:25 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:56:25 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:56:25 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:56:25 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:56:25 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:56:25 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:56:25 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:56:25 user nova-compute[72239]:       <nova:owner>
Jul 31 14:56:25 user nova-compute[72239]:         <nova:user uuid="946df3f784544702b6b057e66e23a97d">tempest-ServerActionsV293TestJSON-339927996-project-member</nova:user>
Jul 31 14:56:25 user nova-compute[72239]:         <nova:project uuid="b0fbc9073ba94f6e93d8491accb42231">tempest-ServerActionsV293TestJSON-339927996</nova:project>
Jul 31 14:56:25 user nova-compute[72239]:       </nova:owner>
Jul 31 14:56:25 user nova-compute[72239]:       <nova:ports>
Jul 31 14:56:25 user nova-compute[72239]:         <nova:port uuid="b00e3e0f-7501-4350-a065-d15b1d9e760a">
Jul 31 14:56:25 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 31 14:56:25 user nova-compute[72239]:         </nova:port>
Jul 31 14:56:25 user nova-compute[72239]:       </nova:ports>
Jul 31 14:56:25 user nova-compute[72239]:     </nova:instance>
Jul 31 14:56:25 user nova-compute[72239]:   </metadata>
Jul 31 14:56:25 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:56:25 user nova-compute[72239]:     <system>
Jul 31 14:56:25 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:56:25 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:56:25 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:56:25 user nova-compute[72239]:       <entry name="serial">12c719bf-b770-4e41-b1f4-314eed1180c3</entry>
Jul 31 14:56:25 user nova-compute[72239]:       <entry name="uuid">12c719bf-b770-4e41-b1f4-314eed1180c3</entry>
Jul 31 14:56:25 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:56:25 user nova-compute[72239]:     </system>
Jul 31 14:56:25 user nova-compute[72239]:   </sysinfo>
Jul 31 14:56:25 user nova-compute[72239]:   <os>
Jul 31 14:56:25 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:56:25 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:56:25 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:56:25 user nova-compute[72239]:   </os>
Jul 31 14:56:25 user nova-compute[72239]:   <features>
Jul 31 14:56:25 user nova-compute[72239]:     <acpi/>
Jul 31 14:56:25 user nova-compute[72239]:     <apic/>
Jul 31 14:56:25 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:56:25 user nova-compute[72239]:   </features>
Jul 31 14:56:25 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:56:25 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:56:25 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:56:25 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:56:25 user nova-compute[72239]:   </clock>
Jul 31 14:56:25 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:56:25 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:56:25 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:56:25 user nova-compute[72239]:   </cpu>
Jul 31 14:56:25 user nova-compute[72239]:   <devices>
Jul 31 14:56:25 user nova-compute[72239]:     <disk type="block" device="disk">
Jul 31 14:56:25 user nova-compute[72239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:56:25 user nova-compute[72239]:       <source dev="/dev/sdg"/>
Jul 31 14:56:25 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:56:25 user nova-compute[72239]:       <serial>0fa80825-8675-4494-a7fe-82e943c2e2a9</serial>
Jul 31 14:56:25 user nova-compute[72239]:     </disk>
Jul 31 14:56:25 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:56:25 user nova-compute[72239]:       <mac address="fa:16:3e:ce:de:f0"/>
Jul 31 14:56:25 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:56:25 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:56:25 user nova-compute[72239]:       <target dev="tapb00e3e0f-75"/>
Jul 31 14:56:25 user nova-compute[72239]:     </interface>
Jul 31 14:56:25 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:56:25 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/12c719bf-b770-4e41-b1f4-314eed1180c3/console.log" append="off"/>
Jul 31 14:56:25 user nova-compute[72239]:     </serial>
Jul 31 14:56:25 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:56:25 user nova-compute[72239]:     <video>
Jul 31 14:56:25 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:56:25 user nova-compute[72239]:     </video>
Jul 31 14:56:25 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:56:25 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:56:25 user nova-compute[72239]:     </rng>
Jul 31 14:56:25 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:56:25 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:56:25 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:56:25 user nova-compute[72239]:     </memballoon>
Jul 31 14:56:25 user nova-compute[72239]:   </devices>
Jul 31 14:56:25 user nova-compute[72239]: </domain>
Jul 31 14:56:25 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:56:25 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1158607357',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1158607357',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOefbRzMHFRHe/taYVNRZdQ1lM3IwZrqbCHgRPaUWK30x1oz/dcn1gnm5m9yHdPFwXBxgCljdwQcUohfGqXNL+C58VJsKHYKFOGAUE4NcwzQ4SM+cFj8p3SAcs0gkt76tw==',key_name='tempest-keypair-1078194837',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b0fbc9073ba94f6e93d8491accb42231',ramdisk_id='',reservation_id='r-ovcgrtjz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-339927996',owner_user_name='tempest-ServerActionsV293TestJSON-339927996-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:56:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='946df3f784544702b6b057e66e23a97d',uuid=12c719bf-b770-4e41-b1f4-314eed1180c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b00e3e0f-7501-4350-a065-d15b1d9e760a", "address": "fa:16:3e:ce:de:f0", "network": {"id": "ef3b3133-c6fe-4492-84f9-211f520dd339", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-428761984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0fbc9073ba94f6e93d8491accb42231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00e3e0f-75", "ovs_interfaceid": "b00e3e0f-7501-4350-a065-d15b1d9e760a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:56:25 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Converting VIF {"id": "b00e3e0f-7501-4350-a065-d15b1d9e760a", "address": "fa:16:3e:ce:de:f0", "network": {"id": "ef3b3133-c6fe-4492-84f9-211f520dd339", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-428761984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0fbc9073ba94f6e93d8491accb42231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00e3e0f-75", "ovs_interfaceid": "b00e3e0f-7501-4350-a065-d15b1d9e760a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:56:25 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:de:f0,bridge_name='br-int',has_traffic_filtering=True,id=b00e3e0f-7501-4350-a065-d15b1d9e760a,network=Network(ef3b3133-c6fe-4492-84f9-211f520dd339),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00e3e0f-75') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:56:25 user nova-compute[72239]: DEBUG os_vif [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:de:f0,bridge_name='br-int',has_traffic_filtering=True,id=b00e3e0f-7501-4350-a065-d15b1d9e760a,network=Network(ef3b3133-c6fe-4492-84f9-211f520dd339),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00e3e0f-75') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:56:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:56:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:56:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb00e3e0f-75, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:56:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb00e3e0f-75, col_values=(('external_ids', {'iface-id': 'b00e3e0f-7501-4350-a065-d15b1d9e760a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:de:f0', 'vm-uuid': '12c719bf-b770-4e41-b1f4-314eed1180c3'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:56:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:56:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:25 user nova-compute[72239]: INFO os_vif [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:de:f0,bridge_name='br-int',has_traffic_filtering=True,id=b00e3e0f-7501-4350-a065-d15b1d9e760a,network=Network(ef3b3133-c6fe-4492-84f9-211f520dd339),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00e3e0f-75')
Jul 31 14:56:25 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:56:25 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] No VIF found with MAC fa:16:3e:ce:de:f0, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:56:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:27 user nova-compute[72239]: DEBUG nova.compute.manager [req-7f3fe7b5-eaa5-4be6-8071-6fc8e48071e1 req-5195a92b-2f65-4e0a-867b-364ae1f0e630 service nova] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Received event network-vif-plugged-b00e3e0f-7501-4350-a065-d15b1d9e760a {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:56:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7f3fe7b5-eaa5-4be6-8071-6fc8e48071e1 req-5195a92b-2f65-4e0a-867b-364ae1f0e630 service nova] Acquiring lock "12c719bf-b770-4e41-b1f4-314eed1180c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:56:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7f3fe7b5-eaa5-4be6-8071-6fc8e48071e1 req-5195a92b-2f65-4e0a-867b-364ae1f0e630 service nova] Lock "12c719bf-b770-4e41-b1f4-314eed1180c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:56:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7f3fe7b5-eaa5-4be6-8071-6fc8e48071e1 req-5195a92b-2f65-4e0a-867b-364ae1f0e630 service nova] Lock "12c719bf-b770-4e41-b1f4-314eed1180c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:56:27 user nova-compute[72239]: DEBUG nova.compute.manager [req-7f3fe7b5-eaa5-4be6-8071-6fc8e48071e1 req-5195a92b-2f65-4e0a-867b-364ae1f0e630 service nova] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] No waiting events found dispatching network-vif-plugged-b00e3e0f-7501-4350-a065-d15b1d9e760a {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:56:27 user nova-compute[72239]: WARNING nova.compute.manager [req-7f3fe7b5-eaa5-4be6-8071-6fc8e48071e1 req-5195a92b-2f65-4e0a-867b-364ae1f0e630 service nova] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Received unexpected event network-vif-plugged-b00e3e0f-7501-4350-a065-d15b1d9e760a for instance with vm_state building and task_state spawning.
Jul 31 14:56:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:29 user nova-compute[72239]: DEBUG nova.compute.manager [req-ed4038c5-c499-4625-91f7-ccdb5f9f25b0 req-577579ac-eaec-44fe-b682-f901c8b788ba service nova] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Received event network-vif-plugged-b00e3e0f-7501-4350-a065-d15b1d9e760a {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:56:29 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ed4038c5-c499-4625-91f7-ccdb5f9f25b0 req-577579ac-eaec-44fe-b682-f901c8b788ba service nova] Acquiring lock "12c719bf-b770-4e41-b1f4-314eed1180c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:56:29 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ed4038c5-c499-4625-91f7-ccdb5f9f25b0 req-577579ac-eaec-44fe-b682-f901c8b788ba service nova] Lock "12c719bf-b770-4e41-b1f4-314eed1180c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:56:29 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ed4038c5-c499-4625-91f7-ccdb5f9f25b0 req-577579ac-eaec-44fe-b682-f901c8b788ba service nova] Lock "12c719bf-b770-4e41-b1f4-314eed1180c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:56:29 user nova-compute[72239]: DEBUG nova.compute.manager [req-ed4038c5-c499-4625-91f7-ccdb5f9f25b0 req-577579ac-eaec-44fe-b682-f901c8b788ba service nova] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] No waiting events found dispatching network-vif-plugged-b00e3e0f-7501-4350-a065-d15b1d9e760a {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:56:29 user nova-compute[72239]: WARNING nova.compute.manager [req-ed4038c5-c499-4625-91f7-ccdb5f9f25b0 req-577579ac-eaec-44fe-b682-f901c8b788ba service nova] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Received unexpected event network-vif-plugged-b00e3e0f-7501-4350-a065-d15b1d9e760a for instance with vm_state building and task_state spawning.
Jul 31 14:56:29 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815389.481424, 12c719bf-b770-4e41-b1f4-314eed1180c3 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:56:29 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] VM Resumed (Lifecycle Event)
Jul 31 14:56:29 user nova-compute[72239]: DEBUG nova.compute.manager [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:56:29 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 14:56:29 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Instance spawned successfully.
Jul 31 14:56:29 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 14:56:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:29 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:56:29 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:56:29 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:56:29 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:56:29 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:56:29 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:56:29 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:56:29 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:56:29 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:56:29 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815389.4832602, 12c719bf-b770-4e41-b1f4-314eed1180c3 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:56:29 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] VM Started (Lifecycle Event)
Jul 31 14:56:29 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:56:29 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:56:29 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:56:29 user nova-compute[72239]: INFO nova.compute.manager [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Took 6.72 seconds to spawn the instance on the hypervisor.
Jul 31 14:56:29 user nova-compute[72239]: DEBUG nova.compute.manager [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:56:29 user nova-compute[72239]: INFO nova.compute.manager [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Took 17.77 seconds to build instance.
Jul 31 14:56:29 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-68ddca03-dfb7-4360-87ef-7ccea0277e60 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "12c719bf-b770-4e41-b1f4-314eed1180c3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.905s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:56:30 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:35 user nova-compute[72239]: INFO nova.compute.manager [None req-c792ade5-e963-4f1f-a2ca-ed3bcb27e1e5 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Unrescuing
Jul 31 14:56:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c792ade5-e963-4f1f-a2ca-ed3bcb27e1e5 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "refresh_cache-3559f541-ed61-41b2-9a9d-8b10e18f7375" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:56:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c792ade5-e963-4f1f-a2ca-ed3bcb27e1e5 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquired lock "refresh_cache-3559f541-ed61-41b2-9a9d-8b10e18f7375" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:56:35 user nova-compute[72239]: DEBUG nova.network.neutron [None req-c792ade5-e963-4f1f-a2ca-ed3bcb27e1e5 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:56:36 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:36 user nova-compute[72239]: DEBUG nova.network.neutron [None req-c792ade5-e963-4f1f-a2ca-ed3bcb27e1e5 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Updating instance_info_cache with network_info: [{"id": "a7009a29-6a23-4d7d-a2ff-046c040e5b73", "address": "fa:16:3e:f5:e4:b4", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7009a29-6a", "ovs_interfaceid": "a7009a29-6a23-4d7d-a2ff-046c040e5b73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:56:36 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c792ade5-e963-4f1f-a2ca-ed3bcb27e1e5 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Releasing lock "refresh_cache-3559f541-ed61-41b2-9a9d-8b10e18f7375" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:56:36 user nova-compute[72239]: DEBUG nova.objects.instance [None req-c792ade5-e963-4f1f-a2ca-ed3bcb27e1e5 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lazy-loading 'flavor' on Instance uuid 3559f541-ed61-41b2-9a9d-8b10e18f7375 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:56:36 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:36 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:36 user nova-compute[72239]: DEBUG nova.compute.manager [req-b436ef52-94a1-42b5-9769-3c0687efa83f req-15f492ad-057b-471d-912b-69f773eb399a service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Received event network-vif-unplugged-a7009a29-6a23-4d7d-a2ff-046c040e5b73 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:56:36 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b436ef52-94a1-42b5-9769-3c0687efa83f req-15f492ad-057b-471d-912b-69f773eb399a service nova] Acquiring lock "3559f541-ed61-41b2-9a9d-8b10e18f7375-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:56:36 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b436ef52-94a1-42b5-9769-3c0687efa83f req-15f492ad-057b-471d-912b-69f773eb399a service nova] Lock "3559f541-ed61-41b2-9a9d-8b10e18f7375-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:56:36 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b436ef52-94a1-42b5-9769-3c0687efa83f req-15f492ad-057b-471d-912b-69f773eb399a service nova] Lock "3559f541-ed61-41b2-9a9d-8b10e18f7375-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:56:36 user nova-compute[72239]: DEBUG nova.compute.manager [req-b436ef52-94a1-42b5-9769-3c0687efa83f req-15f492ad-057b-471d-912b-69f773eb399a service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] No waiting events found dispatching network-vif-unplugged-a7009a29-6a23-4d7d-a2ff-046c040e5b73 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:56:36 user nova-compute[72239]: WARNING nova.compute.manager [req-b436ef52-94a1-42b5-9769-3c0687efa83f req-15f492ad-057b-471d-912b-69f773eb399a service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Received unexpected event network-vif-unplugged-a7009a29-6a23-4d7d-a2ff-046c040e5b73 for instance with vm_state rescued and task_state unrescuing.
Jul 31 14:56:36 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:36 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:37 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Instance destroyed successfully.
Jul 31 14:56:38 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:38 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:38 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:38 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:38 user nova-compute[72239]: DEBUG nova.compute.manager [req-376ecb58-0ce6-4ffb-bbe1-0292fce07b83 req-54a48e5a-30ce-4738-8654-016778291e11 service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Received event network-vif-plugged-a7009a29-6a23-4d7d-a2ff-046c040e5b73 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:56:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-376ecb58-0ce6-4ffb-bbe1-0292fce07b83 req-54a48e5a-30ce-4738-8654-016778291e11 service nova] Acquiring lock "3559f541-ed61-41b2-9a9d-8b10e18f7375-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:56:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-376ecb58-0ce6-4ffb-bbe1-0292fce07b83 req-54a48e5a-30ce-4738-8654-016778291e11 service nova] Lock "3559f541-ed61-41b2-9a9d-8b10e18f7375-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:56:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-376ecb58-0ce6-4ffb-bbe1-0292fce07b83 req-54a48e5a-30ce-4738-8654-016778291e11 service nova] Lock "3559f541-ed61-41b2-9a9d-8b10e18f7375-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:56:38 user nova-compute[72239]: DEBUG nova.compute.manager [req-376ecb58-0ce6-4ffb-bbe1-0292fce07b83 req-54a48e5a-30ce-4738-8654-016778291e11 service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] No waiting events found dispatching network-vif-plugged-a7009a29-6a23-4d7d-a2ff-046c040e5b73 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:56:38 user nova-compute[72239]: WARNING nova.compute.manager [req-376ecb58-0ce6-4ffb-bbe1-0292fce07b83 req-54a48e5a-30ce-4738-8654-016778291e11 service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Received unexpected event network-vif-plugged-a7009a29-6a23-4d7d-a2ff-046c040e5b73 for instance with vm_state rescued and task_state unrescuing.
Jul 31 14:56:38 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:38 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:40 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:40 user nova-compute[72239]: DEBUG nova.compute.manager [None req-c792ade5-e963-4f1f-a2ca-ed3bcb27e1e5 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:56:40 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Removed pending event for 3559f541-ed61-41b2-9a9d-8b10e18f7375 due to event {{(pid=72239) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 14:56:40 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815400.8591511, 3559f541-ed61-41b2-9a9d-8b10e18f7375 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:56:40 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] VM Resumed (Lifecycle Event)
Jul 31 14:56:40 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:56:40 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:56:40 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 31 14:56:40 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815400.8595688, 3559f541-ed61-41b2-9a9d-8b10e18f7375 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:56:40 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] VM Started (Lifecycle Event)
Jul 31 14:56:40 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:56:40 user nova-compute[72239]: DEBUG nova.compute.manager [req-3b9251ff-cea2-4e5b-a47c-e569b21a8fca req-1f977def-4ff9-497c-a16d-4a6dd5d5a06f service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Received event network-vif-plugged-a7009a29-6a23-4d7d-a2ff-046c040e5b73 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:56:40 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-3b9251ff-cea2-4e5b-a47c-e569b21a8fca req-1f977def-4ff9-497c-a16d-4a6dd5d5a06f service nova] Acquiring lock "3559f541-ed61-41b2-9a9d-8b10e18f7375-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:56:40 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-3b9251ff-cea2-4e5b-a47c-e569b21a8fca req-1f977def-4ff9-497c-a16d-4a6dd5d5a06f service nova] Lock "3559f541-ed61-41b2-9a9d-8b10e18f7375-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:56:40 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-3b9251ff-cea2-4e5b-a47c-e569b21a8fca req-1f977def-4ff9-497c-a16d-4a6dd5d5a06f service nova] Lock "3559f541-ed61-41b2-9a9d-8b10e18f7375-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:56:40 user nova-compute[72239]: DEBUG nova.compute.manager [req-3b9251ff-cea2-4e5b-a47c-e569b21a8fca req-1f977def-4ff9-497c-a16d-4a6dd5d5a06f service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] No waiting events found dispatching network-vif-plugged-a7009a29-6a23-4d7d-a2ff-046c040e5b73 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:56:40 user nova-compute[72239]: WARNING nova.compute.manager [req-3b9251ff-cea2-4e5b-a47c-e569b21a8fca req-1f977def-4ff9-497c-a16d-4a6dd5d5a06f service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Received unexpected event network-vif-plugged-a7009a29-6a23-4d7d-a2ff-046c040e5b73 for instance with vm_state rescued and task_state unrescuing.
Jul 31 14:56:40 user nova-compute[72239]: DEBUG nova.compute.manager [req-3b9251ff-cea2-4e5b-a47c-e569b21a8fca req-1f977def-4ff9-497c-a16d-4a6dd5d5a06f service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Received event network-vif-plugged-a7009a29-6a23-4d7d-a2ff-046c040e5b73 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:56:40 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-3b9251ff-cea2-4e5b-a47c-e569b21a8fca req-1f977def-4ff9-497c-a16d-4a6dd5d5a06f service nova] Acquiring lock "3559f541-ed61-41b2-9a9d-8b10e18f7375-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:56:40 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-3b9251ff-cea2-4e5b-a47c-e569b21a8fca req-1f977def-4ff9-497c-a16d-4a6dd5d5a06f service nova] Lock "3559f541-ed61-41b2-9a9d-8b10e18f7375-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:56:40 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-3b9251ff-cea2-4e5b-a47c-e569b21a8fca req-1f977def-4ff9-497c-a16d-4a6dd5d5a06f service nova] Lock "3559f541-ed61-41b2-9a9d-8b10e18f7375-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:56:40 user nova-compute[72239]: DEBUG nova.compute.manager [req-3b9251ff-cea2-4e5b-a47c-e569b21a8fca req-1f977def-4ff9-497c-a16d-4a6dd5d5a06f service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] No waiting events found dispatching network-vif-plugged-a7009a29-6a23-4d7d-a2ff-046c040e5b73 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:56:40 user nova-compute[72239]: WARNING nova.compute.manager [req-3b9251ff-cea2-4e5b-a47c-e569b21a8fca req-1f977def-4ff9-497c-a16d-4a6dd5d5a06f service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Received unexpected event network-vif-plugged-a7009a29-6a23-4d7d-a2ff-046c040e5b73 for instance with vm_state rescued and task_state unrescuing.
Jul 31 14:56:40 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:56:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:49 user nova-compute[72239]: DEBUG nova.compute.manager [req-c60edeec-144c-4f13-ae35-1b78bec1d390 req-963dbb32-5297-45f0-b40f-d2a4aa85797a service nova] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Received event network-changed-3b15bbc2-ce0e-4595-b7c6-543727b06b00 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:56:49 user nova-compute[72239]: DEBUG nova.compute.manager [req-c60edeec-144c-4f13-ae35-1b78bec1d390 req-963dbb32-5297-45f0-b40f-d2a4aa85797a service nova] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Refreshing instance network info cache due to event network-changed-3b15bbc2-ce0e-4595-b7c6-543727b06b00. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:56:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-c60edeec-144c-4f13-ae35-1b78bec1d390 req-963dbb32-5297-45f0-b40f-d2a4aa85797a service nova] Acquiring lock "refresh_cache-91c2d1cf-ffdb-47a3-b754-57a328947e10" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:56:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-c60edeec-144c-4f13-ae35-1b78bec1d390 req-963dbb32-5297-45f0-b40f-d2a4aa85797a service nova] Acquired lock "refresh_cache-91c2d1cf-ffdb-47a3-b754-57a328947e10" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:56:49 user nova-compute[72239]: DEBUG nova.network.neutron [req-c60edeec-144c-4f13-ae35-1b78bec1d390 req-963dbb32-5297-45f0-b40f-d2a4aa85797a service nova] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Refreshing network info cache for port 3b15bbc2-ce0e-4595-b7c6-543727b06b00 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:56:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-674253f5-8458-4be4-aa0e-bf7c7b721494 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "91c2d1cf-ffdb-47a3-b754-57a328947e10" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:56:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-674253f5-8458-4be4-aa0e-bf7c7b721494 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "91c2d1cf-ffdb-47a3-b754-57a328947e10" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:56:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-674253f5-8458-4be4-aa0e-bf7c7b721494 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "91c2d1cf-ffdb-47a3-b754-57a328947e10-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:56:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-674253f5-8458-4be4-aa0e-bf7c7b721494 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "91c2d1cf-ffdb-47a3-b754-57a328947e10-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:56:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-674253f5-8458-4be4-aa0e-bf7c7b721494 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "91c2d1cf-ffdb-47a3-b754-57a328947e10-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:56:49 user nova-compute[72239]: INFO nova.compute.manager [None req-674253f5-8458-4be4-aa0e-bf7c7b721494 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Terminating instance
Jul 31 14:56:49 user nova-compute[72239]: DEBUG nova.compute.manager [None req-674253f5-8458-4be4-aa0e-bf7c7b721494 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 14:56:50 user nova-compute[72239]: DEBUG nova.network.neutron [req-c60edeec-144c-4f13-ae35-1b78bec1d390 req-963dbb32-5297-45f0-b40f-d2a4aa85797a service nova] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Updated VIF entry in instance network info cache for port 3b15bbc2-ce0e-4595-b7c6-543727b06b00. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:56:50 user nova-compute[72239]: DEBUG nova.network.neutron [req-c60edeec-144c-4f13-ae35-1b78bec1d390 req-963dbb32-5297-45f0-b40f-d2a4aa85797a service nova] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Updating instance_info_cache with network_info: [{"id": "3b15bbc2-ce0e-4595-b7c6-543727b06b00", "address": "fa:16:3e:00:f4:01", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.123", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b15bbc2-ce", "ovs_interfaceid": "3b15bbc2-ce0e-4595-b7c6-543727b06b00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:56:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-c60edeec-144c-4f13-ae35-1b78bec1d390 req-963dbb32-5297-45f0-b40f-d2a4aa85797a service nova] Releasing lock "refresh_cache-91c2d1cf-ffdb-47a3-b754-57a328947e10" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:56:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:50 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Instance destroyed successfully.
Jul 31 14:56:50 user nova-compute[72239]: DEBUG nova.objects.instance [None req-674253f5-8458-4be4-aa0e-bf7c7b721494 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lazy-loading 'resources' on Instance uuid 91c2d1cf-ffdb-47a3-b754-57a328947e10 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:56:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-674253f5-8458-4be4-aa0e-bf7c7b721494 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:54:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-48566919',display_name='tempest-AttachVolumeNegativeTest-server-48566919',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-48566919',id=27,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZPvYKsFOXQ+KDy6rhzCiyMIIZb07f11JgBADL//XRqqIqzIx8cOB+TfPwTzYPtpYvqcy7NpwivCE/oj3OgN+KNiWRrr61H0Xw4f72CG1Js19z+ckNRdRZsHSjL9PNEvA==',key_name='tempest-keypair-315615031',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:55:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48e4fe9e81724b9cb6b9d73748f9bdee',ramdisk_id='',reservation_id='r-16i04039',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-620954585',owner_user_name='tempest-AttachVolumeNegativeTest-620954585-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:55:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99f609389e884d5490ba160d9fff28e3',uuid=91c2d1cf-ffdb-47a3-b754-57a328947e10,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b15bbc2-ce0e-4595-b7c6-543727b06b00", "address": "fa:16:3e:00:f4:01", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b15bbc2-ce", "ovs_interfaceid": "3b15bbc2-ce0e-4595-b7c6-543727b06b00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:56:50 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-674253f5-8458-4be4-aa0e-bf7c7b721494 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Converting VIF {"id": "3b15bbc2-ce0e-4595-b7c6-543727b06b00", "address": "fa:16:3e:00:f4:01", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b15bbc2-ce", "ovs_interfaceid": "3b15bbc2-ce0e-4595-b7c6-543727b06b00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:56:50 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-674253f5-8458-4be4-aa0e-bf7c7b721494 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:00:f4:01,bridge_name='br-int',has_traffic_filtering=True,id=3b15bbc2-ce0e-4595-b7c6-543727b06b00,network=Network(f83cfb34-b1ca-4a7c-9a36-3654372585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b15bbc2-ce') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:56:50 user nova-compute[72239]: DEBUG os_vif [None req-674253f5-8458-4be4-aa0e-bf7c7b721494 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:f4:01,bridge_name='br-int',has_traffic_filtering=True,id=3b15bbc2-ce0e-4595-b7c6-543727b06b00,network=Network(f83cfb34-b1ca-4a7c-9a36-3654372585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b15bbc2-ce') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:56:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b15bbc2-ce, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:56:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:56:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:50 user nova-compute[72239]: INFO os_vif [None req-674253f5-8458-4be4-aa0e-bf7c7b721494 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:00:f4:01,bridge_name='br-int',has_traffic_filtering=True,id=3b15bbc2-ce0e-4595-b7c6-543727b06b00,network=Network(f83cfb34-b1ca-4a7c-9a36-3654372585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b15bbc2-ce')
Jul 31 14:56:50 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-674253f5-8458-4be4-aa0e-bf7c7b721494 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Deleting instance files /opt/stack/data/nova/instances/91c2d1cf-ffdb-47a3-b754-57a328947e10_del
Jul 31 14:56:50 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-674253f5-8458-4be4-aa0e-bf7c7b721494 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Deletion of /opt/stack/data/nova/instances/91c2d1cf-ffdb-47a3-b754-57a328947e10_del complete
Jul 31 14:56:50 user nova-compute[72239]: INFO nova.compute.manager [None req-674253f5-8458-4be4-aa0e-bf7c7b721494 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Took 0.91 seconds to destroy the instance on the hypervisor.
Jul 31 14:56:50 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-674253f5-8458-4be4-aa0e-bf7c7b721494 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 14:56:50 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 14:56:50 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 14:56:51 user nova-compute[72239]: DEBUG nova.compute.manager [req-333124c5-e997-4e97-97c7-116b8400f01a req-2c5f6789-3533-45dd-8a73-f8f9925edf99 service nova] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Received event network-vif-unplugged-3b15bbc2-ce0e-4595-b7c6-543727b06b00 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:56:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-333124c5-e997-4e97-97c7-116b8400f01a req-2c5f6789-3533-45dd-8a73-f8f9925edf99 service nova] Acquiring lock "91c2d1cf-ffdb-47a3-b754-57a328947e10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:56:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-333124c5-e997-4e97-97c7-116b8400f01a req-2c5f6789-3533-45dd-8a73-f8f9925edf99 service nova] Lock "91c2d1cf-ffdb-47a3-b754-57a328947e10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:56:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-333124c5-e997-4e97-97c7-116b8400f01a req-2c5f6789-3533-45dd-8a73-f8f9925edf99 service nova] Lock "91c2d1cf-ffdb-47a3-b754-57a328947e10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:56:51 user nova-compute[72239]: DEBUG nova.compute.manager [req-333124c5-e997-4e97-97c7-116b8400f01a req-2c5f6789-3533-45dd-8a73-f8f9925edf99 service nova] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] No waiting events found dispatching network-vif-unplugged-3b15bbc2-ce0e-4595-b7c6-543727b06b00 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:56:51 user nova-compute[72239]: DEBUG nova.compute.manager [req-333124c5-e997-4e97-97c7-116b8400f01a req-2c5f6789-3533-45dd-8a73-f8f9925edf99 service nova] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Received event network-vif-unplugged-3b15bbc2-ce0e-4595-b7c6-543727b06b00 for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 14:56:51 user nova-compute[72239]: DEBUG nova.compute.manager [req-333124c5-e997-4e97-97c7-116b8400f01a req-2c5f6789-3533-45dd-8a73-f8f9925edf99 service nova] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Received event network-vif-plugged-3b15bbc2-ce0e-4595-b7c6-543727b06b00 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:56:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-333124c5-e997-4e97-97c7-116b8400f01a req-2c5f6789-3533-45dd-8a73-f8f9925edf99 service nova] Acquiring lock "91c2d1cf-ffdb-47a3-b754-57a328947e10-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:56:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-333124c5-e997-4e97-97c7-116b8400f01a req-2c5f6789-3533-45dd-8a73-f8f9925edf99 service nova] Lock "91c2d1cf-ffdb-47a3-b754-57a328947e10-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:56:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-333124c5-e997-4e97-97c7-116b8400f01a req-2c5f6789-3533-45dd-8a73-f8f9925edf99 service nova] Lock "91c2d1cf-ffdb-47a3-b754-57a328947e10-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:56:51 user nova-compute[72239]: DEBUG nova.compute.manager [req-333124c5-e997-4e97-97c7-116b8400f01a req-2c5f6789-3533-45dd-8a73-f8f9925edf99 service nova] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] No waiting events found dispatching network-vif-plugged-3b15bbc2-ce0e-4595-b7c6-543727b06b00 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:56:51 user nova-compute[72239]: WARNING nova.compute.manager [req-333124c5-e997-4e97-97c7-116b8400f01a req-2c5f6789-3533-45dd-8a73-f8f9925edf99 service nova] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Received unexpected event network-vif-plugged-3b15bbc2-ce0e-4595-b7c6-543727b06b00 for instance with vm_state active and task_state deleting.
Jul 31 14:56:52 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:56:52 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Took 1.24 seconds to deallocate network for instance.
Jul 31 14:56:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-674253f5-8458-4be4-aa0e-bf7c7b721494 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:56:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-674253f5-8458-4be4-aa0e-bf7c7b721494 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:56:52 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-674253f5-8458-4be4-aa0e-bf7c7b721494 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:56:52 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-674253f5-8458-4be4-aa0e-bf7c7b721494 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:56:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-674253f5-8458-4be4-aa0e-bf7c7b721494 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.475s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:56:52 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-674253f5-8458-4be4-aa0e-bf7c7b721494 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Deleted allocations for instance 91c2d1cf-ffdb-47a3-b754-57a328947e10
Jul 31 14:56:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-674253f5-8458-4be4-aa0e-bf7c7b721494 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "91c2d1cf-ffdb-47a3-b754-57a328947e10" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.829s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:56:53 user nova-compute[72239]: DEBUG nova.compute.manager [req-391d0e67-67a4-45eb-90c1-e66999990110 req-2bace2fa-a88e-458a-89b6-4506675cb4f3 service nova] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Received event network-vif-deleted-3b15bbc2-ce0e-4595-b7c6-543727b06b00 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:56:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:55 user nova-compute[72239]: DEBUG nova.objects.instance [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lazy-loading 'flavor' on Instance uuid db15ad45-8f28-4e0c-8d7e-7db75f33fe92 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:56:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "refresh_cache-db15ad45-8f28-4e0c-8d7e-7db75f33fe92" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:56:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquired lock "refresh_cache-db15ad45-8f28-4e0c-8d7e-7db75f33fe92" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:56:55 user nova-compute[72239]: DEBUG nova.network.neutron [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:56:55 user nova-compute[72239]: DEBUG nova.objects.instance [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lazy-loading 'info_cache' on Instance uuid db15ad45-8f28-4e0c-8d7e-7db75f33fe92 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:56:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG nova.network.neutron [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Updating instance_info_cache with network_info: [{"id": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "address": "fa:16:3e:55:1a:9a", "network": {"id": "50e01a2d-5e91-4aca-a74c-7687f91ed21e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-937098047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e5e2cd6854f0985aa161b1e8a6db7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a60ced2-5c", "ovs_interfaceid": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Releasing lock "refresh_cache-db15ad45-8f28-4e0c-8d7e-7db75f33fe92" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:56:56 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Instance destroyed successfully.
Jul 31 14:56:56 user nova-compute[72239]: DEBUG nova.objects.instance [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lazy-loading 'resources' on Instance uuid db15ad45-8f28-4e0c-8d7e-7db75f33fe92 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:49:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1651644081',display_name='tempest-AttachVolumeTestJSON-server-1651644081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1651644081',id=17,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLc/1qoHPqiofv/4pq100FlHUUylmOhucQEOjm11Kc1EqvJcfHvM7rWQswLn8aCkbuoEn1btWVn/JCFreVgCA/Qh5g2ERD7C+D0EfwpykQR0pThmq61xI0NeRT3g5N4h2A==',key_name='tempest-keypair-1206654507',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:49:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a18e5e2cd6854f0985aa161b1e8a6db7',ramdisk_id='',reservation_id='r-32farejl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-853601938',owner_user_name='tempest-AttachVolumeTestJSON-853601938-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:55:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f8df817a91d41c8a421e2ba562c5015',uuid=db15ad45-8f28-4e0c-8d7e-7db75f33fe92,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "address": "fa:16:3e:55:1a:9a", "network": {"id": "50e01a2d-5e91-4aca-a74c-7687f91ed21e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-937098047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e5e2cd6854f0985aa161b1e8a6db7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a60ced2-5c", "ovs_interfaceid": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Converting VIF {"id": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "address": "fa:16:3e:55:1a:9a", "network": {"id": "50e01a2d-5e91-4aca-a74c-7687f91ed21e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-937098047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e5e2cd6854f0985aa161b1e8a6db7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a60ced2-5c", "ovs_interfaceid": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:1a:9a,bridge_name='br-int',has_traffic_filtering=True,id=4a60ced2-5c35-4f83-9734-e812bce6fad2,network=Network(50e01a2d-5e91-4aca-a74c-7687f91ed21e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a60ced2-5c') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG os_vif [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:1a:9a,bridge_name='br-int',has_traffic_filtering=True,id=4a60ced2-5c35-4f83-9734-e812bce6fad2,network=Network(50e01a2d-5e91-4aca-a74c-7687f91ed21e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a60ced2-5c') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a60ced2-5c, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:56:56 user nova-compute[72239]: INFO os_vif [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:1a:9a,bridge_name='br-int',has_traffic_filtering=True,id=4a60ced2-5c35-4f83-9734-e812bce6fad2,network=Network(50e01a2d-5e91-4aca-a74c-7687f91ed21e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a60ced2-5c')
Jul 31 14:56:56 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Start _get_guest_xml network_info=[{"id": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "address": "fa:16:3e:55:1a:9a", "network": {"id": "50e01a2d-5e91-4aca-a74c-7687f91ed21e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-937098047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e5e2cd6854f0985aa161b1e8a6db7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a60ced2-5c", "ovs_interfaceid": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG nova.objects.instance [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lazy-loading 'numa_topology' on Instance uuid db15ad45-8f28-4e0c-8d7e-7db75f33fe92 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:56:56 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:56:56 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:56:56 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG nova.objects.instance [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lazy-loading 'vcpu_model' on Instance uuid db15ad45-8f28-4e0c-8d7e-7db75f33fe92 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:49:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1651644081',display_name='tempest-AttachVolumeTestJSON-server-1651644081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1651644081',id=17,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLc/1qoHPqiofv/4pq100FlHUUylmOhucQEOjm11Kc1EqvJcfHvM7rWQswLn8aCkbuoEn1btWVn/JCFreVgCA/Qh5g2ERD7C+D0EfwpykQR0pThmq61xI0NeRT3g5N4h2A==',key_name='tempest-keypair-1206654507',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:49:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a18e5e2cd6854f0985aa161b1e8a6db7',ramdisk_id='',reservation_id='r-32farejl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-853601938',owner_user_name='tempest-AttachVolumeTestJSON-853601938-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:55:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f8df817a91d41c8a421e2ba562c5015',uuid=db15ad45-8f28-4e0c-8d7e-7db75f33fe92,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "address": "fa:16:3e:55:1a:9a", "network": {"id": "50e01a2d-5e91-4aca-a74c-7687f91ed21e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-937098047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e5e2cd6854f0985aa161b1e8a6db7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a60ced2-5c", "ovs_interfaceid": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Converting VIF {"id": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "address": "fa:16:3e:55:1a:9a", "network": {"id": "50e01a2d-5e91-4aca-a74c-7687f91ed21e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-937098047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e5e2cd6854f0985aa161b1e8a6db7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a60ced2-5c", "ovs_interfaceid": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:1a:9a,bridge_name='br-int',has_traffic_filtering=True,id=4a60ced2-5c35-4f83-9734-e812bce6fad2,network=Network(50e01a2d-5e91-4aca-a74c-7687f91ed21e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a60ced2-5c') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG nova.objects.instance [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lazy-loading 'pci_devices' on Instance uuid db15ad45-8f28-4e0c-8d7e-7db75f33fe92 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:56:56 user nova-compute[72239]:   <uuid>db15ad45-8f28-4e0c-8d7e-7db75f33fe92</uuid>
Jul 31 14:56:56 user nova-compute[72239]:   <name>instance-00000011</name>
Jul 31 14:56:56 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:56:56 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:56:56 user nova-compute[72239]:   <metadata>
Jul 31 14:56:56 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:56:56 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:56:56 user nova-compute[72239]:       <nova:name>tempest-AttachVolumeTestJSON-server-1651644081</nova:name>
Jul 31 14:56:56 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:56:56</nova:creationTime>
Jul 31 14:56:56 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:56:56 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:56:56 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:56:56 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:56:56 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:56:56 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:56:56 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:56:56 user nova-compute[72239]:       <nova:owner>
Jul 31 14:56:56 user nova-compute[72239]:         <nova:user uuid="2f8df817a91d41c8a421e2ba562c5015">tempest-AttachVolumeTestJSON-853601938-project-member</nova:user>
Jul 31 14:56:56 user nova-compute[72239]:         <nova:project uuid="a18e5e2cd6854f0985aa161b1e8a6db7">tempest-AttachVolumeTestJSON-853601938</nova:project>
Jul 31 14:56:56 user nova-compute[72239]:       </nova:owner>
Jul 31 14:56:56 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:56:56 user nova-compute[72239]:       <nova:ports>
Jul 31 14:56:56 user nova-compute[72239]:         <nova:port uuid="4a60ced2-5c35-4f83-9734-e812bce6fad2">
Jul 31 14:56:56 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 31 14:56:56 user nova-compute[72239]:         </nova:port>
Jul 31 14:56:56 user nova-compute[72239]:       </nova:ports>
Jul 31 14:56:56 user nova-compute[72239]:     </nova:instance>
Jul 31 14:56:56 user nova-compute[72239]:   </metadata>
Jul 31 14:56:56 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:56:56 user nova-compute[72239]:     <system>
Jul 31 14:56:56 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:56:56 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:56:56 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:56:56 user nova-compute[72239]:       <entry name="serial">db15ad45-8f28-4e0c-8d7e-7db75f33fe92</entry>
Jul 31 14:56:56 user nova-compute[72239]:       <entry name="uuid">db15ad45-8f28-4e0c-8d7e-7db75f33fe92</entry>
Jul 31 14:56:56 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:56:56 user nova-compute[72239]:     </system>
Jul 31 14:56:56 user nova-compute[72239]:   </sysinfo>
Jul 31 14:56:56 user nova-compute[72239]:   <os>
Jul 31 14:56:56 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:56:56 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:56:56 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:56:56 user nova-compute[72239]:   </os>
Jul 31 14:56:56 user nova-compute[72239]:   <features>
Jul 31 14:56:56 user nova-compute[72239]:     <acpi/>
Jul 31 14:56:56 user nova-compute[72239]:     <apic/>
Jul 31 14:56:56 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:56:56 user nova-compute[72239]:   </features>
Jul 31 14:56:56 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:56:56 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:56:56 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:56:56 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:56:56 user nova-compute[72239]:   </clock>
Jul 31 14:56:56 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:56:56 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:56:56 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:56:56 user nova-compute[72239]:   </cpu>
Jul 31 14:56:56 user nova-compute[72239]:   <devices>
Jul 31 14:56:56 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:56:56 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:56:56 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk"/>
Jul 31 14:56:56 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:56:56 user nova-compute[72239]:     </disk>
Jul 31 14:56:56 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:56:56 user nova-compute[72239]:       <mac address="fa:16:3e:55:1a:9a"/>
Jul 31 14:56:56 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:56:56 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:56:56 user nova-compute[72239]:       <target dev="tap4a60ced2-5c"/>
Jul 31 14:56:56 user nova-compute[72239]:     </interface>
Jul 31 14:56:56 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:56:56 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/console.log" append="off"/>
Jul 31 14:56:56 user nova-compute[72239]:     </serial>
Jul 31 14:56:56 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:56:56 user nova-compute[72239]:     <video>
Jul 31 14:56:56 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:56:56 user nova-compute[72239]:     </video>
Jul 31 14:56:56 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:56:56 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:56:56 user nova-compute[72239]:     </rng>
Jul 31 14:56:56 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:56:56 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:56:56 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:56:56 user nova-compute[72239]:     </memballoon>
Jul 31 14:56:56 user nova-compute[72239]:   </devices>
Jul 31 14:56:56 user nova-compute[72239]: </domain>
Jul 31 14:56:56 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG nova.objects.instance [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lazy-loading 'trusted_certs' on Instance uuid db15ad45-8f28-4e0c-8d7e-7db75f33fe92 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.159s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Checking if we can resize image /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Cannot resize image /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG nova.objects.instance [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lazy-loading 'migration_context' on Instance uuid db15ad45-8f28-4e0c-8d7e-7db75f33fe92 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:49:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1651644081',display_name='tempest-AttachVolumeTestJSON-server-1651644081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1651644081',id=17,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLc/1qoHPqiofv/4pq100FlHUUylmOhucQEOjm11Kc1EqvJcfHvM7rWQswLn8aCkbuoEn1btWVn/JCFreVgCA/Qh5g2ERD7C+D0EfwpykQR0pThmq61xI0NeRT3g5N4h2A==',key_name='tempest-keypair-1206654507',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:49:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='a18e5e2cd6854f0985aa161b1e8a6db7',ramdisk_id='',reservation_id='r-32farejl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-853601938',owner_user_name='tempest-AttachVolumeTestJSON-853601938-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:55:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f8df817a91d41c8a421e2ba562c5015',uuid=db15ad45-8f28-4e0c-8d7e-7db75f33fe92,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "address": "fa:16:3e:55:1a:9a", "network": {"id": "50e01a2d-5e91-4aca-a74c-7687f91ed21e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-937098047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e5e2cd6854f0985aa161b1e8a6db7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a60ced2-5c", "ovs_interfaceid": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Converting VIF {"id": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "address": "fa:16:3e:55:1a:9a", "network": {"id": "50e01a2d-5e91-4aca-a74c-7687f91ed21e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-937098047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e5e2cd6854f0985aa161b1e8a6db7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a60ced2-5c", "ovs_interfaceid": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:1a:9a,bridge_name='br-int',has_traffic_filtering=True,id=4a60ced2-5c35-4f83-9734-e812bce6fad2,network=Network(50e01a2d-5e91-4aca-a74c-7687f91ed21e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a60ced2-5c') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG os_vif [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:1a:9a,bridge_name='br-int',has_traffic_filtering=True,id=4a60ced2-5c35-4f83-9734-e812bce6fad2,network=Network(50e01a2d-5e91-4aca-a74c-7687f91ed21e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a60ced2-5c') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a60ced2-5c, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4a60ced2-5c, col_values=(('external_ids', {'iface-id': '4a60ced2-5c35-4f83-9734-e812bce6fad2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:1a:9a', 'vm-uuid': 'db15ad45-8f28-4e0c-8d7e-7db75f33fe92'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:56:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:56 user nova-compute[72239]: INFO os_vif [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:1a:9a,bridge_name='br-int',has_traffic_filtering=True,id=4a60ced2-5c35-4f83-9734-e812bce6fad2,network=Network(50e01a2d-5e91-4aca-a74c-7687f91ed21e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a60ced2-5c')
Jul 31 14:56:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:58 user nova-compute[72239]: DEBUG nova.compute.manager [req-785c5276-c02d-4ec8-a95a-0179394ccc20 req-5cf8805f-ffda-437c-8da0-be36f4d8cf8a service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Received event network-vif-plugged-4a60ced2-5c35-4f83-9734-e812bce6fad2 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:56:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-785c5276-c02d-4ec8-a95a-0179394ccc20 req-5cf8805f-ffda-437c-8da0-be36f4d8cf8a service nova] Acquiring lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:56:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-785c5276-c02d-4ec8-a95a-0179394ccc20 req-5cf8805f-ffda-437c-8da0-be36f4d8cf8a service nova] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:56:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-785c5276-c02d-4ec8-a95a-0179394ccc20 req-5cf8805f-ffda-437c-8da0-be36f4d8cf8a service nova] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:56:58 user nova-compute[72239]: DEBUG nova.compute.manager [req-785c5276-c02d-4ec8-a95a-0179394ccc20 req-5cf8805f-ffda-437c-8da0-be36f4d8cf8a service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] No waiting events found dispatching network-vif-plugged-4a60ced2-5c35-4f83-9734-e812bce6fad2 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:56:58 user nova-compute[72239]: WARNING nova.compute.manager [req-785c5276-c02d-4ec8-a95a-0179394ccc20 req-5cf8805f-ffda-437c-8da0-be36f4d8cf8a service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Received unexpected event network-vif-plugged-4a60ced2-5c35-4f83-9734-e812bce6fad2 for instance with vm_state stopped and task_state powering-on.
Jul 31 14:56:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:56:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:00 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815420.520448, db15ad45-8f28-4e0c-8d7e-7db75f33fe92 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:57:00 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] VM Resumed (Lifecycle Event)
Jul 31 14:57:00 user nova-compute[72239]: DEBUG nova.compute.manager [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:57:00 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Instance rebooted successfully.
Jul 31 14:57:00 user nova-compute[72239]: DEBUG nova.compute.manager [None req-0b3c3a08-54f5-46c8-8949-b4a3f1f4c2fa tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:57:00 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:57:00 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:57:00 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] During sync_power_state the instance has a pending task (powering-on). Skip.
Jul 31 14:57:00 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815420.5249476, db15ad45-8f28-4e0c-8d7e-7db75f33fe92 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:57:00 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] VM Started (Lifecycle Event)
Jul 31 14:57:00 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:57:00 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:57:00 user nova-compute[72239]: DEBUG nova.compute.manager [req-4edef637-de03-4137-9bc7-70cc37f688a7 req-3d828dd1-040e-4c35-9929-4011b69982dc service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Received event network-vif-plugged-4a60ced2-5c35-4f83-9734-e812bce6fad2 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:57:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-4edef637-de03-4137-9bc7-70cc37f688a7 req-3d828dd1-040e-4c35-9929-4011b69982dc service nova] Acquiring lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:57:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-4edef637-de03-4137-9bc7-70cc37f688a7 req-3d828dd1-040e-4c35-9929-4011b69982dc service nova] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:57:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-4edef637-de03-4137-9bc7-70cc37f688a7 req-3d828dd1-040e-4c35-9929-4011b69982dc service nova] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:57:00 user nova-compute[72239]: DEBUG nova.compute.manager [req-4edef637-de03-4137-9bc7-70cc37f688a7 req-3d828dd1-040e-4c35-9929-4011b69982dc service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] No waiting events found dispatching network-vif-plugged-4a60ced2-5c35-4f83-9734-e812bce6fad2 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:57:00 user nova-compute[72239]: WARNING nova.compute.manager [req-4edef637-de03-4137-9bc7-70cc37f688a7 req-3d828dd1-040e-4c35-9929-4011b69982dc service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Received unexpected event network-vif-plugged-4a60ced2-5c35-4f83-9734-e812bce6fad2 for instance with vm_state stopped and task_state powering-on.
Jul 31 14:57:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:05 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690815410.7267687, 91c2d1cf-ffdb-47a3-b754-57a328947e10 => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:57:05 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] VM Stopped (Lifecycle Event)
Jul 31 14:57:05 user nova-compute[72239]: DEBUG nova.compute.manager [None req-6746eab2-7629-4fc2-9119-9e80660064bc None None] [instance: 91c2d1cf-ffdb-47a3-b754-57a328947e10] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:57:06 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:07 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:57:07 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 14:57:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-db15ad45-8f28-4e0c-8d7e-7db75f33fe92" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:57:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-db15ad45-8f28-4e0c-8d7e-7db75f33fe92" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:57:07 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 14:57:08 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Updating instance_info_cache with network_info: [{"id": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "address": "fa:16:3e:55:1a:9a", "network": {"id": "50e01a2d-5e91-4aca-a74c-7687f91ed21e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-937098047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e5e2cd6854f0985aa161b1e8a6db7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a60ced2-5c", "ovs_interfaceid": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:57:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-db15ad45-8f28-4e0c-8d7e-7db75f33fe92" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:57:08 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 14:57:08 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:57:08 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:57:08 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:57:08 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:57:08 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:57:09 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:57:09 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:57:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:57:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:57:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:57:09 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 14:57:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87dd3b4b-c511-4784-acf9-ad21534c8337/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87dd3b4b-c511-4784-acf9-ad21534c8337/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87dd3b4b-c511-4784-acf9-ad21534c8337/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87dd3b4b-c511-4784-acf9-ad21534c8337/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:57:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:57:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:57:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:57:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:57:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:57:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dcd718a-280f-4b0e-b54f-616ee983ad16/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dcd718a-280f-4b0e-b54f-616ee983ad16/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dcd718a-280f-4b0e-b54f-616ee983ad16/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dcd718a-280f-4b0e-b54f-616ee983ad16/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:13 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:57:13 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:57:13 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=7000MB free_disk=25.137657165527344GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 14:57:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:57:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:57:13 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 20abf743-de5b-4122-aad0-e2124c7804b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:57:13 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 7d81b881-b44e-4fb3-8245-9dea634bdec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:57:13 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 079a5ed7-ee25-495b-a2a4-924d830a670a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:57:13 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 2f11022e-a007-4d4c-adc1-b54ea59b9e6a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:57:13 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance c10918e9-9731-48ea-860e-8a02cb6a0ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:57:13 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance db15ad45-8f28-4e0c-8d7e-7db75f33fe92 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:57:13 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance c2b3c85b-e939-41d0-8bf0-3a7f650177b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:57:13 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 3559f541-ed61-41b2-9a9d-8b10e18f7375 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:57:13 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 87dd3b4b-c511-4784-acf9-ad21534c8337 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:57:13 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 7dcd718a-280f-4b0e-b54f-616ee983ad16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:57:13 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance e6f6d85d-ffa0-4d72-b521-e855afa23a09 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:57:13 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 14653984-6c32-4ddd-bc0b-203a670c2b4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:57:13 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 12c719bf-b770-4e41-b1f4-314eed1180c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:57:13 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 14:57:13 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 14:57:13 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:57:14 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:57:14 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 14:57:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.569s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:57:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Acquiring lock "bc1b9270-ccf7-4127-a3fd-cab56d362f0d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:57:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Lock "bc1b9270-ccf7-4127-a3fd-cab56d362f0d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:57:15 user nova-compute[72239]: DEBUG nova.compute.manager [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 14:57:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:57:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:57:16 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 14:57:16 user nova-compute[72239]: INFO nova.compute.claims [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Claim successful on node user
Jul 31 14:57:16 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:57:16 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 14:57:16 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:57:16 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:57:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.454s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:57:16 user nova-compute[72239]: DEBUG nova.compute.manager [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 14:57:16 user nova-compute[72239]: DEBUG nova.compute.manager [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 14:57:16 user nova-compute[72239]: DEBUG nova.network.neutron [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 14:57:16 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 14:57:16 user nova-compute[72239]: DEBUG nova.compute.manager [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 14:57:16 user nova-compute[72239]: DEBUG nova.compute.manager [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 14:57:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 14:57:16 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Creating image(s)
Jul 31 14:57:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Acquiring lock "/opt/stack/data/nova/instances/bc1b9270-ccf7-4127-a3fd-cab56d362f0d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:57:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Lock "/opt/stack/data/nova/instances/bc1b9270-ccf7-4127-a3fd-cab56d362f0d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:57:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Lock "/opt/stack/data/nova/instances/bc1b9270-ccf7-4127-a3fd-cab56d362f0d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:57:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:16 user nova-compute[72239]: DEBUG nova.policy [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0d9b82d0ef5c4d3eb979876c7d5d55f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c951e0df58d342ecb09fe0cd5a78faf1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 14:57:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.138s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Acquiring lock "ca449065000c92aac3b7b9fa685f9a7710929444" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:57:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:57:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:16 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.131s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/bc1b9270-ccf7-4127-a3fd-cab56d362f0d/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/bc1b9270-ccf7-4127-a3fd-cab56d362f0d/disk 1073741824" returned: 0 in 0.056s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:57:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.138s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:17 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bc1b9270-ccf7-4127-a3fd-cab56d362f0d/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 14:57:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc1b9270-ccf7-4127-a3fd-cab56d362f0d/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc1b9270-ccf7-4127-a3fd-cab56d362f0d/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:17 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Cannot resize image /opt/stack/data/nova/instances/bc1b9270-ccf7-4127-a3fd-cab56d362f0d/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 14:57:17 user nova-compute[72239]: DEBUG nova.objects.instance [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Lazy-loading 'migration_context' on Instance uuid bc1b9270-ccf7-4127-a3fd-cab56d362f0d {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:57:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 14:57:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Ensure instance console log exists: /opt/stack/data/nova/instances/bc1b9270-ccf7-4127-a3fd-cab56d362f0d/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 14:57:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:57:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:57:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:57:17 user nova-compute[72239]: DEBUG nova.network.neutron [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Successfully created port: 84f0ba8c-8039-4217-9a8b-1f4e2b40e027 {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG nova.network.neutron [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Successfully updated port: 84f0ba8c-8039-4217-9a8b-1f4e2b40e027 {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Acquiring lock "refresh_cache-bc1b9270-ccf7-4127-a3fd-cab56d362f0d" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Acquired lock "refresh_cache-bc1b9270-ccf7-4127-a3fd-cab56d362f0d" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG nova.network.neutron [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG nova.compute.manager [req-d57ee277-68fe-4dd6-a5db-a565bf583dc5 req-d8f96aba-be96-4006-89a0-cefebe982198 service nova] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Received event network-changed-84f0ba8c-8039-4217-9a8b-1f4e2b40e027 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG nova.compute.manager [req-d57ee277-68fe-4dd6-a5db-a565bf583dc5 req-d8f96aba-be96-4006-89a0-cefebe982198 service nova] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Refreshing instance network info cache due to event network-changed-84f0ba8c-8039-4217-9a8b-1f4e2b40e027. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d57ee277-68fe-4dd6-a5db-a565bf583dc5 req-d8f96aba-be96-4006-89a0-cefebe982198 service nova] Acquiring lock "refresh_cache-bc1b9270-ccf7-4127-a3fd-cab56d362f0d" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG nova.network.neutron [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG nova.network.neutron [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Updating instance_info_cache with network_info: [{"id": "84f0ba8c-8039-4217-9a8b-1f4e2b40e027", "address": "fa:16:3e:36:0b:3a", "network": {"id": "bbf0bef1-878c-4e9c-96d1-0c54c8b0ff68", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "be985e778f1041c8a2378f305504c462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f0ba8c-80", "ovs_interfaceid": "84f0ba8c-8039-4217-9a8b-1f4e2b40e027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Releasing lock "refresh_cache-bc1b9270-ccf7-4127-a3fd-cab56d362f0d" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG nova.compute.manager [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Instance network_info: |[{"id": "84f0ba8c-8039-4217-9a8b-1f4e2b40e027", "address": "fa:16:3e:36:0b:3a", "network": {"id": "bbf0bef1-878c-4e9c-96d1-0c54c8b0ff68", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "be985e778f1041c8a2378f305504c462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f0ba8c-80", "ovs_interfaceid": "84f0ba8c-8039-4217-9a8b-1f4e2b40e027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d57ee277-68fe-4dd6-a5db-a565bf583dc5 req-d8f96aba-be96-4006-89a0-cefebe982198 service nova] Acquired lock "refresh_cache-bc1b9270-ccf7-4127-a3fd-cab56d362f0d" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG nova.network.neutron [req-d57ee277-68fe-4dd6-a5db-a565bf583dc5 req-d8f96aba-be96-4006-89a0-cefebe982198 service nova] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Refreshing network info cache for port 84f0ba8c-8039-4217-9a8b-1f4e2b40e027 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Start _get_guest_xml network_info=[{"id": "84f0ba8c-8039-4217-9a8b-1f4e2b40e027", "address": "fa:16:3e:36:0b:3a", "network": {"id": "bbf0bef1-878c-4e9c-96d1-0c54c8b0ff68", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "be985e778f1041c8a2378f305504c462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f0ba8c-80", "ovs_interfaceid": "84f0ba8c-8039-4217-9a8b-1f4e2b40e027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:57:18 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:57:18 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:57:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:57:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-33641494',display_name='tempest-VolumesNegativeTest-instance-33641494',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-33641494',id=30,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c951e0df58d342ecb09fe0cd5a78faf1',ramdisk_id='',reservation_id='r-dnttx2f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-783587187',owner_user_name='tempest-VolumesNegativeTest-783587187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:57:17Z,user_data=None,user_id='0d9b82d0ef5c4d3eb979876c7d5d55f5',uuid=bc1b9270-ccf7-4127-a3fd-cab56d362f0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84f0ba8c-8039-4217-9a8b-1f4e2b40e027", "address": "fa:16:3e:36:0b:3a", "network": {"id": "bbf0bef1-878c-4e9c-96d1-0c54c8b0ff68", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "be985e778f1041c8a2378f305504c462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f0ba8c-80", "ovs_interfaceid": "84f0ba8c-8039-4217-9a8b-1f4e2b40e027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Converting VIF {"id": "84f0ba8c-8039-4217-9a8b-1f4e2b40e027", "address": "fa:16:3e:36:0b:3a", "network": {"id": "bbf0bef1-878c-4e9c-96d1-0c54c8b0ff68", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "be985e778f1041c8a2378f305504c462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f0ba8c-80", "ovs_interfaceid": "84f0ba8c-8039-4217-9a8b-1f4e2b40e027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:0b:3a,bridge_name='br-int',has_traffic_filtering=True,id=84f0ba8c-8039-4217-9a8b-1f4e2b40e027,network=Network(bbf0bef1-878c-4e9c-96d1-0c54c8b0ff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84f0ba8c-80') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG nova.objects.instance [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Lazy-loading 'pci_devices' on Instance uuid bc1b9270-ccf7-4127-a3fd-cab56d362f0d {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:57:18 user nova-compute[72239]:   <uuid>bc1b9270-ccf7-4127-a3fd-cab56d362f0d</uuid>
Jul 31 14:57:18 user nova-compute[72239]:   <name>instance-0000001e</name>
Jul 31 14:57:18 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:57:18 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:57:18 user nova-compute[72239]:   <metadata>
Jul 31 14:57:18 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:57:18 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:57:18 user nova-compute[72239]:       <nova:name>tempest-VolumesNegativeTest-instance-33641494</nova:name>
Jul 31 14:57:18 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:57:18</nova:creationTime>
Jul 31 14:57:18 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:57:18 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:57:18 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:57:18 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:57:18 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:57:18 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:57:18 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:57:18 user nova-compute[72239]:       <nova:owner>
Jul 31 14:57:18 user nova-compute[72239]:         <nova:user uuid="0d9b82d0ef5c4d3eb979876c7d5d55f5">tempest-VolumesNegativeTest-783587187-project-member</nova:user>
Jul 31 14:57:18 user nova-compute[72239]:         <nova:project uuid="c951e0df58d342ecb09fe0cd5a78faf1">tempest-VolumesNegativeTest-783587187</nova:project>
Jul 31 14:57:18 user nova-compute[72239]:       </nova:owner>
Jul 31 14:57:18 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:57:18 user nova-compute[72239]:       <nova:ports>
Jul 31 14:57:18 user nova-compute[72239]:         <nova:port uuid="84f0ba8c-8039-4217-9a8b-1f4e2b40e027">
Jul 31 14:57:18 user nova-compute[72239]:           <nova:ip type="fixed" address="192.168.233.176" ipVersion="4"/>
Jul 31 14:57:18 user nova-compute[72239]:         </nova:port>
Jul 31 14:57:18 user nova-compute[72239]:       </nova:ports>
Jul 31 14:57:18 user nova-compute[72239]:     </nova:instance>
Jul 31 14:57:18 user nova-compute[72239]:   </metadata>
Jul 31 14:57:18 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:57:18 user nova-compute[72239]:     <system>
Jul 31 14:57:18 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:57:18 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:57:18 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:57:18 user nova-compute[72239]:       <entry name="serial">bc1b9270-ccf7-4127-a3fd-cab56d362f0d</entry>
Jul 31 14:57:18 user nova-compute[72239]:       <entry name="uuid">bc1b9270-ccf7-4127-a3fd-cab56d362f0d</entry>
Jul 31 14:57:18 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:57:18 user nova-compute[72239]:     </system>
Jul 31 14:57:18 user nova-compute[72239]:   </sysinfo>
Jul 31 14:57:18 user nova-compute[72239]:   <os>
Jul 31 14:57:18 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:57:18 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:57:18 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:57:18 user nova-compute[72239]:   </os>
Jul 31 14:57:18 user nova-compute[72239]:   <features>
Jul 31 14:57:18 user nova-compute[72239]:     <acpi/>
Jul 31 14:57:18 user nova-compute[72239]:     <apic/>
Jul 31 14:57:18 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:57:18 user nova-compute[72239]:   </features>
Jul 31 14:57:18 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:57:18 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:57:18 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:57:18 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:57:18 user nova-compute[72239]:   </clock>
Jul 31 14:57:18 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:57:18 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:57:18 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:57:18 user nova-compute[72239]:   </cpu>
Jul 31 14:57:18 user nova-compute[72239]:   <devices>
Jul 31 14:57:18 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:57:18 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:57:18 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/bc1b9270-ccf7-4127-a3fd-cab56d362f0d/disk"/>
Jul 31 14:57:18 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:57:18 user nova-compute[72239]:     </disk>
Jul 31 14:57:18 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:57:18 user nova-compute[72239]:       <mac address="fa:16:3e:36:0b:3a"/>
Jul 31 14:57:18 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:57:18 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:57:18 user nova-compute[72239]:       <target dev="tap84f0ba8c-80"/>
Jul 31 14:57:18 user nova-compute[72239]:     </interface>
Jul 31 14:57:18 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:57:18 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/bc1b9270-ccf7-4127-a3fd-cab56d362f0d/console.log" append="off"/>
Jul 31 14:57:18 user nova-compute[72239]:     </serial>
Jul 31 14:57:18 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:57:18 user nova-compute[72239]:     <video>
Jul 31 14:57:18 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:57:18 user nova-compute[72239]:     </video>
Jul 31 14:57:18 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:57:18 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:57:18 user nova-compute[72239]:     </rng>
Jul 31 14:57:18 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:57:18 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:57:18 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:57:18 user nova-compute[72239]:     </memballoon>
Jul 31 14:57:18 user nova-compute[72239]:   </devices>
Jul 31 14:57:18 user nova-compute[72239]: </domain>
Jul 31 14:57:18 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:57:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-33641494',display_name='tempest-VolumesNegativeTest-instance-33641494',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-33641494',id=30,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c951e0df58d342ecb09fe0cd5a78faf1',ramdisk_id='',reservation_id='r-dnttx2f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-783587187',owner_user_name='tempest-VolumesNegativeTest-783587187-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:57:17Z,user_data=None,user_id='0d9b82d0ef5c4d3eb979876c7d5d55f5',uuid=bc1b9270-ccf7-4127-a3fd-cab56d362f0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84f0ba8c-8039-4217-9a8b-1f4e2b40e027", "address": "fa:16:3e:36:0b:3a", "network": {"id": "bbf0bef1-878c-4e9c-96d1-0c54c8b0ff68", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "be985e778f1041c8a2378f305504c462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f0ba8c-80", "ovs_interfaceid": "84f0ba8c-8039-4217-9a8b-1f4e2b40e027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Converting VIF {"id": "84f0ba8c-8039-4217-9a8b-1f4e2b40e027", "address": "fa:16:3e:36:0b:3a", "network": {"id": "bbf0bef1-878c-4e9c-96d1-0c54c8b0ff68", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "be985e778f1041c8a2378f305504c462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f0ba8c-80", "ovs_interfaceid": "84f0ba8c-8039-4217-9a8b-1f4e2b40e027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:0b:3a,bridge_name='br-int',has_traffic_filtering=True,id=84f0ba8c-8039-4217-9a8b-1f4e2b40e027,network=Network(bbf0bef1-878c-4e9c-96d1-0c54c8b0ff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84f0ba8c-80') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG os_vif [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:0b:3a,bridge_name='br-int',has_traffic_filtering=True,id=84f0ba8c-8039-4217-9a8b-1f4e2b40e027,network=Network(bbf0bef1-878c-4e9c-96d1-0c54c8b0ff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84f0ba8c-80') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84f0ba8c-80, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap84f0ba8c-80, col_values=(('external_ids', {'iface-id': '84f0ba8c-8039-4217-9a8b-1f4e2b40e027', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:0b:3a', 'vm-uuid': 'bc1b9270-ccf7-4127-a3fd-cab56d362f0d'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:18 user nova-compute[72239]: INFO os_vif [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:0b:3a,bridge_name='br-int',has_traffic_filtering=True,id=84f0ba8c-8039-4217-9a8b-1f4e2b40e027,network=Network(bbf0bef1-878c-4e9c-96d1-0c54c8b0ff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84f0ba8c-80')
Jul 31 14:57:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:57:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] No VIF found with MAC fa:16:3e:36:0b:3a, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:57:19 user nova-compute[72239]: INFO nova.compute.manager [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Rescuing
Jul 31 14:57:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "refresh_cache-e6f6d85d-ffa0-4d72-b521-e855afa23a09" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:57:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquired lock "refresh_cache-e6f6d85d-ffa0-4d72-b521-e855afa23a09" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:57:19 user nova-compute[72239]: DEBUG nova.network.neutron [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:57:19 user nova-compute[72239]: DEBUG nova.network.neutron [req-d57ee277-68fe-4dd6-a5db-a565bf583dc5 req-d8f96aba-be96-4006-89a0-cefebe982198 service nova] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Updated VIF entry in instance network info cache for port 84f0ba8c-8039-4217-9a8b-1f4e2b40e027. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:57:19 user nova-compute[72239]: DEBUG nova.network.neutron [req-d57ee277-68fe-4dd6-a5db-a565bf583dc5 req-d8f96aba-be96-4006-89a0-cefebe982198 service nova] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Updating instance_info_cache with network_info: [{"id": "84f0ba8c-8039-4217-9a8b-1f4e2b40e027", "address": "fa:16:3e:36:0b:3a", "network": {"id": "bbf0bef1-878c-4e9c-96d1-0c54c8b0ff68", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "be985e778f1041c8a2378f305504c462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f0ba8c-80", "ovs_interfaceid": "84f0ba8c-8039-4217-9a8b-1f4e2b40e027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:57:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d57ee277-68fe-4dd6-a5db-a565bf583dc5 req-d8f96aba-be96-4006-89a0-cefebe982198 service nova] Releasing lock "refresh_cache-bc1b9270-ccf7-4127-a3fd-cab56d362f0d" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:57:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:20 user nova-compute[72239]: DEBUG nova.network.neutron [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Updating instance_info_cache with network_info: [{"id": "5c7f836e-274b-4a20-915a-d28d7e70d2a3", "address": "fa:16:3e:78:53:e9", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7f836e-27", "ovs_interfaceid": "5c7f836e-274b-4a20-915a-d28d7e70d2a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:57:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Releasing lock "refresh_cache-e6f6d85d-ffa0-4d72-b521-e855afa23a09" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:57:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:20 user nova-compute[72239]: DEBUG nova.compute.manager [req-0af26990-a890-4fd6-831e-d5e1d6e7e826 req-a335b5ae-392d-4d53-8be5-8809ba00ddc1 service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Received event network-vif-unplugged-5c7f836e-274b-4a20-915a-d28d7e70d2a3 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:57:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0af26990-a890-4fd6-831e-d5e1d6e7e826 req-a335b5ae-392d-4d53-8be5-8809ba00ddc1 service nova] Acquiring lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:57:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0af26990-a890-4fd6-831e-d5e1d6e7e826 req-a335b5ae-392d-4d53-8be5-8809ba00ddc1 service nova] Lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:57:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0af26990-a890-4fd6-831e-d5e1d6e7e826 req-a335b5ae-392d-4d53-8be5-8809ba00ddc1 service nova] Lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:57:20 user nova-compute[72239]: DEBUG nova.compute.manager [req-0af26990-a890-4fd6-831e-d5e1d6e7e826 req-a335b5ae-392d-4d53-8be5-8809ba00ddc1 service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] No waiting events found dispatching network-vif-unplugged-5c7f836e-274b-4a20-915a-d28d7e70d2a3 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:57:20 user nova-compute[72239]: WARNING nova.compute.manager [req-0af26990-a890-4fd6-831e-d5e1d6e7e826 req-a335b5ae-392d-4d53-8be5-8809ba00ddc1 service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Received unexpected event network-vif-unplugged-5c7f836e-274b-4a20-915a-d28d7e70d2a3 for instance with vm_state active and task_state rescuing.
Jul 31 14:57:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:20 user nova-compute[72239]: DEBUG nova.compute.manager [req-a13c8063-d42e-4d41-b588-fe1d7d0108da req-e30f13cc-fb76-4e7f-a214-f47d6226dfb9 service nova] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Received event network-vif-plugged-84f0ba8c-8039-4217-9a8b-1f4e2b40e027 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:57:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a13c8063-d42e-4d41-b588-fe1d7d0108da req-e30f13cc-fb76-4e7f-a214-f47d6226dfb9 service nova] Acquiring lock "bc1b9270-ccf7-4127-a3fd-cab56d362f0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:57:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a13c8063-d42e-4d41-b588-fe1d7d0108da req-e30f13cc-fb76-4e7f-a214-f47d6226dfb9 service nova] Lock "bc1b9270-ccf7-4127-a3fd-cab56d362f0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:57:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a13c8063-d42e-4d41-b588-fe1d7d0108da req-e30f13cc-fb76-4e7f-a214-f47d6226dfb9 service nova] Lock "bc1b9270-ccf7-4127-a3fd-cab56d362f0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:57:20 user nova-compute[72239]: DEBUG nova.compute.manager [req-a13c8063-d42e-4d41-b588-fe1d7d0108da req-e30f13cc-fb76-4e7f-a214-f47d6226dfb9 service nova] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] No waiting events found dispatching network-vif-plugged-84f0ba8c-8039-4217-9a8b-1f4e2b40e027 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:57:20 user nova-compute[72239]: WARNING nova.compute.manager [req-a13c8063-d42e-4d41-b588-fe1d7d0108da req-e30f13cc-fb76-4e7f-a214-f47d6226dfb9 service nova] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Received unexpected event network-vif-plugged-84f0ba8c-8039-4217-9a8b-1f4e2b40e027 for instance with vm_state building and task_state spawning.
Jul 31 14:57:21 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Instance destroyed successfully.
Jul 31 14:57:21 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Attempting a stable device rescue
Jul 31 14:57:21 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=72239) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 31 14:57:21 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Instance directory exists: not creating {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 31 14:57:21 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Creating image(s)
Jul 31 14:57:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "/opt/stack/data/nova/instances/e6f6d85d-ffa0-4d72-b521-e855afa23a09/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:57:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "/opt/stack/data/nova/instances/e6f6d85d-ffa0-4d72-b521-e855afa23a09/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:57:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "/opt/stack/data/nova/instances/e6f6d85d-ffa0-4d72-b521-e855afa23a09/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:57:21 user nova-compute[72239]: DEBUG nova.objects.instance [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lazy-loading 'trusted_certs' on Instance uuid e6f6d85d-ffa0-4d72-b521-e855afa23a09 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:57:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "f26436c38aacbc546fb6769bbd72e00b6b88a499" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:57:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "f26436c38aacbc546fb6769bbd72e00b6b88a499" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:57:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f26436c38aacbc546fb6769bbd72e00b6b88a499.part --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f26436c38aacbc546fb6769bbd72e00b6b88a499.part --force-share --output=json" returned: 0 in 0.139s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:22 user nova-compute[72239]: DEBUG nova.virt.images [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] 17e73e9f-4832-44db-8a7e-b027f2652d71 was qcow2, converting to raw {{(pid=72239) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 31 14:57:22 user nova-compute[72239]: DEBUG nova.privsep.utils [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72239) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 14:57:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f26436c38aacbc546fb6769bbd72e00b6b88a499.part /opt/stack/data/nova/instances/_base/f26436c38aacbc546fb6769bbd72e00b6b88a499.converted {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:22 user nova-compute[72239]: DEBUG nova.compute.manager [req-946bcf3f-0826-4848-8aa3-22e7e0617793 req-d4dab63b-c904-4145-a2e5-ba44d454f3e2 service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Received event network-vif-plugged-5c7f836e-274b-4a20-915a-d28d7e70d2a3 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:57:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-946bcf3f-0826-4848-8aa3-22e7e0617793 req-d4dab63b-c904-4145-a2e5-ba44d454f3e2 service nova] Acquiring lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:57:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-946bcf3f-0826-4848-8aa3-22e7e0617793 req-d4dab63b-c904-4145-a2e5-ba44d454f3e2 service nova] Lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:57:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-946bcf3f-0826-4848-8aa3-22e7e0617793 req-d4dab63b-c904-4145-a2e5-ba44d454f3e2 service nova] Lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:57:22 user nova-compute[72239]: DEBUG nova.compute.manager [req-946bcf3f-0826-4848-8aa3-22e7e0617793 req-d4dab63b-c904-4145-a2e5-ba44d454f3e2 service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] No waiting events found dispatching network-vif-plugged-5c7f836e-274b-4a20-915a-d28d7e70d2a3 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:57:22 user nova-compute[72239]: WARNING nova.compute.manager [req-946bcf3f-0826-4848-8aa3-22e7e0617793 req-d4dab63b-c904-4145-a2e5-ba44d454f3e2 service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Received unexpected event network-vif-plugged-5c7f836e-274b-4a20-915a-d28d7e70d2a3 for instance with vm_state active and task_state rescuing.
Jul 31 14:57:22 user nova-compute[72239]: DEBUG nova.compute.manager [req-b0ee50f4-e9dc-4f9e-8a90-0b919eb71e83 req-e11f0e03-21f2-4727-90ea-900828db0706 service nova] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Received event network-vif-plugged-84f0ba8c-8039-4217-9a8b-1f4e2b40e027 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:57:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b0ee50f4-e9dc-4f9e-8a90-0b919eb71e83 req-e11f0e03-21f2-4727-90ea-900828db0706 service nova] Acquiring lock "bc1b9270-ccf7-4127-a3fd-cab56d362f0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:57:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b0ee50f4-e9dc-4f9e-8a90-0b919eb71e83 req-e11f0e03-21f2-4727-90ea-900828db0706 service nova] Lock "bc1b9270-ccf7-4127-a3fd-cab56d362f0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:57:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b0ee50f4-e9dc-4f9e-8a90-0b919eb71e83 req-e11f0e03-21f2-4727-90ea-900828db0706 service nova] Lock "bc1b9270-ccf7-4127-a3fd-cab56d362f0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:57:22 user nova-compute[72239]: DEBUG nova.compute.manager [req-b0ee50f4-e9dc-4f9e-8a90-0b919eb71e83 req-e11f0e03-21f2-4727-90ea-900828db0706 service nova] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] No waiting events found dispatching network-vif-plugged-84f0ba8c-8039-4217-9a8b-1f4e2b40e027 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:57:22 user nova-compute[72239]: WARNING nova.compute.manager [req-b0ee50f4-e9dc-4f9e-8a90-0b919eb71e83 req-e11f0e03-21f2-4727-90ea-900828db0706 service nova] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Received unexpected event network-vif-plugged-84f0ba8c-8039-4217-9a8b-1f4e2b40e027 for instance with vm_state building and task_state spawning.
Jul 31 14:57:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f26436c38aacbc546fb6769bbd72e00b6b88a499.part /opt/stack/data/nova/instances/_base/f26436c38aacbc546fb6769bbd72e00b6b88a499.converted" returned: 0 in 0.544s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f26436c38aacbc546fb6769bbd72e00b6b88a499.converted --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f26436c38aacbc546fb6769bbd72e00b6b88a499.converted --force-share --output=json" returned: 0 in 0.184s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "f26436c38aacbc546fb6769bbd72e00b6b88a499" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.024s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "f26436c38aacbc546fb6769bbd72e00b6b88a499" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "f26436c38aacbc546fb6769bbd72e00b6b88a499" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f26436c38aacbc546fb6769bbd72e00b6b88a499 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f26436c38aacbc546fb6769bbd72e00b6b88a499 --force-share --output=json" returned: 0 in 0.141s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f26436c38aacbc546fb6769bbd72e00b6b88a499,backing_fmt=raw /opt/stack/data/nova/instances/e6f6d85d-ffa0-4d72-b521-e855afa23a09/disk.rescue {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f26436c38aacbc546fb6769bbd72e00b6b88a499,backing_fmt=raw /opt/stack/data/nova/instances/e6f6d85d-ffa0-4d72-b521-e855afa23a09/disk.rescue" returned: 0 in 0.073s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "f26436c38aacbc546fb6769bbd72e00b6b88a499" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.objects.instance [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lazy-loading 'migration_context' on Instance uuid e6f6d85d-ffa0-4d72-b521-e855afa23a09 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Start _get_guest_xml network_info=[{"id": "5c7f836e-274b-4a20-915a-d28d7e70d2a3", "address": "fa:16:3e:78:53:e9", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "vif_mac": "fa:16:3e:78:53:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7f836e-27", "ovs_interfaceid": "5c7f836e-274b-4a20-915a-d28d7e70d2a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '17e73e9f-4832-44db-8a7e-b027f2652d71', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'c5cc8cd8-05ef-4a05-88a4-09add22fb5b9', 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kPyhpOjt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'e6f6d85d-ffa0-4d72-b521-e855afa23a09', 'attached_at': '', 'detached_at': '', 'volume_id': '084e3707-fde6-425e-bb74-cc8b96e427ae', 'serial': '084e3707-fde6-425e-bb74-cc8b96e427ae'}, 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.objects.instance [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lazy-loading 'resources' on Instance uuid e6f6d85d-ffa0-4d72-b521-e855afa23a09 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815443.3885148, bc1b9270-ccf7-4127-a3fd-cab56d362f0d => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:57:23 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] VM Resumed (Lifecycle Event)
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.compute.manager [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.objects.instance [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lazy-loading 'numa_topology' on Instance uuid e6f6d85d-ffa0-4d72-b521-e855afa23a09 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:57:23 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Instance spawned successfully.
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:57:23 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815443.3907893, bc1b9270-ccf7-4127-a3fd-cab56d362f0d => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:57:23 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] VM Started (Lifecycle Event)
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:57:23 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:57:23 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:57:23 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.objects.instance [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lazy-loading 'vcpu_model' on Instance uuid e6f6d85d-ffa0-4d72-b521-e855afa23a09 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kPyhpOjt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:57:23 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:57:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:57:23 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:57:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:57:23 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 14:57:23 user nova-compute[72239]: INFO nova.compute.manager [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Took 6.89 seconds to spawn the instance on the hypervisor.
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.compute.manager [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f43c7d-9f7b-49ed-b6f5-0200ab210f2f]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = kPyhpOjt\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 31 14:57:23 user nova-compute[72239]: node.name = iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae
Jul 31 14:57:23 user nova-compute[72239]: node.tpgt = -1
Jul 31 14:57:23 user nova-compute[72239]: node.startup = automatic
Jul 31 14:57:23 user nova-compute[72239]: node.leading_login = No
Jul 31 14:57:23 user nova-compute[72239]: iface.iscsi_ifacename = default
Jul 31 14:57:23 user nova-compute[72239]: iface.net_ifacename = <empty>
Jul 31 14:57:23 user nova-compute[72239]: iface.ipaddress = <empty>
Jul 31 14:57:23 user nova-compute[72239]: iface.prefix_len = 0
Jul 31 14:57:23 user nova-compute[72239]: iface.hwaddress = <empty>
Jul 31 14:57:23 user nova-compute[72239]: iface.transport_name = tcp
Jul 31 14:57:23 user nova-compute[72239]: iface.initiatorname = <empty>
Jul 31 14:57:23 user nova-compute[72239]: iface.state = <empty>
Jul 31 14:57:23 user nova-compute[72239]: iface.vlan_id = 0
Jul 31 14:57:23 user nova-compute[72239]: iface.vlan_priority = 0
Jul 31 14:57:23 user nova-compute[72239]: iface.vlan_state = <empty>
Jul 31 14:57:23 user nova-compute[72239]: iface.iface_num = 0
Jul 31 14:57:23 user nova-compute[72239]: iface.mtu = 0
Jul 31 14:57:23 user nova-compute[72239]: iface.port = 0
Jul 31 14:57:23 user nova-compute[72239]: iface.bootproto = <empty>
Jul 31 14:57:23 user nova-compute[72239]: iface.subnet_mask = <empty>
Jul 31 14:57:23 user nova-compute[72239]: iface.gateway = <empty>
Jul 31 14:57:23 user nova-compute[72239]: iface.dhcp_alt_client_id_state = <empty>
Jul 31 14:57:23 user nova-compute[72239]: iface.dhcp_alt_client_id = <empty>
Jul 31 14:57:23 user nova-compute[72239]: iface.dhcp_dns = <empty>
Jul 31 14:57:23 user nova-compute[72239]: iface.dhcp_learn_iqn = <empty>
Jul 31 14:57:23 user nova-compute[72239]: iface.dhcp_req_vendor_id_state = <empty>
Jul 31 14:57:23 user nova-compute[72239]: iface.dhcp_vendor_id_state = <empty>
Jul 31 14:57:23 user nova-compute[72239]: iface.dhcp_vendor_id = <empty>
Jul 31 14:57:23 user nova-compute[72239]: iface.dhcp_slp_da = <empty>
Jul 31 14:57:23 user nova-compute[72239]: iface.fragmentation = <empty>
Jul 31 14:57:23 user nova-compute[72239]: iface.gratuitous_arp = <empty>
Jul 31 14:57:23 user nova-compute[72239]: iface.incoming_forwarding = <empty>
Jul 31 14:57:23 user nova-compute[72239]: iface.tos_state = <empty>
Jul 31 14:57:23 user nova-compute[72239]: iface.tos = 0
Jul 31 14:57:23 user nova-compute[72239]: iface.ttl = 0
Jul 31 14:57:23 user nova-compute[72239]: iface.delayed_ack = <empty>
Jul 31 14:57:23 user nova-compute[72239]: iface.tcp_nagle = <empty>
Jul 31 14:57:23 user nova-compute[72239]: iface.tcp_wsf_state = <empty>
Jul 31 14:57:23 user nova-compute[72239]: iface.tcp_wsf = 0
Jul 31 14:57:23 user nova-compute[72239]: iface.tcp_timer_scale = 0
Jul 31 14:57:23 user nova-compute[72239]: iface.tcp_timestamp = <empty>
Jul 31 14:57:23 user nova-compute[72239]: iface.redirect = <empty>
Jul 31 14:57:23 user nova-compute[72239]: iface.def_task_mgmt_timeout = 0
Jul 31 14:57:23 user nova-compute[72239]: iface.header_digest = <empty>
Jul 31 14:57:23 user nova-compute[72239]: iface.data_digest = <empty>
Jul 31 14:57:23 user nova-compute[72239]: iface.immediate_data = <empty>
Jul 31 14:57:23 user nova-compute[72239]: iface.initial_r2t = <empty>
Jul 31 14:57:23 user nova-compute[72239]: iface.data_seq_inorder = <empty>
Jul 31 14:57:23 user nova-compute[72239]: iface.data_pdu_inorder = <empty>
Jul 31 14:57:23 user nova-compute[72239]: iface.erl = 0
Jul 31 14:57:23 user nova-compute[72239]: iface.max_receive_data_len = 0
Jul 31 14:57:23 user nova-compute[72239]: iface.first_burst_len = 0
Jul 31 14:57:23 user nova-compute[72239]: iface.max_outstanding_r2t = 0
Jul 31 14:57:23 user nova-compute[72239]: iface.max_burst_len = 0
Jul 31 14:57:23 user nova-compute[72239]: iface.chap_auth = <empty>
Jul 31 14:57:23 user nova-compute[72239]: iface.bidi_chap = <empty>
Jul 31 14:57:23 user nova-compute[72239]: iface.strict_login_compliance = <empty>
Jul 31 14:57:23 user nova-compute[72239]: iface.discovery_auth = <empty>
Jul 31 14:57:23 user nova-compute[72239]: iface.discovery_logout = <empty>
Jul 31 14:57:23 user nova-compute[72239]: node.discovery_address = <empty>
Jul 31 14:57:23 user nova-compute[72239]: node.discovery_port = 0
Jul 31 14:57:23 user nova-compute[72239]: node.discovery_type = static
Jul 31 14:57:23 user nova-compute[72239]: node.session.initial_cmdsn = 0
Jul 31 14:57:23 user nova-compute[72239]: node.session.initial_login_retry_max = 8
Jul 31 14:57:23 user nova-compute[72239]: node.session.xmit_thread_priority = -20
Jul 31 14:57:23 user nova-compute[72239]: node.session.cmds_max = 128
Jul 31 14:57:23 user nova-compute[72239]: node.session.queue_depth = 32
Jul 31 14:57:23 user nova-compute[72239]: node.session.nr_sessions = 1
Jul 31 14:57:23 user nova-compute[72239]: node.session.auth.authmethod = CHAP
Jul 31 14:57:23 user nova-compute[72239]: node.session.auth.username = kPyhpOjt
Jul 31 14:57:23 user nova-compute[72239]: node.session.auth.password = ***
Jul 31 14:57:23 user nova-compute[72239]: node.session.auth.username_in = <empty>
Jul 31 14:57:23 user nova-compute[72239]: node.session.auth.password_in = <empty>
Jul 31 14:57:23 user nova-compute[72239]: node.session.auth.chap_algs = MD5
Jul 31 14:57:23 user nova-compute[72239]: node.session.timeo.replacement_timeout = 120
Jul 31 14:57:23 user nova-compute[72239]: node.session.err_timeo.abort_timeout = 15
Jul 31 14:57:23 user nova-compute[72239]: node.session.err_timeo.lu_reset_timeout = 30
Jul 31 14:57:23 user nova-compute[72239]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 31 14:57:23 user nova-compute[72239]: node.session.err_timeo.host_reset_timeout = 60
Jul 31 14:57:23 user nova-compute[72239]: node.session.iscsi.FastAbort = Yes
Jul 31 14:57:23 user nova-compute[72239]: node.session.iscsi.InitialR2T = No
Jul 31 14:57:23 user nova-compute[72239]: node.session.iscsi.ImmediateData = Yes
Jul 31 14:57:23 user nova-compute[72239]: node.session.iscsi.FirstBurstLength = 262144
Jul 31 14:57:23 user nova-compute[72239]: node.session.iscsi.MaxBurstLength = 16776192
Jul 31 14:57:23 user nova-compute[72239]: node.session.iscsi.DefaultTime2Retain = 0
Jul 31 14:57:23 user nova-compute[72239]: node.session.iscsi.DefaultTime2Wait = 2
Jul 31 14:57:23 user nova-compute[72239]: node.session.iscsi.MaxConnections = 1
Jul 31 14:57:23 user nova-compute[72239]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 31 14:57:23 user nova-compute[72239]: node.session.iscsi.ERL = 0
Jul 31 14:57:23 user nova-compute[72239]: node.session.scan = manual
Jul 31 14:57:23 user nova-compute[72239]: node.session.reopen_max = 0
Jul 31 14:57:23 user nova-compute[72239]: node.conn[0].address = 172.16.0.220
Jul 31 14:57:23 user nova-compute[72239]: node.conn[0].port = 3260
Jul 31 14:57:23 user nova-compute[72239]: node.conn[0].startup = manual
Jul 31 14:57:23 user nova-compute[72239]: node.conn[0].tcp.window_size = 524288
Jul 31 14:57:23 user nova-compute[72239]: node.conn[0].tcp.type_of_service = 0
Jul 31 14:57:23 user nova-compute[72239]: node.conn[0].timeo.logout_timeout = 15
Jul 31 14:57:23 user nova-compute[72239]: node.conn[0].timeo.login_timeout = 15
Jul 31 14:57:23 user nova-compute[72239]: node.conn[0].timeo.auth_timeout = 45
Jul 31 14:57:23 user nova-compute[72239]: node.conn[0].timeo.noop_out_interval = 5
Jul 31 14:57:23 user nova-compute[72239]: node.conn[0].timeo.noop_out_timeout = 5
Jul 31 14:57:23 user nova-compute[72239]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 31 14:57:23 user nova-compute[72239]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 31 14:57:23 user nova-compute[72239]: node.conn[0].iscsi.HeaderDigest = None
Jul 31 14:57:23 user nova-compute[72239]: node.conn[0].iscsi.DataDigest = None
Jul 31 14:57:23 user nova-compute[72239]: node.conn[0].iscsi.IFMarker = No
Jul 31 14:57:23 user nova-compute[72239]: node.conn[0].iscsi.OFMarker = No
Jul 31 14:57:23 user nova-compute[72239]: # END RECORD
Jul 31 14:57:23 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[72293f67-4775-4c8c-aa07-c2f93a2dcc4a]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a7a34a-983e-4610-a8ca-aa7e8e58e1c3]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:57:23 user nova-compute[72239]: INFO nova.compute.manager [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Took 7.69 seconds to build instance.
Jul 31 14:57:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kPyhpOjt {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b517092e-1a75-4048-9daf-db7d637c58c6 tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Lock "bc1b9270-ccf7-4127-a3fd-cab56d362f0d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.782s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kPyhpOjt" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3207af57-f0aa-4904-b469-02aa2e4fc139]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kPyhpOjt'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c89bd6-d494-4457-b5fe-c80d6bf01c05]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6490e8d9-4d4d-4fc4-a41b-691fe9a3df6d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:57:23 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:57:23 user nova-compute[72239]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)
Jul 31 14:57:23 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 14:57:23 user nova-compute[72239]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd (non-flash)
Jul 31 14:57:23 user nova-compute[72239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 (non-flash)
Jul 31 14:57:23 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:57:23 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:57:23 user nova-compute[72239]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)
Jul 31 14:57:23 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 14:57:23 user nova-compute[72239]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd (non-flash)
Jul 31 14:57:23 user nova-compute[72239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 (non-flash)
Jul 31 14:57:23 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.160s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] HCTL ('33', '0', '0', 0) found on session 32 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae183c7d-4360-40ed-89d3-fd6b3cd7c9fa]: (4, ('0 0 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Searching for a device in session 32 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kPyhpOjt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.183s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] <== connect_volume: return (184ms) {'type': 'block', 'scsi_wwn': '26331343864356530', 'path': '/dev/sdb'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331343864356530', 'path': '/dev/sdb'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:55:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-714375545',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-714375545',id=28,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:55:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d8281237f9c417a9685e55826911e1b',ramdisk_id='',reservation_id='r-a0hy000h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-148379254',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:55:47Z,user_data=None,user_id='94ab9298205143d489f678b28be5b085',uuid=e6f6d85d-ffa0-4d72-b521-e855afa23a09,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c7f836e-274b-4a20-915a-d28d7e70d2a3", "address": "fa:16:3e:78:53:e9", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "vif_mac": "fa:16:3e:78:53:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7f836e-27", "ovs_interfaceid": "5c7f836e-274b-4a20-915a-d28d7e70d2a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Converting VIF {"id": "5c7f836e-274b-4a20-915a-d28d7e70d2a3", "address": "fa:16:3e:78:53:e9", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "vif_mac": "fa:16:3e:78:53:e9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7f836e-27", "ovs_interfaceid": "5c7f836e-274b-4a20-915a-d28d7e70d2a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:53:e9,bridge_name='br-int',has_traffic_filtering=True,id=5c7f836e-274b-4a20-915a-d28d7e70d2a3,network=Network(172fb80f-4bbe-4706-91cf-60540fbceb2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c7f836e-27') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.objects.instance [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lazy-loading 'pci_devices' on Instance uuid e6f6d85d-ffa0-4d72-b521-e855afa23a09 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:57:23 user nova-compute[72239]:   <uuid>e6f6d85d-ffa0-4d72-b521-e855afa23a09</uuid>
Jul 31 14:57:23 user nova-compute[72239]:   <name>instance-0000001c</name>
Jul 31 14:57:23 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:57:23 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:57:23 user nova-compute[72239]:   <metadata>
Jul 31 14:57:23 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:57:23 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:57:23 user nova-compute[72239]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-714375545</nova:name>
Jul 31 14:57:23 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:57:23</nova:creationTime>
Jul 31 14:57:23 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:57:23 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:57:23 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:57:23 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:57:23 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:57:23 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:57:23 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:57:23 user nova-compute[72239]:       <nova:owner>
Jul 31 14:57:23 user nova-compute[72239]:         <nova:user uuid="94ab9298205143d489f678b28be5b085">tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member</nova:user>
Jul 31 14:57:23 user nova-compute[72239]:         <nova:project uuid="1d8281237f9c417a9685e55826911e1b">tempest-ServerBootFromVolumeStableRescueTest-148379254</nova:project>
Jul 31 14:57:23 user nova-compute[72239]:       </nova:owner>
Jul 31 14:57:23 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:57:23 user nova-compute[72239]:       <nova:ports>
Jul 31 14:57:23 user nova-compute[72239]:         <nova:port uuid="5c7f836e-274b-4a20-915a-d28d7e70d2a3">
Jul 31 14:57:23 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 31 14:57:23 user nova-compute[72239]:         </nova:port>
Jul 31 14:57:23 user nova-compute[72239]:       </nova:ports>
Jul 31 14:57:23 user nova-compute[72239]:     </nova:instance>
Jul 31 14:57:23 user nova-compute[72239]:   </metadata>
Jul 31 14:57:23 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:57:23 user nova-compute[72239]:     <system>
Jul 31 14:57:23 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:57:23 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:57:23 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:57:23 user nova-compute[72239]:       <entry name="serial">e6f6d85d-ffa0-4d72-b521-e855afa23a09</entry>
Jul 31 14:57:23 user nova-compute[72239]:       <entry name="uuid">e6f6d85d-ffa0-4d72-b521-e855afa23a09</entry>
Jul 31 14:57:23 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:57:23 user nova-compute[72239]:     </system>
Jul 31 14:57:23 user nova-compute[72239]:   </sysinfo>
Jul 31 14:57:23 user nova-compute[72239]:   <os>
Jul 31 14:57:23 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:57:23 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:57:23 user nova-compute[72239]:   </os>
Jul 31 14:57:23 user nova-compute[72239]:   <features>
Jul 31 14:57:23 user nova-compute[72239]:     <acpi/>
Jul 31 14:57:23 user nova-compute[72239]:     <apic/>
Jul 31 14:57:23 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:57:23 user nova-compute[72239]:   </features>
Jul 31 14:57:23 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:57:23 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:57:23 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:57:23 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:57:23 user nova-compute[72239]:   </clock>
Jul 31 14:57:23 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:57:23 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:57:23 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:57:23 user nova-compute[72239]:   </cpu>
Jul 31 14:57:23 user nova-compute[72239]:   <devices>
Jul 31 14:57:23 user nova-compute[72239]:     <disk type="block" device="disk">
Jul 31 14:57:23 user nova-compute[72239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:57:23 user nova-compute[72239]:       <source dev="/dev/sdb"/>
Jul 31 14:57:23 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:57:23 user nova-compute[72239]:       <serial>084e3707-fde6-425e-bb74-cc8b96e427ae</serial>
Jul 31 14:57:23 user nova-compute[72239]:     </disk>
Jul 31 14:57:23 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:57:23 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:57:23 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/e6f6d85d-ffa0-4d72-b521-e855afa23a09/disk.rescue"/>
Jul 31 14:57:23 user nova-compute[72239]:       <target dev="vdb" bus="virtio"/>
Jul 31 14:57:23 user nova-compute[72239]:       <boot order="1"/>
Jul 31 14:57:23 user nova-compute[72239]:     </disk>
Jul 31 14:57:23 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:57:23 user nova-compute[72239]:       <mac address="fa:16:3e:78:53:e9"/>
Jul 31 14:57:23 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:57:23 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:57:23 user nova-compute[72239]:       <target dev="tap5c7f836e-27"/>
Jul 31 14:57:23 user nova-compute[72239]:     </interface>
Jul 31 14:57:23 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:57:23 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/e6f6d85d-ffa0-4d72-b521-e855afa23a09/console.log" append="off"/>
Jul 31 14:57:23 user nova-compute[72239]:     </serial>
Jul 31 14:57:23 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:57:23 user nova-compute[72239]:     <video>
Jul 31 14:57:23 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:57:23 user nova-compute[72239]:     </video>
Jul 31 14:57:23 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:57:23 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:57:23 user nova-compute[72239]:     </rng>
Jul 31 14:57:23 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:57:23 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:57:23 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:57:23 user nova-compute[72239]:     </memballoon>
Jul 31 14:57:23 user nova-compute[72239]:   </devices>
Jul 31 14:57:23 user nova-compute[72239]: </domain>
Jul 31 14:57:23 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:57:23 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Instance destroyed successfully.
Jul 31 14:57:23 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:57:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] No VIF found with MAC fa:16:3e:78:53:e9, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:57:24 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-493ecca5-c8bf-4206-82b6-708a53ffc4c3 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "14653984-6c32-4ddd-bc0b-203a670c2b4e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:57:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-493ecca5-c8bf-4206-82b6-708a53ffc4c3 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "14653984-6c32-4ddd-bc0b-203a670c2b4e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:57:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:25 user nova-compute[72239]: INFO nova.compute.manager [None req-493ecca5-c8bf-4206-82b6-708a53ffc4c3 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Detaching volume b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd
Jul 31 14:57:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:25 user nova-compute[72239]: INFO nova.virt.block_device [None req-493ecca5-c8bf-4206-82b6-708a53ffc4c3 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Attempting to driver detach volume b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd from mountpoint /dev/vdc
Jul 31 14:57:25 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-493ecca5-c8bf-4206-82b6-708a53ffc4c3 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Attempting to detach device vdc from instance 14653984-6c32-4ddd-bc0b-203a670c2b4e from the persistent domain config. {{(pid=72239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 14:57:25 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-493ecca5-c8bf-4206-82b6-708a53ffc4c3 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 14:57:25 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:57:25 user nova-compute[72239]:   <source dev="/dev/sdf"/>
Jul 31 14:57:25 user nova-compute[72239]:   <target dev="vdc" bus="virtio"/>
Jul 31 14:57:25 user nova-compute[72239]:   <serial>b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd</serial>
Jul 31 14:57:25 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 31 14:57:25 user nova-compute[72239]: </disk>
Jul 31 14:57:25 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 14:57:25 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-493ecca5-c8bf-4206-82b6-708a53ffc4c3 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Successfully detached device vdc from instance 14653984-6c32-4ddd-bc0b-203a670c2b4e from the persistent domain config.
Jul 31 14:57:25 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-493ecca5-c8bf-4206-82b6-708a53ffc4c3 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 14653984-6c32-4ddd-bc0b-203a670c2b4e from the live domain config. {{(pid=72239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 14:57:25 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-493ecca5-c8bf-4206-82b6-708a53ffc4c3 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 14:57:25 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:57:25 user nova-compute[72239]:   <source dev="/dev/sdf"/>
Jul 31 14:57:25 user nova-compute[72239]:   <target dev="vdc" bus="virtio"/>
Jul 31 14:57:25 user nova-compute[72239]:   <serial>b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd</serial>
Jul 31 14:57:25 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 31 14:57:25 user nova-compute[72239]: </disk>
Jul 31 14:57:25 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 14:57:25 user nova-compute[72239]: DEBUG nova.compute.manager [req-499ce6e1-25b2-47b1-a12a-a7aa75dc1058 req-c453d828-03aa-42d1-a5bc-9253359eaf09 service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Received event network-vif-plugged-5c7f836e-274b-4a20-915a-d28d7e70d2a3 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:57:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-499ce6e1-25b2-47b1-a12a-a7aa75dc1058 req-c453d828-03aa-42d1-a5bc-9253359eaf09 service nova] Acquiring lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:57:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-499ce6e1-25b2-47b1-a12a-a7aa75dc1058 req-c453d828-03aa-42d1-a5bc-9253359eaf09 service nova] Lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:57:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-499ce6e1-25b2-47b1-a12a-a7aa75dc1058 req-c453d828-03aa-42d1-a5bc-9253359eaf09 service nova] Lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:57:25 user nova-compute[72239]: DEBUG nova.compute.manager [req-499ce6e1-25b2-47b1-a12a-a7aa75dc1058 req-c453d828-03aa-42d1-a5bc-9253359eaf09 service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] No waiting events found dispatching network-vif-plugged-5c7f836e-274b-4a20-915a-d28d7e70d2a3 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:57:25 user nova-compute[72239]: WARNING nova.compute.manager [req-499ce6e1-25b2-47b1-a12a-a7aa75dc1058 req-c453d828-03aa-42d1-a5bc-9253359eaf09 service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Received unexpected event network-vif-plugged-5c7f836e-274b-4a20-915a-d28d7e70d2a3 for instance with vm_state active and task_state rescuing.
Jul 31 14:57:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Received event <DeviceRemovedEvent: 1690815446.1967242, 14653984-6c32-4ddd-bc0b-203a670c2b4e => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72239) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-493ecca5-c8bf-4206-82b6-708a53ffc4c3 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 14653984-6c32-4ddd-bc0b-203a670c2b4e {{(pid=72239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 14:57:26 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-493ecca5-c8bf-4206-82b6-708a53ffc4c3 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Successfully detached device vdc from instance 14653984-6c32-4ddd-bc0b-203a670c2b4e from the live domain config.
Jul 31 14:57:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-493ecca5-c8bf-4206-82b6-708a53ffc4c3 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-493ecca5-c8bf-4206-82b6-708a53ffc4c3 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lVoGimpb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:57:26 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-493ecca5-c8bf-4206-82b6-708a53ffc4c3 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:57:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-493ecca5-c8bf-4206-82b6-708a53ffc4c3 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-493ecca5-c8bf-4206-82b6-708a53ffc4c3 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-493ecca5-c8bf-4206-82b6-708a53ffc4c3 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[95b7d4f3-0e9f-4ed1-b4bd-8fc27b35fbbd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[51467c7d-d347-4081-8e30-401dff327b08]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-493ecca5-c8bf-4206-82b6-708a53ffc4c3 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:57:26 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:57:26 user nova-compute[72239]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)
Jul 31 14:57:26 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 14:57:26 user nova-compute[72239]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd (non-flash)
Jul 31 14:57:26 user nova-compute[72239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 (non-flash)
Jul 31 14:57:26 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-493ecca5-c8bf-4206-82b6-708a53ffc4c3 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:57:26 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:57:26 user nova-compute[72239]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)
Jul 31 14:57:26 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 14:57:26 user nova-compute[72239]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd (non-flash)
Jul 31 14:57:26 user nova-compute[72239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 (non-flash)
Jul 31 14:57:26 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-493ecca5-c8bf-4206-82b6-708a53ffc4c3 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4118216170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd'): ({'sdf'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-493ecca5-c8bf-4206-82b6-708a53ffc4c3 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Removing single pathed devices sdf {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1496b8-ce7f-45da-b881-5eacdedae283]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[afffd8b1-0ee8-4b22-9172-2135c67a21a6]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-493ecca5-c8bf-4206-82b6-708a53ffc4c3 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Flushing IO for device /dev/sdf {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a585b9-3502-4e7b-92ad-6d8a995aa84d]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-493ecca5-c8bf-4206-82b6-708a53ffc4c3 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.061s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a970ee00-5ea9-43d0-a780-79a7f4c46243]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-493ecca5-c8bf-4206-82b6-708a53ffc4c3 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-493ecca5-c8bf-4206-82b6-708a53ffc4c3 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] SCSI volumes sdf have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-493ecca5-c8bf-4206-82b6-708a53ffc4c3 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.073s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d0db61-c436-41bb-a8e7-c1a56cefd7e1]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-493ecca5-c8bf-4206-82b6-708a53ffc4c3 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd -p 172.16.0.220:3260 --logout" returned: 0 in 0.296s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7c1d63-c7b8-4cd0-beed-7bde80446ffb]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-493ecca5-c8bf-4206-82b6-708a53ffc4c3 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd, portal: 172.16.0.220,3260]
Jul 31 14:57:26 user nova-compute[72239]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd, portal: 172.16.0.220,3260] successful.
Jul 31 14:57:26 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b1aff3d2-7ab0-4f14-a533-bd7f2087d3bd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[557c6170-3f18-4af2-ae4b-94aaa3a842d1]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-493ecca5-c8bf-4206-82b6-708a53ffc4c3 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-493ecca5-c8bf-4206-82b6-708a53ffc4c3 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.645s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-493ecca5-c8bf-4206-82b6-708a53ffc4c3 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] <== disconnect_volume: return (647ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:57:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-493ecca5-c8bf-4206-82b6-708a53ffc4c3 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 14:57:27 user nova-compute[72239]: DEBUG nova.compute.manager [req-4e4c0fa0-d2ad-46e7-a2bf-01ca0d447c54 req-76d15152-ab42-4039-94e9-28732be2548a service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Received event network-vif-plugged-5c7f836e-274b-4a20-915a-d28d7e70d2a3 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:57:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-4e4c0fa0-d2ad-46e7-a2bf-01ca0d447c54 req-76d15152-ab42-4039-94e9-28732be2548a service nova] Acquiring lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:57:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-4e4c0fa0-d2ad-46e7-a2bf-01ca0d447c54 req-76d15152-ab42-4039-94e9-28732be2548a service nova] Lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:57:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-4e4c0fa0-d2ad-46e7-a2bf-01ca0d447c54 req-76d15152-ab42-4039-94e9-28732be2548a service nova] Lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:57:27 user nova-compute[72239]: DEBUG nova.compute.manager [req-4e4c0fa0-d2ad-46e7-a2bf-01ca0d447c54 req-76d15152-ab42-4039-94e9-28732be2548a service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] No waiting events found dispatching network-vif-plugged-5c7f836e-274b-4a20-915a-d28d7e70d2a3 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:57:27 user nova-compute[72239]: WARNING nova.compute.manager [req-4e4c0fa0-d2ad-46e7-a2bf-01ca0d447c54 req-76d15152-ab42-4039-94e9-28732be2548a service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Received unexpected event network-vif-plugged-5c7f836e-274b-4a20-915a-d28d7e70d2a3 for instance with vm_state active and task_state rescuing.
Jul 31 14:57:27 user nova-compute[72239]: DEBUG nova.objects.instance [None req-493ecca5-c8bf-4206-82b6-708a53ffc4c3 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lazy-loading 'flavor' on Instance uuid 14653984-6c32-4ddd-bc0b-203a670c2b4e {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:57:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-493ecca5-c8bf-4206-82b6-708a53ffc4c3 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "14653984-6c32-4ddd-bc0b-203a670c2b4e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.527s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:57:28 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Removed pending event for e6f6d85d-ffa0-4d72-b521-e855afa23a09 due to event {{(pid=72239) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 14:57:28 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815448.4658272, e6f6d85d-ffa0-4d72-b521-e855afa23a09 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:57:28 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] VM Resumed (Lifecycle Event)
Jul 31 14:57:28 user nova-compute[72239]: DEBUG nova.compute.manager [None req-c7054317-3a38-4edf-8eae-d39f257f5721 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:57:28 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:57:28 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:57:28 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 31 14:57:28 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815448.4711733, e6f6d85d-ffa0-4d72-b521-e855afa23a09 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:57:28 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] VM Started (Lifecycle Event)
Jul 31 14:57:28 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:57:28 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:57:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:33 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:38 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-abc9b8f3-55bd-48da-9289-7fa1a15cfeb5 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "87dd3b4b-c511-4784-acf9-ad21534c8337" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:57:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-abc9b8f3-55bd-48da-9289-7fa1a15cfeb5 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "87dd3b4b-c511-4784-acf9-ad21534c8337" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:57:41 user nova-compute[72239]: INFO nova.compute.manager [None req-abc9b8f3-55bd-48da-9289-7fa1a15cfeb5 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Detaching volume e94914bb-15fa-4c61-9593-212f11b63b2b
Jul 31 14:57:41 user nova-compute[72239]: INFO nova.virt.block_device [None req-abc9b8f3-55bd-48da-9289-7fa1a15cfeb5 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Attempting to driver detach volume e94914bb-15fa-4c61-9593-212f11b63b2b from mountpoint /dev/vdb
Jul 31 14:57:41 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-abc9b8f3-55bd-48da-9289-7fa1a15cfeb5 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Attempting to detach device vdb from instance 87dd3b4b-c511-4784-acf9-ad21534c8337 from the persistent domain config. {{(pid=72239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 14:57:41 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-abc9b8f3-55bd-48da-9289-7fa1a15cfeb5 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 14:57:41 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:57:41 user nova-compute[72239]:   <source dev="/dev/sde"/>
Jul 31 14:57:41 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:57:41 user nova-compute[72239]:   <serial>e94914bb-15fa-4c61-9593-212f11b63b2b</serial>
Jul 31 14:57:41 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 14:57:41 user nova-compute[72239]: </disk>
Jul 31 14:57:41 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 14:57:41 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-abc9b8f3-55bd-48da-9289-7fa1a15cfeb5 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Successfully detached device vdb from instance 87dd3b4b-c511-4784-acf9-ad21534c8337 from the persistent domain config.
Jul 31 14:57:41 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-abc9b8f3-55bd-48da-9289-7fa1a15cfeb5 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 87dd3b4b-c511-4784-acf9-ad21534c8337 from the live domain config. {{(pid=72239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 14:57:41 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-abc9b8f3-55bd-48da-9289-7fa1a15cfeb5 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 14:57:41 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:57:41 user nova-compute[72239]:   <source dev="/dev/sde"/>
Jul 31 14:57:41 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:57:41 user nova-compute[72239]:   <serial>e94914bb-15fa-4c61-9593-212f11b63b2b</serial>
Jul 31 14:57:41 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 14:57:41 user nova-compute[72239]: </disk>
Jul 31 14:57:41 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 14:57:41 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Received event <DeviceRemovedEvent: 1690815461.8457298, 87dd3b4b-c511-4784-acf9-ad21534c8337 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72239) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 14:57:41 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-abc9b8f3-55bd-48da-9289-7fa1a15cfeb5 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 87dd3b4b-c511-4784-acf9-ad21534c8337 {{(pid=72239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 14:57:41 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-abc9b8f3-55bd-48da-9289-7fa1a15cfeb5 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Successfully detached device vdb from instance 87dd3b4b-c511-4784-acf9-ad21534c8337 from the live domain config.
Jul 31 14:57:41 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abc9b8f3-55bd-48da-9289-7fa1a15cfeb5 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 14:57:41 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-abc9b8f3-55bd-48da-9289-7fa1a15cfeb5 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wLCVSXYM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:57:41 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-abc9b8f3-55bd-48da-9289-7fa1a15cfeb5 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:57:41 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-abc9b8f3-55bd-48da-9289-7fa1a15cfeb5 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:57:41 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-abc9b8f3-55bd-48da-9289-7fa1a15cfeb5 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:57:41 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-abc9b8f3-55bd-48da-9289-7fa1a15cfeb5 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 14:57:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:41 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f19a10-3e4a-47b3-967b-47110991f8fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:57:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:41 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ad6709-b6c6-4cde-938a-6cd5918a491b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:57:41 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-abc9b8f3-55bd-48da-9289-7fa1a15cfeb5 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:57:41 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:57:41 user nova-compute[72239]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)
Jul 31 14:57:41 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 14:57:41 user nova-compute[72239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 (non-flash)
Jul 31 14:57:41 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:57:41 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-abc9b8f3-55bd-48da-9289-7fa1a15cfeb5 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:57:41 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:57:41 user nova-compute[72239]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b (non-flash)
Jul 31 14:57:41 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 14:57:41 user nova-compute[72239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 (non-flash)
Jul 31 14:57:41 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:57:41 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-abc9b8f3-55bd-48da-9289-7fa1a15cfeb5 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41204a7eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b'): ({'sde'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 14:57:41 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-abc9b8f3-55bd-48da-9289-7fa1a15cfeb5 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Removing single pathed devices sde {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 14:57:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:41 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4a756b-55fb-42ab-be42-b6ffb766b152]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:57:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:41 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b1cb8b-ef29-4b44-acc1-b2cce84fd4e6]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:57:41 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-abc9b8f3-55bd-48da-9289-7fa1a15cfeb5 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Flushing IO for device /dev/sde {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 14:57:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:41 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e95ce19-1f90-4ea7-b3fd-fddc9e2eb754]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:57:41 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-abc9b8f3-55bd-48da-9289-7fa1a15cfeb5 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 14:57:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7e6991-60de-4a76-967c-225891b26fb1]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:57:42 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-abc9b8f3-55bd-48da-9289-7fa1a15cfeb5 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 14:57:42 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-abc9b8f3-55bd-48da-9289-7fa1a15cfeb5 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] SCSI volumes sde have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 14:57:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-abc9b8f3-55bd-48da-9289-7fa1a15cfeb5 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 14:57:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6607e9-40dd-42c4-ae0f-2576ee10d45b]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:57:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-abc9b8f3-55bd-48da-9289-7fa1a15cfeb5 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:57:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[72542df6-75eb-47e9-8fbc-60b283ab4d1a]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:57:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-abc9b8f3-55bd-48da-9289-7fa1a15cfeb5 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b, portal: 172.16.0.220,3260]
Jul 31 14:57:42 user nova-compute[72239]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b, portal: 172.16.0.220,3260] successful.
Jul 31 14:57:42 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:57:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e94914bb-15fa-4c61-9593-212f11b63b2b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[456925d9-5c81-4390-af8e-59348137b9ff]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:57:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-abc9b8f3-55bd-48da-9289-7fa1a15cfeb5 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:57:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-abc9b8f3-55bd-48da-9289-7fa1a15cfeb5 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:57:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-abc9b8f3-55bd-48da-9289-7fa1a15cfeb5 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] <== disconnect_volume: return (310ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:57:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-abc9b8f3-55bd-48da-9289-7fa1a15cfeb5 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 14:57:42 user nova-compute[72239]: DEBUG nova.objects.instance [None req-abc9b8f3-55bd-48da-9289-7fa1a15cfeb5 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lazy-loading 'flavor' on Instance uuid 87dd3b4b-c511-4784-acf9-ad21534c8337 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:57:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-abc9b8f3-55bd-48da-9289-7fa1a15cfeb5 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "87dd3b4b-c511-4784-acf9-ad21534c8337" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.712s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:57:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "3d70608b-fc54-4178-9aa6-98ca6198a37b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:57:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "3d70608b-fc54-4178-9aa6-98ca6198a37b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:57:51 user nova-compute[72239]: DEBUG nova.compute.manager [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 14:57:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:57:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:57:51 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 14:57:51 user nova-compute[72239]: INFO nova.compute.claims [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Claim successful on node user
Jul 31 14:57:52 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:57:52 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:57:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.618s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:57:52 user nova-compute[72239]: DEBUG nova.compute.manager [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 14:57:52 user nova-compute[72239]: DEBUG nova.compute.manager [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 14:57:52 user nova-compute[72239]: DEBUG nova.network.neutron [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 14:57:52 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 14:57:52 user nova-compute[72239]: DEBUG nova.compute.manager [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 14:57:52 user nova-compute[72239]: DEBUG nova.policy [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd0e2796894b249cc868a888fac759983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217b0eef1c154602850f4cf2d81b7ead', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 14:57:52 user nova-compute[72239]: INFO nova.virt.block_device [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Booting with volume 911a7119-d076-4773-9b93-ec934911c468 at /dev/vda
Jul 31 14:57:52 user nova-compute[72239]: DEBUG os_brick.utils [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:57:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:52 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a299303-396a-459b-8eb9-b83488dd9bdb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:57:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:52 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8d37c9-1ac5-4dc4-be62-862f6dd70b4a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:57:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.038s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:57:52 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0169ae81-3e48-4317-824a-0cec299bde3c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:57:52 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[72bb4c93-6e84-4404-b1a7-b135630dfb79]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:57:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:57:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 14:57:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:57:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:57:52 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 14:57:52 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b251233-da25-4f21-92e1-420dfa47b903]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:57:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 14:57:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 14:57:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 14:57:52 user nova-compute[72239]: DEBUG os_brick.utils [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:57:52 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Updating existing volume attachment record: 65e3a9b4-92ad-42fd-9246-09f1f0197d76 {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 14:57:53 user nova-compute[72239]: DEBUG nova.network.neutron [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Successfully created port: d115f55c-2a02-4b41-88b0-0922039e58ba {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:57:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:53 user nova-compute[72239]: DEBUG nova.network.neutron [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Successfully updated port: d115f55c-2a02-4b41-88b0-0922039e58ba {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:57:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "refresh_cache-3d70608b-fc54-4178-9aa6-98ca6198a37b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:57:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquired lock "refresh_cache-3d70608b-fc54-4178-9aa6-98ca6198a37b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:57:53 user nova-compute[72239]: DEBUG nova.network.neutron [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:57:53 user nova-compute[72239]: DEBUG nova.compute.manager [req-6331ba2e-d1d6-4404-bfc5-8da585f33918 req-030a1d95-ff2c-40f5-a069-7b9bd7d906e9 service nova] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Received event network-changed-d115f55c-2a02-4b41-88b0-0922039e58ba {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:57:53 user nova-compute[72239]: DEBUG nova.compute.manager [req-6331ba2e-d1d6-4404-bfc5-8da585f33918 req-030a1d95-ff2c-40f5-a069-7b9bd7d906e9 service nova] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Refreshing instance network info cache due to event network-changed-d115f55c-2a02-4b41-88b0-0922039e58ba. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:57:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-6331ba2e-d1d6-4404-bfc5-8da585f33918 req-030a1d95-ff2c-40f5-a069-7b9bd7d906e9 service nova] Acquiring lock "refresh_cache-3d70608b-fc54-4178-9aa6-98ca6198a37b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:57:53 user nova-compute[72239]: DEBUG nova.network.neutron [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:57:54 user nova-compute[72239]: DEBUG nova.network.neutron [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Updating instance_info_cache with network_info: [{"id": "d115f55c-2a02-4b41-88b0-0922039e58ba", "address": "fa:16:3e:15:91:63", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115f55c-2a", "ovs_interfaceid": "d115f55c-2a02-4b41-88b0-0922039e58ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:57:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Releasing lock "refresh_cache-3d70608b-fc54-4178-9aa6-98ca6198a37b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:57:54 user nova-compute[72239]: DEBUG nova.compute.manager [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Instance network_info: |[{"id": "d115f55c-2a02-4b41-88b0-0922039e58ba", "address": "fa:16:3e:15:91:63", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115f55c-2a", "ovs_interfaceid": "d115f55c-2a02-4b41-88b0-0922039e58ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 14:57:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-6331ba2e-d1d6-4404-bfc5-8da585f33918 req-030a1d95-ff2c-40f5-a069-7b9bd7d906e9 service nova] Acquired lock "refresh_cache-3d70608b-fc54-4178-9aa6-98ca6198a37b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:57:54 user nova-compute[72239]: DEBUG nova.network.neutron [req-6331ba2e-d1d6-4404-bfc5-8da585f33918 req-030a1d95-ff2c-40f5-a069-7b9bd7d906e9 service nova] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Refreshing network info cache for port d115f55c-2a02-4b41-88b0-0922039e58ba {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:57:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:54 user nova-compute[72239]: DEBUG nova.network.neutron [req-6331ba2e-d1d6-4404-bfc5-8da585f33918 req-030a1d95-ff2c-40f5-a069-7b9bd7d906e9 service nova] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Updated VIF entry in instance network info cache for port d115f55c-2a02-4b41-88b0-0922039e58ba. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:57:54 user nova-compute[72239]: DEBUG nova.network.neutron [req-6331ba2e-d1d6-4404-bfc5-8da585f33918 req-030a1d95-ff2c-40f5-a069-7b9bd7d906e9 service nova] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Updating instance_info_cache with network_info: [{"id": "d115f55c-2a02-4b41-88b0-0922039e58ba", "address": "fa:16:3e:15:91:63", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115f55c-2a", "ovs_interfaceid": "d115f55c-2a02-4b41-88b0-0922039e58ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:57:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-6331ba2e-d1d6-4404-bfc5-8da585f33918 req-030a1d95-ff2c-40f5-a069-7b9bd7d906e9 service nova] Releasing lock "refresh_cache-3d70608b-fc54-4178-9aa6-98ca6198a37b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:57:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:57:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG nova.compute.manager [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 14:58:00 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Creating image(s)
Jul 31 14:58:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Did not create local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Ensure instance console log exists: /opt/stack/data/nova/instances/3d70608b-fc54-4178-9aa6-98ca6198a37b/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Start _get_guest_xml network_info=[{"id": "d115f55c-2a02-4b41-88b0-0922039e58ba", "address": "fa:16:3e:15:91:63", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115f55c-2a", "ovs_interfaceid": "d115f55c-2a02-4b41-88b0-0922039e58ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '65e3a9b4-92ad-42fd-9246-09f1f0197d76', 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SEvDcOrt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3d70608b-fc54-4178-9aa6-98ca6198a37b', 'attached_at': '', 'detached_at': '', 'volume_id': '911a7119-d076-4773-9b93-ec934911c468', 'serial': '911a7119-d076-4773-9b93-ec934911c468'}, 'delete_on_termination': True, 'guest_format': None, 'volume_type': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:58:00 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:58:00 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:58:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SEvDcOrt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:58:00 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:58:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:58:00 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:58:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:58:00 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 14:58:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2851eda-4ac4-4d9d-b090-f6067690c2a5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 14:58:00 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dff0db2-a422-49f3-be62-92b7e00b6c44]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468] added
Jul 31 14:58:00 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d613ffe3-4ebd-417b-9da9-2e56ca4942d8]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd73a7d-b60a-488d-b607-21b50c776b31]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SEvDcOrt {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SEvDcOrt" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e24abc-79ab-4b88-a460-8702eb58afb2]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SEvDcOrt'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd848e9-6ffd-49c9-8f62-02c55681108e]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6bf917-52b0-4c27-9746-8052046ce4f8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:58:00 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:58:00 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 14:58:00 user nova-compute[72239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 (non-flash)
Jul 31 14:58:00 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:58:00 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:58:00 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 14:58:00 user nova-compute[72239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 (non-flash)
Jul 31 14:58:00 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:58:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:01 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[649375dd-7a81-43e2-84e3-a219728b4aa0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:01 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468, portal: 172.16.0.220,3260]
Jul 31 14:58:01 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468, portal: 172.16.0.220,3260] successful.
Jul 31 14:58:01 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:58:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:01 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[727c5b8a-0065-443b-bbf3-908953d25d36]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:01 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:58:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:01 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9e6cf6-c8b9-4bad-b6d0-fa901e25b492]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:01 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:58:01 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:58:01 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 14:58:01 user nova-compute[72239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 (non-flash)
Jul 31 14:58:01 user nova-compute[72239]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 14:58:01 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:58:01 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:58:01 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:58:01 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 14:58:01 user nova-compute[72239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 (non-flash)
Jul 31 14:58:01 user nova-compute[72239]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 14:58:01 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:58:01 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:58:01 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 14:58:01 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 14:58:01 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 14:58:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:01 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0c9c7c-7a8c-430a-8d46-7d47ff13aa39]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:01 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:58:01 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SEvDcOrt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 14:58:01 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:58:02 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:58:02 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23635636139393566', 'path': '/dev/sdc'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:58:02 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635636139393566', 'path': '/dev/sdc'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 14:58:02 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:57:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2050515265',display_name='tempest-ServerActionsTestOtherA-server-2050515265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2050515265',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcC0f3guhYTNzECKpfyNk4cXj6Y8F4GpucRwb/0EBaXIalClpDyM69s13M23SyVQiCvr0tglg8FRaf5C4ibRcE2Gd6CEj06wnsuSnTBc8jPOcwf8pDTnQMrdikVLzRidg==',key_name='tempest-keypair-538819016',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='217b0eef1c154602850f4cf2d81b7ead',ramdisk_id='',reservation_id='r-4t9012f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-456571617',owner_user_name='tempest-ServerActionsTestOtherA-456571617-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:57:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0e2796894b249cc868a888fac759983',uuid=3d70608b-fc54-4178-9aa6-98ca6198a37b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d115f55c-2a02-4b41-88b0-0922039e58ba", "address": "fa:16:3e:15:91:63", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115f55c-2a", "ovs_interfaceid": "d115f55c-2a02-4b41-88b0-0922039e58ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:58:02 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Converting VIF {"id": "d115f55c-2a02-4b41-88b0-0922039e58ba", "address": "fa:16:3e:15:91:63", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115f55c-2a", "ovs_interfaceid": "d115f55c-2a02-4b41-88b0-0922039e58ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:58:02 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:91:63,bridge_name='br-int',has_traffic_filtering=True,id=d115f55c-2a02-4b41-88b0-0922039e58ba,network=Network(6d954fa8-21ae-4438-b6c0-6ae7fb37718c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd115f55c-2a') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:58:02 user nova-compute[72239]: DEBUG nova.objects.instance [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d70608b-fc54-4178-9aa6-98ca6198a37b {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:58:02 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:58:02 user nova-compute[72239]:   <uuid>3d70608b-fc54-4178-9aa6-98ca6198a37b</uuid>
Jul 31 14:58:02 user nova-compute[72239]:   <name>instance-0000001f</name>
Jul 31 14:58:02 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:58:02 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:58:02 user nova-compute[72239]:   <metadata>
Jul 31 14:58:02 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:58:02 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:58:02 user nova-compute[72239]:       <nova:name>tempest-ServerActionsTestOtherA-server-2050515265</nova:name>
Jul 31 14:58:02 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:58:00</nova:creationTime>
Jul 31 14:58:02 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:58:02 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:58:02 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:58:02 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:58:02 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:58:02 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:58:02 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:58:02 user nova-compute[72239]:       <nova:owner>
Jul 31 14:58:02 user nova-compute[72239]:         <nova:user uuid="d0e2796894b249cc868a888fac759983">tempest-ServerActionsTestOtherA-456571617-project-member</nova:user>
Jul 31 14:58:02 user nova-compute[72239]:         <nova:project uuid="217b0eef1c154602850f4cf2d81b7ead">tempest-ServerActionsTestOtherA-456571617</nova:project>
Jul 31 14:58:02 user nova-compute[72239]:       </nova:owner>
Jul 31 14:58:02 user nova-compute[72239]:       <nova:ports>
Jul 31 14:58:02 user nova-compute[72239]:         <nova:port uuid="d115f55c-2a02-4b41-88b0-0922039e58ba">
Jul 31 14:58:02 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 31 14:58:02 user nova-compute[72239]:         </nova:port>
Jul 31 14:58:02 user nova-compute[72239]:       </nova:ports>
Jul 31 14:58:02 user nova-compute[72239]:     </nova:instance>
Jul 31 14:58:02 user nova-compute[72239]:   </metadata>
Jul 31 14:58:02 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:58:02 user nova-compute[72239]:     <system>
Jul 31 14:58:02 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:58:02 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:58:02 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:58:02 user nova-compute[72239]:       <entry name="serial">3d70608b-fc54-4178-9aa6-98ca6198a37b</entry>
Jul 31 14:58:02 user nova-compute[72239]:       <entry name="uuid">3d70608b-fc54-4178-9aa6-98ca6198a37b</entry>
Jul 31 14:58:02 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:58:02 user nova-compute[72239]:     </system>
Jul 31 14:58:02 user nova-compute[72239]:   </sysinfo>
Jul 31 14:58:02 user nova-compute[72239]:   <os>
Jul 31 14:58:02 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:58:02 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:58:02 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:58:02 user nova-compute[72239]:   </os>
Jul 31 14:58:02 user nova-compute[72239]:   <features>
Jul 31 14:58:02 user nova-compute[72239]:     <acpi/>
Jul 31 14:58:02 user nova-compute[72239]:     <apic/>
Jul 31 14:58:02 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:58:02 user nova-compute[72239]:   </features>
Jul 31 14:58:02 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:58:02 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:58:02 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:58:02 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:58:02 user nova-compute[72239]:   </clock>
Jul 31 14:58:02 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:58:02 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:58:02 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:58:02 user nova-compute[72239]:   </cpu>
Jul 31 14:58:02 user nova-compute[72239]:   <devices>
Jul 31 14:58:02 user nova-compute[72239]:     <disk type="block" device="disk">
Jul 31 14:58:02 user nova-compute[72239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:58:02 user nova-compute[72239]:       <source dev="/dev/sdc"/>
Jul 31 14:58:02 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:58:02 user nova-compute[72239]:       <serial>911a7119-d076-4773-9b93-ec934911c468</serial>
Jul 31 14:58:02 user nova-compute[72239]:     </disk>
Jul 31 14:58:02 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:58:02 user nova-compute[72239]:       <mac address="fa:16:3e:15:91:63"/>
Jul 31 14:58:02 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:58:02 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:58:02 user nova-compute[72239]:       <target dev="tapd115f55c-2a"/>
Jul 31 14:58:02 user nova-compute[72239]:     </interface>
Jul 31 14:58:02 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:58:02 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/3d70608b-fc54-4178-9aa6-98ca6198a37b/console.log" append="off"/>
Jul 31 14:58:02 user nova-compute[72239]:     </serial>
Jul 31 14:58:02 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:58:02 user nova-compute[72239]:     <video>
Jul 31 14:58:02 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:58:02 user nova-compute[72239]:     </video>
Jul 31 14:58:02 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:58:02 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:58:02 user nova-compute[72239]:     </rng>
Jul 31 14:58:02 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:58:02 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:58:02 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:58:02 user nova-compute[72239]:     </memballoon>
Jul 31 14:58:02 user nova-compute[72239]:   </devices>
Jul 31 14:58:02 user nova-compute[72239]: </domain>
Jul 31 14:58:02 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:58:02 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:57:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2050515265',display_name='tempest-ServerActionsTestOtherA-server-2050515265',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2050515265',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcC0f3guhYTNzECKpfyNk4cXj6Y8F4GpucRwb/0EBaXIalClpDyM69s13M23SyVQiCvr0tglg8FRaf5C4ibRcE2Gd6CEj06wnsuSnTBc8jPOcwf8pDTnQMrdikVLzRidg==',key_name='tempest-keypair-538819016',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='217b0eef1c154602850f4cf2d81b7ead',ramdisk_id='',reservation_id='r-4t9012f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-456571617',owner_user_name='tempest-ServerActionsTestOtherA-456571617-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:57:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0e2796894b249cc868a888fac759983',uuid=3d70608b-fc54-4178-9aa6-98ca6198a37b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d115f55c-2a02-4b41-88b0-0922039e58ba", "address": "fa:16:3e:15:91:63", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115f55c-2a", "ovs_interfaceid": "d115f55c-2a02-4b41-88b0-0922039e58ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:58:02 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Converting VIF {"id": "d115f55c-2a02-4b41-88b0-0922039e58ba", "address": "fa:16:3e:15:91:63", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115f55c-2a", "ovs_interfaceid": "d115f55c-2a02-4b41-88b0-0922039e58ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:58:02 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:91:63,bridge_name='br-int',has_traffic_filtering=True,id=d115f55c-2a02-4b41-88b0-0922039e58ba,network=Network(6d954fa8-21ae-4438-b6c0-6ae7fb37718c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd115f55c-2a') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:58:02 user nova-compute[72239]: DEBUG os_vif [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:91:63,bridge_name='br-int',has_traffic_filtering=True,id=d115f55c-2a02-4b41-88b0-0922039e58ba,network=Network(6d954fa8-21ae-4438-b6c0-6ae7fb37718c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd115f55c-2a') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:58:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:58:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:58:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd115f55c-2a, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:58:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd115f55c-2a, col_values=(('external_ids', {'iface-id': 'd115f55c-2a02-4b41-88b0-0922039e58ba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:91:63', 'vm-uuid': '3d70608b-fc54-4178-9aa6-98ca6198a37b'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:58:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:58:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:02 user nova-compute[72239]: INFO os_vif [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:91:63,bridge_name='br-int',has_traffic_filtering=True,id=d115f55c-2a02-4b41-88b0-0922039e58ba,network=Network(6d954fa8-21ae-4438-b6c0-6ae7fb37718c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd115f55c-2a')
Jul 31 14:58:02 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:58:02 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] No VIF found with MAC fa:16:3e:15:91:63, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:58:03 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:58:03 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:03 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:03 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:03 user nova-compute[72239]: DEBUG nova.compute.manager [req-43f5f5df-1ce8-45f4-b4be-f6029dc8ecf2 req-cd17a6de-7960-4d38-88e0-3cdfe6f0e6d9 service nova] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Received event network-changed-b00e3e0f-7501-4350-a065-d15b1d9e760a {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:58:03 user nova-compute[72239]: DEBUG nova.compute.manager [req-43f5f5df-1ce8-45f4-b4be-f6029dc8ecf2 req-cd17a6de-7960-4d38-88e0-3cdfe6f0e6d9 service nova] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Refreshing instance network info cache due to event network-changed-b00e3e0f-7501-4350-a065-d15b1d9e760a. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:58:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-43f5f5df-1ce8-45f4-b4be-f6029dc8ecf2 req-cd17a6de-7960-4d38-88e0-3cdfe6f0e6d9 service nova] Acquiring lock "refresh_cache-12c719bf-b770-4e41-b1f4-314eed1180c3" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:58:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-43f5f5df-1ce8-45f4-b4be-f6029dc8ecf2 req-cd17a6de-7960-4d38-88e0-3cdfe6f0e6d9 service nova] Acquired lock "refresh_cache-12c719bf-b770-4e41-b1f4-314eed1180c3" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:58:03 user nova-compute[72239]: DEBUG nova.network.neutron [req-43f5f5df-1ce8-45f4-b4be-f6029dc8ecf2 req-cd17a6de-7960-4d38-88e0-3cdfe6f0e6d9 service nova] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Refreshing network info cache for port b00e3e0f-7501-4350-a065-d15b1d9e760a {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:58:03 user nova-compute[72239]: DEBUG nova.compute.manager [req-7ca97565-b772-4302-bd53-bfef51deb9f2 req-4fbff948-b6af-42ab-8082-d07230d8ada8 service nova] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Received event network-vif-plugged-d115f55c-2a02-4b41-88b0-0922039e58ba {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:58:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7ca97565-b772-4302-bd53-bfef51deb9f2 req-4fbff948-b6af-42ab-8082-d07230d8ada8 service nova] Acquiring lock "3d70608b-fc54-4178-9aa6-98ca6198a37b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:58:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7ca97565-b772-4302-bd53-bfef51deb9f2 req-4fbff948-b6af-42ab-8082-d07230d8ada8 service nova] Lock "3d70608b-fc54-4178-9aa6-98ca6198a37b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:58:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7ca97565-b772-4302-bd53-bfef51deb9f2 req-4fbff948-b6af-42ab-8082-d07230d8ada8 service nova] Lock "3d70608b-fc54-4178-9aa6-98ca6198a37b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:58:03 user nova-compute[72239]: DEBUG nova.compute.manager [req-7ca97565-b772-4302-bd53-bfef51deb9f2 req-4fbff948-b6af-42ab-8082-d07230d8ada8 service nova] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] No waiting events found dispatching network-vif-plugged-d115f55c-2a02-4b41-88b0-0922039e58ba {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:58:03 user nova-compute[72239]: WARNING nova.compute.manager [req-7ca97565-b772-4302-bd53-bfef51deb9f2 req-4fbff948-b6af-42ab-8082-d07230d8ada8 service nova] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Received unexpected event network-vif-plugged-d115f55c-2a02-4b41-88b0-0922039e58ba for instance with vm_state building and task_state spawning.
Jul 31 14:58:03 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:03 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:04 user nova-compute[72239]: DEBUG nova.network.neutron [req-43f5f5df-1ce8-45f4-b4be-f6029dc8ecf2 req-cd17a6de-7960-4d38-88e0-3cdfe6f0e6d9 service nova] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Updated VIF entry in instance network info cache for port b00e3e0f-7501-4350-a065-d15b1d9e760a. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:58:04 user nova-compute[72239]: DEBUG nova.network.neutron [req-43f5f5df-1ce8-45f4-b4be-f6029dc8ecf2 req-cd17a6de-7960-4d38-88e0-3cdfe6f0e6d9 service nova] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Updating instance_info_cache with network_info: [{"id": "b00e3e0f-7501-4350-a065-d15b1d9e760a", "address": "fa:16:3e:ce:de:f0", "network": {"id": "ef3b3133-c6fe-4492-84f9-211f520dd339", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-428761984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0fbc9073ba94f6e93d8491accb42231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00e3e0f-75", "ovs_interfaceid": "b00e3e0f-7501-4350-a065-d15b1d9e760a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:58:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-43f5f5df-1ce8-45f4-b4be-f6029dc8ecf2 req-cd17a6de-7960-4d38-88e0-3cdfe6f0e6d9 service nova] Releasing lock "refresh_cache-12c719bf-b770-4e41-b1f4-314eed1180c3" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:58:04 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:58:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:04 user nova-compute[72239]: INFO nova.compute.manager [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Rebuilding instance
Jul 31 14:58:04 user nova-compute[72239]: DEBUG nova.objects.instance [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lazy-loading 'trusted_certs' on Instance uuid 12c719bf-b770-4e41-b1f4-314eed1180c3 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:58:04 user nova-compute[72239]: DEBUG nova.compute.manager [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:58:04 user nova-compute[72239]: DEBUG nova.objects.instance [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lazy-loading 'pci_requests' on Instance uuid 12c719bf-b770-4e41-b1f4-314eed1180c3 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:58:04 user nova-compute[72239]: DEBUG nova.objects.instance [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lazy-loading 'pci_devices' on Instance uuid 12c719bf-b770-4e41-b1f4-314eed1180c3 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:58:04 user nova-compute[72239]: DEBUG nova.objects.instance [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lazy-loading 'resources' on Instance uuid 12c719bf-b770-4e41-b1f4-314eed1180c3 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:58:04 user nova-compute[72239]: DEBUG nova.objects.instance [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lazy-loading 'migration_context' on Instance uuid 12c719bf-b770-4e41-b1f4-314eed1180c3 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:58:04 user nova-compute[72239]: DEBUG nova.objects.instance [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72239) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 31 14:58:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG nova.compute.manager [req-6f77c59c-9a3c-4a89-99dd-d50fe223c00d req-e664e387-a1b4-42ed-aedf-37734fcd66ae service nova] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Received event network-vif-unplugged-b00e3e0f-7501-4350-a065-d15b1d9e760a {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-6f77c59c-9a3c-4a89-99dd-d50fe223c00d req-e664e387-a1b4-42ed-aedf-37734fcd66ae service nova] Acquiring lock "12c719bf-b770-4e41-b1f4-314eed1180c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-6f77c59c-9a3c-4a89-99dd-d50fe223c00d req-e664e387-a1b4-42ed-aedf-37734fcd66ae service nova] Lock "12c719bf-b770-4e41-b1f4-314eed1180c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-6f77c59c-9a3c-4a89-99dd-d50fe223c00d req-e664e387-a1b4-42ed-aedf-37734fcd66ae service nova] Lock "12c719bf-b770-4e41-b1f4-314eed1180c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG nova.compute.manager [req-6f77c59c-9a3c-4a89-99dd-d50fe223c00d req-e664e387-a1b4-42ed-aedf-37734fcd66ae service nova] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] No waiting events found dispatching network-vif-unplugged-b00e3e0f-7501-4350-a065-d15b1d9e760a {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:58:05 user nova-compute[72239]: WARNING nova.compute.manager [req-6f77c59c-9a3c-4a89-99dd-d50fe223c00d req-e664e387-a1b4-42ed-aedf-37734fcd66ae service nova] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Received unexpected event network-vif-unplugged-b00e3e0f-7501-4350-a065-d15b1d9e760a for instance with vm_state active and task_state rebuilding.
Jul 31 14:58:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:05 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Instance destroyed successfully.
Jul 31 14:58:05 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Instance destroyed successfully.
Jul 31 14:58:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1132747549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1158607357',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOefbRzMHFRHe/taYVNRZdQ1lM3IwZrqbCHgRPaUWK30x1oz/dcn1gnm5m9yHdPFwXBxgCljdwQcUohfGqXNL+C58VJsKHYKFOGAUE4NcwzQ4SM+cFj8p3SAcs0gkt76tw==',key_name='tempest-keypair-1078194837',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:56:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b0fbc9073ba94f6e93d8491accb42231',ramdisk_id='',reservation_id='r-ovcgrtjz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-339927996',owner_user_name='tempest-ServerActionsV293TestJSON-339927996-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:58:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='946df3f784544702b6b057e66e23a97d',uuid=12c719bf-b770-4e41-b1f4-314eed1180c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b00e3e0f-7501-4350-a065-d15b1d9e760a", "address": "fa:16:3e:ce:de:f0", "network": {"id": "ef3b3133-c6fe-4492-84f9-211f520dd339", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-428761984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0fbc9073ba94f6e93d8491accb42231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00e3e0f-75", "ovs_interfaceid": "b00e3e0f-7501-4350-a065-d15b1d9e760a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Converting VIF {"id": "b00e3e0f-7501-4350-a065-d15b1d9e760a", "address": "fa:16:3e:ce:de:f0", "network": {"id": "ef3b3133-c6fe-4492-84f9-211f520dd339", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-428761984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0fbc9073ba94f6e93d8491accb42231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00e3e0f-75", "ovs_interfaceid": "b00e3e0f-7501-4350-a065-d15b1d9e760a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:de:f0,bridge_name='br-int',has_traffic_filtering=True,id=b00e3e0f-7501-4350-a065-d15b1d9e760a,network=Network(ef3b3133-c6fe-4492-84f9-211f520dd339),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00e3e0f-75') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG os_vif [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:de:f0,bridge_name='br-int',has_traffic_filtering=True,id=b00e3e0f-7501-4350-a065-d15b1d9e760a,network=Network(ef3b3133-c6fe-4492-84f9-211f520dd339),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00e3e0f-75') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb00e3e0f-75, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:58:05 user nova-compute[72239]: INFO os_vif [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:de:f0,bridge_name='br-int',has_traffic_filtering=True,id=b00e3e0f-7501-4350-a065-d15b1d9e760a,network=Network(ef3b3133-c6fe-4492-84f9-211f520dd339),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00e3e0f-75')
Jul 31 14:58:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BsxrcqOj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:58:05 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 31 14:58:05 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19a2fd4-c523-4c31-9283-cf14b41b07d2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[989ab6eb-af61-4784-aaed-c2610f105cbd]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:58:05 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:58:05 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 14:58:05 user nova-compute[72239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 (non-flash)
Jul 31 14:58:05 user nova-compute[72239]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 14:58:05 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:58:05 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:58:05 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 14:58:05 user nova-compute[72239]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 (non-flash)
Jul 31 14:58:05 user nova-compute[72239]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 14:58:05 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4126ac9090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9'): ({'sdg'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Removing single pathed devices sdg {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[521c8501-da91-4174-9d48-ca8e0bf07848]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.028s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f46fae-714a-44ce-b0dc-badaae4265f3]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Flushing IO for device /dev/sdg {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde4c8bc-6e0c-4a1f-9717-92d5781d22a2]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815485.7904491, 3d70608b-fc54-4178-9aa6-98ca6198a37b => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:58:05 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] VM Resumed (Lifecycle Event)
Jul 31 14:58:05 user nova-compute[72239]: DEBUG nova.compute.manager [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.058s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca79fc8-3ba9-47e9-bbf8-8d0d14c32c39]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] SCSI volumes sdg have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23764376533323537', '/dev/disk/by-id/scsi-1SCST_BIO22bbacb4-7d7e325723592e62', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_22bbacb4') {{(pid=83493) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[637475f0-3e7a-4579-9c6e-54e79d594c1c]: (4, None) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:05 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Instance spawned successfully.
Jul 31 14:58:05 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG nova.compute.manager [req-2160bfb6-2121-43e8-ba83-821d0d14720b req-f1e3b90d-0c78-4dd0-a5f5-1f89feb95afa service nova] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Received event network-vif-plugged-d115f55c-2a02-4b41-88b0-0922039e58ba {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-2160bfb6-2121-43e8-ba83-821d0d14720b req-f1e3b90d-0c78-4dd0-a5f5-1f89feb95afa service nova] Acquiring lock "3d70608b-fc54-4178-9aa6-98ca6198a37b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-2160bfb6-2121-43e8-ba83-821d0d14720b req-f1e3b90d-0c78-4dd0-a5f5-1f89feb95afa service nova] Lock "3d70608b-fc54-4178-9aa6-98ca6198a37b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-2160bfb6-2121-43e8-ba83-821d0d14720b req-f1e3b90d-0c78-4dd0-a5f5-1f89feb95afa service nova] Lock "3d70608b-fc54-4178-9aa6-98ca6198a37b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG nova.compute.manager [req-2160bfb6-2121-43e8-ba83-821d0d14720b req-f1e3b90d-0c78-4dd0-a5f5-1f89feb95afa service nova] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] No waiting events found dispatching network-vif-plugged-d115f55c-2a02-4b41-88b0-0922039e58ba {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:58:05 user nova-compute[72239]: WARNING nova.compute.manager [req-2160bfb6-2121-43e8-ba83-821d0d14720b req-f1e3b90d-0c78-4dd0-a5f5-1f89feb95afa service nova] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Received unexpected event network-vif-plugged-d115f55c-2a02-4b41-88b0-0922039e58ba for instance with vm_state building and task_state spawning.
Jul 31 14:58:05 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:58:05 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815485.7915947, 3d70608b-fc54-4178-9aa6-98ca6198a37b => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:58:05 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] VM Started (Lifecycle Event)
Jul 31 14:58:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0ddc94-6ad5-4232-b367-fd559518d2bb]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:58:05 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:58:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e234eb-69dd-4f77-8273-02ecf09a5a0c]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9, portal: 172.16.0.220,3260]
Jul 31 14:58:05 user nova-compute[72239]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9, portal: 172.16.0.220,3260] successful.
Jul 31 14:58:05 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:58:05 user nova-compute[72239]: INFO nova.compute.manager [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Took 5.21 seconds to spawn the instance on the hypervisor.
Jul 31 14:58:05 user nova-compute[72239]: DEBUG nova.compute.manager [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16fb9e7-0514-4eed-9356-a8cca0e8bd14]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] <== disconnect_volume: return (385ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:58:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 14:58:05 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Deleting instance files /opt/stack/data/nova/instances/12c719bf-b770-4e41-b1f4-314eed1180c3_del
Jul 31 14:58:05 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Deletion of /opt/stack/data/nova/instances/12c719bf-b770-4e41-b1f4-314eed1180c3_del complete
Jul 31 14:58:06 user nova-compute[72239]: INFO nova.compute.manager [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Took 14.43 seconds to build instance.
Jul 31 14:58:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-866ae768-2a51-49cb-99fc-bd884df46c45 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "3d70608b-fc54-4178-9aa6-98ca6198a37b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.528s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:58:06 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 12c719bf-b770-4e41-b1f4-314eed1180c3 could not be found.
Jul 31 14:58:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 14:58:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BsxrcqOj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:58:06 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 31 14:58:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:58:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:58:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 14:58:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:06 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d90e8a-fa05-46da-9463-32b918092872]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:06 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6c247d-f507-4eb0-9627-a9150bbf94ea]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:58:06 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:58:06 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 14:58:06 user nova-compute[72239]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 14:58:06 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:58:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:58:06 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:58:06 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 14:58:06 user nova-compute[72239]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 14:58:06 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:58:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4120157d00>, {}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 14:58:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Disconnecting from: [] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 14:58:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.054s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:58:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] <== disconnect_volume: return (55ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:58:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 14:58:07 user nova-compute[72239]: DEBUG nova.compute.manager [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Preparing to wait for external event volume-reimaged-0fa80825-8675-4494-a7fe-82e943c2e2a9 {{(pid=72239) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Jul 31 14:58:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Acquiring lock "12c719bf-b770-4e41-b1f4-314eed1180c3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:58:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "12c719bf-b770-4e41-b1f4-314eed1180c3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:58:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "12c719bf-b770-4e41-b1f4-314eed1180c3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:58:07 user nova-compute[72239]: DEBUG nova.compute.manager [req-d8dcb08a-463b-4318-b89a-ea2c1ca75cb5 req-c955038a-ad4f-4200-acf3-97626168e05b service nova] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Received event network-vif-plugged-b00e3e0f-7501-4350-a065-d15b1d9e760a {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:58:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d8dcb08a-463b-4318-b89a-ea2c1ca75cb5 req-c955038a-ad4f-4200-acf3-97626168e05b service nova] Acquiring lock "12c719bf-b770-4e41-b1f4-314eed1180c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:58:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d8dcb08a-463b-4318-b89a-ea2c1ca75cb5 req-c955038a-ad4f-4200-acf3-97626168e05b service nova] Lock "12c719bf-b770-4e41-b1f4-314eed1180c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:58:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d8dcb08a-463b-4318-b89a-ea2c1ca75cb5 req-c955038a-ad4f-4200-acf3-97626168e05b service nova] Lock "12c719bf-b770-4e41-b1f4-314eed1180c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:58:07 user nova-compute[72239]: DEBUG nova.compute.manager [req-d8dcb08a-463b-4318-b89a-ea2c1ca75cb5 req-c955038a-ad4f-4200-acf3-97626168e05b service nova] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] No event matching network-vif-plugged-b00e3e0f-7501-4350-a065-d15b1d9e760a in dict_keys([('volume-reimaged', '0fa80825-8675-4494-a7fe-82e943c2e2a9')]) {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Jul 31 14:58:07 user nova-compute[72239]: WARNING nova.compute.manager [req-d8dcb08a-463b-4318-b89a-ea2c1ca75cb5 req-c955038a-ad4f-4200-acf3-97626168e05b service nova] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Received unexpected event network-vif-plugged-b00e3e0f-7501-4350-a065-d15b1d9e760a for instance with vm_state active and task_state rebuilding.
Jul 31 14:58:07 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:58:07 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:58:08 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:58:09 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:58:09 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:58:09 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 14:58:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-14653984-6c32-4ddd-bc0b-203a670c2b4e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:58:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-14653984-6c32-4ddd-bc0b-203a670c2b4e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:58:09 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 14:58:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:09 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Updating instance_info_cache with network_info: [{"id": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "address": "fa:16:3e:5e:e5:b2", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b01e63-20", "ovs_interfaceid": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:58:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-14653984-6c32-4ddd-bc0b-203a670c2b4e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:58:09 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 14:58:10 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:58:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:58:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:58:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:58:10 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 14:58:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87dd3b4b-c511-4784-acf9-ad21534c8337/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87dd3b4b-c511-4784-acf9-ad21534c8337/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87dd3b4b-c511-4784-acf9-ad21534c8337/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/87dd3b4b-c511-4784-acf9-ad21534c8337/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:58:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f6d85d-ffa0-4d72-b521-e855afa23a09/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f6d85d-ffa0-4d72-b521-e855afa23a09/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f6d85d-ffa0-4d72-b521-e855afa23a09/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f6d85d-ffa0-4d72-b521-e855afa23a09/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:58:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:58:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json" returned: 0 in 0.137s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:58:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc1b9270-ccf7-4127-a3fd-cab56d362f0d/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc1b9270-ccf7-4127-a3fd-cab56d362f0d/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc1b9270-ccf7-4127-a3fd-cab56d362f0d/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bc1b9270-ccf7-4127-a3fd-cab56d362f0d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dcd718a-280f-4b0e-b54f-616ee983ad16/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dcd718a-280f-4b0e-b54f-616ee983ad16/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dcd718a-280f-4b0e-b54f-616ee983ad16/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dcd718a-280f-4b0e-b54f-616ee983ad16/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:15 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:58:15 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:58:15 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=7068MB free_disk=25.008544921875GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 14:58:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:58:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:58:15 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 20abf743-de5b-4122-aad0-e2124c7804b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:58:15 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 7d81b881-b44e-4fb3-8245-9dea634bdec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:58:15 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 079a5ed7-ee25-495b-a2a4-924d830a670a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:58:15 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 2f11022e-a007-4d4c-adc1-b54ea59b9e6a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:58:15 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance c10918e9-9731-48ea-860e-8a02cb6a0ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:58:15 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance db15ad45-8f28-4e0c-8d7e-7db75f33fe92 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:58:15 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance c2b3c85b-e939-41d0-8bf0-3a7f650177b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:58:15 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 3559f541-ed61-41b2-9a9d-8b10e18f7375 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:58:15 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 87dd3b4b-c511-4784-acf9-ad21534c8337 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:58:15 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 7dcd718a-280f-4b0e-b54f-616ee983ad16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:58:15 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance e6f6d85d-ffa0-4d72-b521-e855afa23a09 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:58:15 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 14653984-6c32-4ddd-bc0b-203a670c2b4e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:58:15 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 12c719bf-b770-4e41-b1f4-314eed1180c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:58:15 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance bc1b9270-ccf7-4127-a3fd-cab56d362f0d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:58:15 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 3d70608b-fc54-4178-9aa6-98ca6198a37b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:58:15 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 14:58:15 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 14:58:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e7a18305-684a-4a23-a8d0-a4c20d70781a tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "14653984-6c32-4ddd-bc0b-203a670c2b4e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:58:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e7a18305-684a-4a23-a8d0-a4c20d70781a tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "14653984-6c32-4ddd-bc0b-203a670c2b4e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:58:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e7a18305-684a-4a23-a8d0-a4c20d70781a tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "14653984-6c32-4ddd-bc0b-203a670c2b4e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:58:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e7a18305-684a-4a23-a8d0-a4c20d70781a tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "14653984-6c32-4ddd-bc0b-203a670c2b4e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:58:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e7a18305-684a-4a23-a8d0-a4c20d70781a tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "14653984-6c32-4ddd-bc0b-203a670c2b4e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:58:15 user nova-compute[72239]: INFO nova.compute.manager [None req-e7a18305-684a-4a23-a8d0-a4c20d70781a tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Terminating instance
Jul 31 14:58:15 user nova-compute[72239]: DEBUG nova.compute.manager [None req-e7a18305-684a-4a23-a8d0-a4c20d70781a tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 14:58:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:15 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:58:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:15 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:58:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:15 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 14:58:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.711s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:58:15 user nova-compute[72239]: DEBUG nova.compute.manager [req-e8893570-e6cd-4733-8e7b-d63d82c5c910 req-25a5ad35-2a95-4e4b-97a6-5f2de497266f service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Received event network-vif-unplugged-b1b01e63-209d-4388-a81d-eb17afdf0db4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:58:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e8893570-e6cd-4733-8e7b-d63d82c5c910 req-25a5ad35-2a95-4e4b-97a6-5f2de497266f service nova] Acquiring lock "14653984-6c32-4ddd-bc0b-203a670c2b4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:58:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e8893570-e6cd-4733-8e7b-d63d82c5c910 req-25a5ad35-2a95-4e4b-97a6-5f2de497266f service nova] Lock "14653984-6c32-4ddd-bc0b-203a670c2b4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:58:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e8893570-e6cd-4733-8e7b-d63d82c5c910 req-25a5ad35-2a95-4e4b-97a6-5f2de497266f service nova] Lock "14653984-6c32-4ddd-bc0b-203a670c2b4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:58:16 user nova-compute[72239]: DEBUG nova.compute.manager [req-e8893570-e6cd-4733-8e7b-d63d82c5c910 req-25a5ad35-2a95-4e4b-97a6-5f2de497266f service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] No waiting events found dispatching network-vif-unplugged-b1b01e63-209d-4388-a81d-eb17afdf0db4 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:58:16 user nova-compute[72239]: DEBUG nova.compute.manager [req-e8893570-e6cd-4733-8e7b-d63d82c5c910 req-25a5ad35-2a95-4e4b-97a6-5f2de497266f service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Received event network-vif-unplugged-b1b01e63-209d-4388-a81d-eb17afdf0db4 for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 14:58:16 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:16 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:16 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:16 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Instance destroyed successfully.
Jul 31 14:58:16 user nova-compute[72239]: DEBUG nova.objects.instance [None req-e7a18305-684a-4a23-a8d0-a4c20d70781a tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lazy-loading 'resources' on Instance uuid 14653984-6c32-4ddd-bc0b-203a670c2b4e {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:58:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-e7a18305-684a-4a23-a8d0-a4c20d70781a tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T14:51:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-236697822',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-236697822',id=20,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKRPopS6NZ8SJLGIqXpCTuBDBqc4poSQIzgLPnpX8KBSKuZ0J23omJc+3/YxYJoxechHepUs7tMFC/G2hd/C8KcWH0ZiYO+ptZU4vZL8aClAs6bSSlr6XibY/Q6VYdulsg==',key_name='tempest-keypair-1016500460',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:55:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a6715a7ff38401d844b620cb8d8769e',ramdisk_id='',reservation_id='r-m9hzvwfm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-599528407',owner_user_name='tempest-AttachVolumeShelveTestJSON-599528407-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:55:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70c6001a7ac5434fbc5ac7d003edd4eb',uuid=14653984-6c32-4ddd-bc0b-203a670c2b4e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "address": "fa:16:3e:5e:e5:b2", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b01e63-20", "ovs_interfaceid": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:58:16 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-e7a18305-684a-4a23-a8d0-a4c20d70781a tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Converting VIF {"id": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "address": "fa:16:3e:5e:e5:b2", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb1b01e63-20", "ovs_interfaceid": "b1b01e63-209d-4388-a81d-eb17afdf0db4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:58:16 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-e7a18305-684a-4a23-a8d0-a4c20d70781a tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:e5:b2,bridge_name='br-int',has_traffic_filtering=True,id=b1b01e63-209d-4388-a81d-eb17afdf0db4,network=Network(37a946a3-d20a-4694-8647-73e84d2b0cb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1b01e63-20') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:58:16 user nova-compute[72239]: DEBUG os_vif [None req-e7a18305-684a-4a23-a8d0-a4c20d70781a tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:e5:b2,bridge_name='br-int',has_traffic_filtering=True,id=b1b01e63-209d-4388-a81d-eb17afdf0db4,network=Network(37a946a3-d20a-4694-8647-73e84d2b0cb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1b01e63-20') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:58:16 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:16 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb1b01e63-20, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:58:16 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:16 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:58:16 user nova-compute[72239]: INFO os_vif [None req-e7a18305-684a-4a23-a8d0-a4c20d70781a tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:e5:b2,bridge_name='br-int',has_traffic_filtering=True,id=b1b01e63-209d-4388-a81d-eb17afdf0db4,network=Network(37a946a3-d20a-4694-8647-73e84d2b0cb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb1b01e63-20')
Jul 31 14:58:16 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-e7a18305-684a-4a23-a8d0-a4c20d70781a tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Deleting instance files /opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e_del
Jul 31 14:58:16 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-e7a18305-684a-4a23-a8d0-a4c20d70781a tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Deletion of /opt/stack/data/nova/instances/14653984-6c32-4ddd-bc0b-203a670c2b4e_del complete
Jul 31 14:58:16 user nova-compute[72239]: INFO nova.compute.manager [None req-e7a18305-684a-4a23-a8d0-a4c20d70781a tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Took 0.85 seconds to destroy the instance on the hypervisor.
Jul 31 14:58:16 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-e7a18305-684a-4a23-a8d0-a4c20d70781a tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 14:58:16 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 14:58:16 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 14:58:17 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:58:17 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Took 0.79 seconds to deallocate network for instance.
Jul 31 14:58:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e7a18305-684a-4a23-a8d0-a4c20d70781a tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:58:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e7a18305-684a-4a23-a8d0-a4c20d70781a tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:58:17 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-e7a18305-684a-4a23-a8d0-a4c20d70781a tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:58:18 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-e7a18305-684a-4a23-a8d0-a4c20d70781a tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:58:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e7a18305-684a-4a23-a8d0-a4c20d70781a tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.458s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:58:18 user nova-compute[72239]: DEBUG nova.compute.manager [req-86d684ab-249f-4eca-b2bb-c827853489a6 req-8e7c593f-485c-4c08-a95e-9d9c29282222 service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Received event network-vif-plugged-b1b01e63-209d-4388-a81d-eb17afdf0db4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:58:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-86d684ab-249f-4eca-b2bb-c827853489a6 req-8e7c593f-485c-4c08-a95e-9d9c29282222 service nova] Acquiring lock "14653984-6c32-4ddd-bc0b-203a670c2b4e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:58:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-86d684ab-249f-4eca-b2bb-c827853489a6 req-8e7c593f-485c-4c08-a95e-9d9c29282222 service nova] Lock "14653984-6c32-4ddd-bc0b-203a670c2b4e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:58:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-86d684ab-249f-4eca-b2bb-c827853489a6 req-8e7c593f-485c-4c08-a95e-9d9c29282222 service nova] Lock "14653984-6c32-4ddd-bc0b-203a670c2b4e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:58:18 user nova-compute[72239]: DEBUG nova.compute.manager [req-86d684ab-249f-4eca-b2bb-c827853489a6 req-8e7c593f-485c-4c08-a95e-9d9c29282222 service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] No waiting events found dispatching network-vif-plugged-b1b01e63-209d-4388-a81d-eb17afdf0db4 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:58:18 user nova-compute[72239]: WARNING nova.compute.manager [req-86d684ab-249f-4eca-b2bb-c827853489a6 req-8e7c593f-485c-4c08-a95e-9d9c29282222 service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Received unexpected event network-vif-plugged-b1b01e63-209d-4388-a81d-eb17afdf0db4 for instance with vm_state deleted and task_state None.
Jul 31 14:58:18 user nova-compute[72239]: DEBUG nova.compute.manager [req-86d684ab-249f-4eca-b2bb-c827853489a6 req-8e7c593f-485c-4c08-a95e-9d9c29282222 service nova] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Received event network-vif-deleted-b1b01e63-209d-4388-a81d-eb17afdf0db4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:58:18 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-e7a18305-684a-4a23-a8d0-a4c20d70781a tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Deleted allocations for instance 14653984-6c32-4ddd-bc0b-203a670c2b4e
Jul 31 14:58:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e7a18305-684a-4a23-a8d0-a4c20d70781a tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "14653984-6c32-4ddd-bc0b-203a670c2b4e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.521s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:58:18 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:58:18 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 14:58:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:20 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690815485.537211, 12c719bf-b770-4e41-b1f4-314eed1180c3 => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:58:20 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] VM Stopped (Lifecycle Event)
Jul 31 14:58:20 user nova-compute[72239]: DEBUG nova.compute.manager [None req-28de1f07-ceb3-41c2-9a79-69c75d5302f7 None None] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:58:21 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:24 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:24 user nova-compute[72239]: DEBUG nova.compute.manager [req-32216f82-9b6a-4c9a-b62d-1076e6d87160 req-742c1ada-38a4-4d3d-bbf8-89a05151a70c service nova] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Received event volume-reimaged-0fa80825-8675-4494-a7fe-82e943c2e2a9 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:58:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-32216f82-9b6a-4c9a-b62d-1076e6d87160 req-742c1ada-38a4-4d3d-bbf8-89a05151a70c service nova] Acquiring lock "12c719bf-b770-4e41-b1f4-314eed1180c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:58:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-32216f82-9b6a-4c9a-b62d-1076e6d87160 req-742c1ada-38a4-4d3d-bbf8-89a05151a70c service nova] Lock "12c719bf-b770-4e41-b1f4-314eed1180c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:58:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-32216f82-9b6a-4c9a-b62d-1076e6d87160 req-742c1ada-38a4-4d3d-bbf8-89a05151a70c service nova] Lock "12c719bf-b770-4e41-b1f4-314eed1180c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:58:24 user nova-compute[72239]: DEBUG nova.compute.manager [req-32216f82-9b6a-4c9a-b62d-1076e6d87160 req-742c1ada-38a4-4d3d-bbf8-89a05151a70c service nova] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Processing event volume-reimaged-0fa80825-8675-4494-a7fe-82e943c2e2a9 {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Jul 31 14:58:24 user nova-compute[72239]: DEBUG nova.compute.manager [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Instance event wait completed in 17 seconds for volume-reimaged {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:58:24 user nova-compute[72239]: INFO nova.virt.block_device [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Booting with volume 0fa80825-8675-4494-a7fe-82e943c2e2a9 at /dev/vda
Jul 31 14:58:24 user nova-compute[72239]: DEBUG os_brick.utils [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:58:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:24 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b06a0d4-f8de-4b9e-a20a-7cd19862cde3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:24 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[426be1dd-a16f-4d5a-b557-6e208e3230be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:24 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0fba50-7e98-460e-a719-b8bc8e797f39]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:24 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[791b138c-f896-43d7-b692-9eab1f26e0d2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:58:24 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 14:58:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:58:24 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 14:58:24 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d583b206-4bc8-4d9d-a9ec-635e7b8aad34]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:24 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 14:58:24 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 14:58:24 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 14:58:24 user nova-compute[72239]: DEBUG os_brick.utils [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:58:24 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Updating existing volume attachment record: f4d74c52-229f-4ae1-959e-ab7bdedbc72d {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 14:58:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:28 user nova-compute[72239]: DEBUG nova.compute.manager [req-3d5a6346-b98a-4482-a218-a8305d5099ba req-10b90af4-16c3-4026-bbfb-2db751a5e34b service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Received event network-changed-a7009a29-6a23-4d7d-a2ff-046c040e5b73 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:58:28 user nova-compute[72239]: DEBUG nova.compute.manager [req-3d5a6346-b98a-4482-a218-a8305d5099ba req-10b90af4-16c3-4026-bbfb-2db751a5e34b service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Refreshing instance network info cache due to event network-changed-a7009a29-6a23-4d7d-a2ff-046c040e5b73. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:58:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-3d5a6346-b98a-4482-a218-a8305d5099ba req-10b90af4-16c3-4026-bbfb-2db751a5e34b service nova] Acquiring lock "refresh_cache-3559f541-ed61-41b2-9a9d-8b10e18f7375" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:58:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-3d5a6346-b98a-4482-a218-a8305d5099ba req-10b90af4-16c3-4026-bbfb-2db751a5e34b service nova] Acquired lock "refresh_cache-3559f541-ed61-41b2-9a9d-8b10e18f7375" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:58:28 user nova-compute[72239]: DEBUG nova.network.neutron [req-3d5a6346-b98a-4482-a218-a8305d5099ba req-10b90af4-16c3-4026-bbfb-2db751a5e34b service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Refreshing network info cache for port a7009a29-6a23-4d7d-a2ff-046c040e5b73 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:58:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7a235212-5d71-468a-a772-86c33e944c3a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "3559f541-ed61-41b2-9a9d-8b10e18f7375" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:58:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7a235212-5d71-468a-a772-86c33e944c3a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "3559f541-ed61-41b2-9a9d-8b10e18f7375" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:58:28 user nova-compute[72239]: INFO nova.compute.manager [None req-7a235212-5d71-468a-a772-86c33e944c3a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Detaching volume a5f05c38-e6ce-44aa-afa6-92b1b1e72c45
Jul 31 14:58:28 user nova-compute[72239]: DEBUG nova.network.neutron [req-3d5a6346-b98a-4482-a218-a8305d5099ba req-10b90af4-16c3-4026-bbfb-2db751a5e34b service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Updated VIF entry in instance network info cache for port a7009a29-6a23-4d7d-a2ff-046c040e5b73. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:58:28 user nova-compute[72239]: DEBUG nova.network.neutron [req-3d5a6346-b98a-4482-a218-a8305d5099ba req-10b90af4-16c3-4026-bbfb-2db751a5e34b service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Updating instance_info_cache with network_info: [{"id": "a7009a29-6a23-4d7d-a2ff-046c040e5b73", "address": "fa:16:3e:f5:e4:b4", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7009a29-6a", "ovs_interfaceid": "a7009a29-6a23-4d7d-a2ff-046c040e5b73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:58:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-3d5a6346-b98a-4482-a218-a8305d5099ba req-10b90af4-16c3-4026-bbfb-2db751a5e34b service nova] Releasing lock "refresh_cache-3559f541-ed61-41b2-9a9d-8b10e18f7375" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:58:28 user nova-compute[72239]: INFO nova.virt.block_device [None req-7a235212-5d71-468a-a772-86c33e944c3a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Attempting to driver detach volume a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 from mountpoint /dev/vdb
Jul 31 14:58:28 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7a235212-5d71-468a-a772-86c33e944c3a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Attempting to detach device vdb from instance 3559f541-ed61-41b2-9a9d-8b10e18f7375 from the persistent domain config. {{(pid=72239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 14:58:28 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-7a235212-5d71-468a-a772-86c33e944c3a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 14:58:28 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:58:28 user nova-compute[72239]:   <source dev="/dev/sdd"/>
Jul 31 14:58:28 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:58:28 user nova-compute[72239]:   <serial>a5f05c38-e6ce-44aa-afa6-92b1b1e72c45</serial>
Jul 31 14:58:28 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 14:58:28 user nova-compute[72239]: </disk>
Jul 31 14:58:28 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 14:58:28 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-7a235212-5d71-468a-a772-86c33e944c3a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Successfully detached device vdb from instance 3559f541-ed61-41b2-9a9d-8b10e18f7375 from the persistent domain config.
Jul 31 14:58:28 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7a235212-5d71-468a-a772-86c33e944c3a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3559f541-ed61-41b2-9a9d-8b10e18f7375 from the live domain config. {{(pid=72239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 14:58:28 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-7a235212-5d71-468a-a772-86c33e944c3a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 14:58:28 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:58:28 user nova-compute[72239]:   <source dev="/dev/sdd"/>
Jul 31 14:58:28 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 14:58:28 user nova-compute[72239]:   <serial>a5f05c38-e6ce-44aa-afa6-92b1b1e72c45</serial>
Jul 31 14:58:28 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 14:58:28 user nova-compute[72239]: </disk>
Jul 31 14:58:28 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Received event <DeviceRemovedEvent: 1690815509.0595155, 3559f541-ed61-41b2-9a9d-8b10e18f7375 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72239) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7a235212-5d71-468a-a772-86c33e944c3a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3559f541-ed61-41b2-9a9d-8b10e18f7375 {{(pid=72239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 14:58:29 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-7a235212-5d71-468a-a772-86c33e944c3a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Successfully detached device vdb from instance 3559f541-ed61-41b2-9a9d-8b10e18f7375 from the live domain config.
Jul 31 14:58:29 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a235212-5d71-468a-a772-86c33e944c3a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a235212-5d71-468a-a772-86c33e944c3a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lsdIinAU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:58:29 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-7a235212-5d71-468a-a772-86c33e944c3a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:58:29 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-7a235212-5d71-468a-a772-86c33e944c3a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-7a235212-5d71-468a-a772-86c33e944c3a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a235212-5d71-468a-a772-86c33e944c3a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb922528-fe13-4a88-a204-d891125b35a8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e9cf4d-088a-4bca-9138-12a297ba3ee8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a235212-5d71-468a-a772-86c33e944c3a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:58:29 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:58:29 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 14:58:29 user nova-compute[72239]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 14:58:29 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a235212-5d71-468a-a772-86c33e944c3a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:58:29 user nova-compute[72239]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 (non-flash)
Jul 31 14:58:29 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 14:58:29 user nova-compute[72239]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 14:58:29 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a235212-5d71-468a-a772-86c33e944c3a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41007ba560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45'): ({'sdd'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-7a235212-5d71-468a-a772-86c33e944c3a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Removing single pathed devices sdd {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcabc982-02c1-42b3-ad93-37e6e0de7067]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[674f9acb-f5e6-4ebd-bdd9-f4ca50a90fa9]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-7a235212-5d71-468a-a772-86c33e944c3a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Flushing IO for device /dev/sdd {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9437d2-57e0-46b0-b26d-024755158c58]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-7a235212-5d71-468a-a772-86c33e944c3a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.032s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae88e70-37f5-4d7a-b20e-f3657e8fac3f]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-7a235212-5d71-468a-a772-86c33e944c3a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-7a235212-5d71-468a-a772-86c33e944c3a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] SCSI volumes sdd have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a235212-5d71-468a-a772-86c33e944c3a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[31cb9e1c-b13b-4626-ba71-019beaa01ba1]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a235212-5d71-468a-a772-86c33e944c3a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89f7ea0-e497-4fcc-8ba1-93cc7b4240f3]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a235212-5d71-468a-a772-86c33e944c3a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45, portal: 172.16.0.220,3260]
Jul 31 14:58:29 user nova-compute[72239]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45, portal: 172.16.0.220,3260] successful.
Jul 31 14:58:29 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a5f05c38-e6ce-44aa-afa6-92b1b1e72c45 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfae7a8-e0de-4279-9da5-ff745171b92a]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a235212-5d71-468a-a772-86c33e944c3a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-7a235212-5d71-468a-a772-86c33e944c3a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7a235212-5d71-468a-a772-86c33e944c3a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] <== disconnect_volume: return (278ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7a235212-5d71-468a-a772-86c33e944c3a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 14:58:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:30 user nova-compute[72239]: DEBUG nova.compute.manager [req-c9fe8b63-a6d4-4581-95fa-0f68624ee012 req-6d9a38cb-2f3a-4bbc-900c-014c5938e63a service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Received event network-changed-a7009a29-6a23-4d7d-a2ff-046c040e5b73 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:58:30 user nova-compute[72239]: DEBUG nova.compute.manager [req-c9fe8b63-a6d4-4581-95fa-0f68624ee012 req-6d9a38cb-2f3a-4bbc-900c-014c5938e63a service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Refreshing instance network info cache due to event network-changed-a7009a29-6a23-4d7d-a2ff-046c040e5b73. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:58:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-c9fe8b63-a6d4-4581-95fa-0f68624ee012 req-6d9a38cb-2f3a-4bbc-900c-014c5938e63a service nova] Acquiring lock "refresh_cache-3559f541-ed61-41b2-9a9d-8b10e18f7375" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:58:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-c9fe8b63-a6d4-4581-95fa-0f68624ee012 req-6d9a38cb-2f3a-4bbc-900c-014c5938e63a service nova] Acquired lock "refresh_cache-3559f541-ed61-41b2-9a9d-8b10e18f7375" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:58:30 user nova-compute[72239]: DEBUG nova.network.neutron [req-c9fe8b63-a6d4-4581-95fa-0f68624ee012 req-6d9a38cb-2f3a-4bbc-900c-014c5938e63a service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Refreshing network info cache for port a7009a29-6a23-4d7d-a2ff-046c040e5b73 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:58:30 user nova-compute[72239]: DEBUG nova.objects.instance [None req-7a235212-5d71-468a-a772-86c33e944c3a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lazy-loading 'flavor' on Instance uuid 3559f541-ed61-41b2-9a9d-8b10e18f7375 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:58:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7a235212-5d71-468a-a772-86c33e944c3a tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "3559f541-ed61-41b2-9a9d-8b10e18f7375" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.774s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:58:30 user nova-compute[72239]: DEBUG nova.network.neutron [req-c9fe8b63-a6d4-4581-95fa-0f68624ee012 req-6d9a38cb-2f3a-4bbc-900c-014c5938e63a service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Updated VIF entry in instance network info cache for port a7009a29-6a23-4d7d-a2ff-046c040e5b73. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:58:30 user nova-compute[72239]: DEBUG nova.network.neutron [req-c9fe8b63-a6d4-4581-95fa-0f68624ee012 req-6d9a38cb-2f3a-4bbc-900c-014c5938e63a service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Updating instance_info_cache with network_info: [{"id": "a7009a29-6a23-4d7d-a2ff-046c040e5b73", "address": "fa:16:3e:f5:e4:b4", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7009a29-6a", "ovs_interfaceid": "a7009a29-6a23-4d7d-a2ff-046c040e5b73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:58:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-c9fe8b63-a6d4-4581-95fa-0f68624ee012 req-6d9a38cb-2f3a-4bbc-900c-014c5938e63a service nova] Releasing lock "refresh_cache-3559f541-ed61-41b2-9a9d-8b10e18f7375" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:58:31 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690815496.3877451, 14653984-6c32-4ddd-bc0b-203a670c2b4e => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:58:31 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] VM Stopped (Lifecycle Event)
Jul 31 14:58:31 user nova-compute[72239]: DEBUG nova.compute.manager [None req-87010063-9136-4c55-bb8f-4cdca5372569 None None] [instance: 14653984-6c32-4ddd-bc0b-203a670c2b4e] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:58:31 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-efd098da-06dd-43f0-8558-8e767f8bd1c4 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "87dd3b4b-c511-4784-acf9-ad21534c8337" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:58:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-efd098da-06dd-43f0-8558-8e767f8bd1c4 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "87dd3b4b-c511-4784-acf9-ad21534c8337" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:58:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-efd098da-06dd-43f0-8558-8e767f8bd1c4 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "87dd3b4b-c511-4784-acf9-ad21534c8337-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:58:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-efd098da-06dd-43f0-8558-8e767f8bd1c4 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "87dd3b4b-c511-4784-acf9-ad21534c8337-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:58:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-efd098da-06dd-43f0-8558-8e767f8bd1c4 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "87dd3b4b-c511-4784-acf9-ad21534c8337-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:58:31 user nova-compute[72239]: INFO nova.compute.manager [None req-efd098da-06dd-43f0-8558-8e767f8bd1c4 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Terminating instance
Jul 31 14:58:31 user nova-compute[72239]: DEBUG nova.compute.manager [None req-efd098da-06dd-43f0-8558-8e767f8bd1c4 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 14:58:31 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:31 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:31 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:31 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG nova.compute.manager [req-e9be7ea8-9eb9-4012-a5fc-a61ba7e90654 req-6a2ca885-4de9-4741-ab4f-b0646e794cb5 service nova] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Received event network-vif-unplugged-b3ad3fcc-4893-4a8d-b571-56531232aa38 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e9be7ea8-9eb9-4012-a5fc-a61ba7e90654 req-6a2ca885-4de9-4741-ab4f-b0646e794cb5 service nova] Acquiring lock "87dd3b4b-c511-4784-acf9-ad21534c8337-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e9be7ea8-9eb9-4012-a5fc-a61ba7e90654 req-6a2ca885-4de9-4741-ab4f-b0646e794cb5 service nova] Lock "87dd3b4b-c511-4784-acf9-ad21534c8337-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e9be7ea8-9eb9-4012-a5fc-a61ba7e90654 req-6a2ca885-4de9-4741-ab4f-b0646e794cb5 service nova] Lock "87dd3b4b-c511-4784-acf9-ad21534c8337-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG nova.compute.manager [req-e9be7ea8-9eb9-4012-a5fc-a61ba7e90654 req-6a2ca885-4de9-4741-ab4f-b0646e794cb5 service nova] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] No waiting events found dispatching network-vif-unplugged-b3ad3fcc-4893-4a8d-b571-56531232aa38 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG nova.compute.manager [req-e9be7ea8-9eb9-4012-a5fc-a61ba7e90654 req-6a2ca885-4de9-4741-ab4f-b0646e794cb5 service nova] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Received event network-vif-unplugged-b3ad3fcc-4893-4a8d-b571-56531232aa38 for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 14:58:32 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Instance destroyed successfully.
Jul 31 14:58:32 user nova-compute[72239]: DEBUG nova.objects.instance [None req-efd098da-06dd-43f0-8558-8e767f8bd1c4 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lazy-loading 'resources' on Instance uuid 87dd3b4b-c511-4784-acf9-ad21534c8337 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-efd098da-06dd-43f0-8558-8e767f8bd1c4 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:52:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-644202697',display_name='tempest-AttachVolumeNegativeTest-server-644202697',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-644202697',id=23,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMppTHM1FnkXOlJGlz0iPP9YDtT0ELcybzl0dCDuW66fH3EH9FaZsh1xXd4oGZRQ+YpvhreZmu503DtBwqW/f8Rlj3ukElg6Kk78sLy3JmBI158DdZh8h1fBUI2M6th/tA==',key_name='tempest-keypair-447190904',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:52:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48e4fe9e81724b9cb6b9d73748f9bdee',ramdisk_id='',reservation_id='r-men4o51d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-620954585',owner_user_name='tempest-AttachVolumeNegativeTest-620954585-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:52:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99f609389e884d5490ba160d9fff28e3',uuid=87dd3b4b-c511-4784-acf9-ad21534c8337,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b3ad3fcc-4893-4a8d-b571-56531232aa38", "address": "fa:16:3e:a6:c6:59", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ad3fcc-48", "ovs_interfaceid": "b3ad3fcc-4893-4a8d-b571-56531232aa38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-efd098da-06dd-43f0-8558-8e767f8bd1c4 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Converting VIF {"id": "b3ad3fcc-4893-4a8d-b571-56531232aa38", "address": "fa:16:3e:a6:c6:59", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb3ad3fcc-48", "ovs_interfaceid": "b3ad3fcc-4893-4a8d-b571-56531232aa38", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-efd098da-06dd-43f0-8558-8e767f8bd1c4 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:c6:59,bridge_name='br-int',has_traffic_filtering=True,id=b3ad3fcc-4893-4a8d-b571-56531232aa38,network=Network(f83cfb34-b1ca-4a7c-9a36-3654372585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3ad3fcc-48') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG os_vif [None req-efd098da-06dd-43f0-8558-8e767f8bd1c4 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:c6:59,bridge_name='br-int',has_traffic_filtering=True,id=b3ad3fcc-4893-4a8d-b571-56531232aa38,network=Network(f83cfb34-b1ca-4a7c-9a36-3654372585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3ad3fcc-48') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb3ad3fcc-48, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:32 user nova-compute[72239]: INFO os_vif [None req-efd098da-06dd-43f0-8558-8e767f8bd1c4 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:c6:59,bridge_name='br-int',has_traffic_filtering=True,id=b3ad3fcc-4893-4a8d-b571-56531232aa38,network=Network(f83cfb34-b1ca-4a7c-9a36-3654372585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb3ad3fcc-48')
Jul 31 14:58:32 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-efd098da-06dd-43f0-8558-8e767f8bd1c4 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Deleting instance files /opt/stack/data/nova/instances/87dd3b4b-c511-4784-acf9-ad21534c8337_del
Jul 31 14:58:32 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-efd098da-06dd-43f0-8558-8e767f8bd1c4 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Deletion of /opt/stack/data/nova/instances/87dd3b4b-c511-4784-acf9-ad21534c8337_del complete
Jul 31 14:58:32 user nova-compute[72239]: INFO nova.compute.manager [None req-efd098da-06dd-43f0-8558-8e767f8bd1c4 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Took 0.84 seconds to destroy the instance on the hypervisor.
Jul 31 14:58:32 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-efd098da-06dd-43f0-8558-8e767f8bd1c4 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 14:58:32 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Creating image(s)
Jul 31 14:58:32 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Did not create local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Ensure instance console log exists: /opt/stack/data/nova/instances/12c719bf-b770-4e41-b1f4-314eed1180c3/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Start _get_guest_xml network_info=[{"id": "b00e3e0f-7501-4350-a065-d15b1d9e760a", "address": "fa:16:3e:ce:de:f0", "network": {"id": "ef3b3133-c6fe-4492-84f9-211f520dd339", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-428761984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0fbc9073ba94f6e93d8491accb42231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00e3e0f-75", "ovs_interfaceid": "b00e3e0f-7501-4350-a065-d15b1d9e760a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'f4d74c52-229f-4ae1-959e-ab7bdedbc72d', 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BsxrcqOj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '12c719bf-b770-4e41-b1f4-314eed1180c3', 'attached_at': '', 'detached_at': '', 'volume_id': '0fa80825-8675-4494-a7fe-82e943c2e2a9', 'serial': '0fa80825-8675-4494-a7fe-82e943c2e2a9'}, 'delete_on_termination': True, 'guest_format': None, 'volume_type': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:58:32 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 31 14:58:32 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 31 14:58:32 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG nova.objects.instance [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lazy-loading 'vcpu_model' on Instance uuid 12c719bf-b770-4e41-b1f4-314eed1180c3 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BsxrcqOj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:58:32 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 31 14:58:32 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:58:32 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 31 14:58:32 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:58:32 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 14:58:32 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c39a753-3563-48fc-82c3-ea5a2ee470ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 14:58:32 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7b80fe-f472-4751-abae-c79c30693ca8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9] added
Jul 31 14:58:32 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3253a48-11e3-4990-a66f-dfc9a60a0d76]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d65ebb-33f0-4e60-bb6a-3cf590c7b4eb]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BsxrcqOj {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BsxrcqOj" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cc5b75-70cd-47e9-adc8-7ca6f4f19d8e]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BsxrcqOj'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[31dc02fb-854f-4693-8354-07b492edf3c7]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[79985723-6471-4040-a602-7a4dfc3a6c3e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:58:32 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 14:58:32 user nova-compute[72239]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 14:58:32 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:58:32 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 14:58:32 user nova-compute[72239]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 14:58:32 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e002c8-3925-426f-92d6-6b1592764a41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9, portal: 172.16.0.220,3260]
Jul 31 14:58:32 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9, portal: 172.16.0.220,3260] successful.
Jul 31 14:58:32 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[851769e8-212f-4602-bd28-c59e8b427964]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebf0a8f-ea1a-4c86-98e1-846502582683]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:58:32 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 14:58:32 user nova-compute[72239]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 14:58:32 user nova-compute[72239]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 (non-flash)
Jul 31 14:58:32 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:58:32 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 14:58:32 user nova-compute[72239]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 14:58:32 user nova-compute[72239]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 (non-flash)
Jul 31 14:58:32 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[150939ac-e01c-48eb-a79a-3e9c0c03494f]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:58:32 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: None {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:58:33 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:58:33 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Took 0.83 seconds to deallocate network for instance.
Jul 31 14:58:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-efd098da-06dd-43f0-8558-8e767f8bd1c4 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:58:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-efd098da-06dd-43f0-8558-8e767f8bd1c4 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:58:33 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-efd098da-06dd-43f0-8558-8e767f8bd1c4 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:58:33 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-efd098da-06dd-43f0-8558-8e767f8bd1c4 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:58:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-efd098da-06dd-43f0-8558-8e767f8bd1c4 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:58:33 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-efd098da-06dd-43f0-8558-8e767f8bd1c4 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Deleted allocations for instance 87dd3b4b-c511-4784-acf9-ad21534c8337
Jul 31 14:58:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-efd098da-06dd-43f0-8558-8e767f8bd1c4 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "87dd3b4b-c511-4784-acf9-ad21534c8337" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.261s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:58:33 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 14:58:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BsxrcqOj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 14:58:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:58:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23764376533323537', 'path': '/dev/sdd'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:58:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764376533323537', 'path': '/dev/sdd'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 14:58:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T14:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1132747549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1158607357',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOefbRzMHFRHe/taYVNRZdQ1lM3IwZrqbCHgRPaUWK30x1oz/dcn1gnm5m9yHdPFwXBxgCljdwQcUohfGqXNL+C58VJsKHYKFOGAUE4NcwzQ4SM+cFj8p3SAcs0gkt76tw==',key_name='tempest-keypair-1078194837',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:56:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b0fbc9073ba94f6e93d8491accb42231',ramdisk_id='',reservation_id='r-ovcgrtjz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-339927996',owner_user_name='tempest-ServerActionsV293TestJSON-339927996-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:58:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='946df3f784544702b6b057e66e23a97d',uuid=12c719bf-b770-4e41-b1f4-314eed1180c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b00e3e0f-7501-4350-a065-d15b1d9e760a", "address": "fa:16:3e:ce:de:f0", "network": {"id": "ef3b3133-c6fe-4492-84f9-211f520dd339", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-428761984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0fbc9073ba94f6e93d8491accb42231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00e3e0f-75", "ovs_interfaceid": "b00e3e0f-7501-4350-a065-d15b1d9e760a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:58:33 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Converting VIF {"id": "b00e3e0f-7501-4350-a065-d15b1d9e760a", "address": "fa:16:3e:ce:de:f0", "network": {"id": "ef3b3133-c6fe-4492-84f9-211f520dd339", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-428761984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0fbc9073ba94f6e93d8491accb42231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00e3e0f-75", "ovs_interfaceid": "b00e3e0f-7501-4350-a065-d15b1d9e760a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:58:33 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:de:f0,bridge_name='br-int',has_traffic_filtering=True,id=b00e3e0f-7501-4350-a065-d15b1d9e760a,network=Network(ef3b3133-c6fe-4492-84f9-211f520dd339),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00e3e0f-75') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:58:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:58:33 user nova-compute[72239]:   <uuid>12c719bf-b770-4e41-b1f4-314eed1180c3</uuid>
Jul 31 14:58:33 user nova-compute[72239]:   <name>instance-0000001d</name>
Jul 31 14:58:33 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:58:33 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:58:33 user nova-compute[72239]:   <metadata>
Jul 31 14:58:33 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:58:33 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:58:33 user nova-compute[72239]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1132747549</nova:name>
Jul 31 14:58:33 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:58:32</nova:creationTime>
Jul 31 14:58:33 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:58:33 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:58:33 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:58:33 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:58:33 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:58:33 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:58:33 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:58:33 user nova-compute[72239]:       <nova:owner>
Jul 31 14:58:33 user nova-compute[72239]:         <nova:user uuid="946df3f784544702b6b057e66e23a97d">tempest-ServerActionsV293TestJSON-339927996-project-member</nova:user>
Jul 31 14:58:33 user nova-compute[72239]:         <nova:project uuid="b0fbc9073ba94f6e93d8491accb42231">tempest-ServerActionsV293TestJSON-339927996</nova:project>
Jul 31 14:58:33 user nova-compute[72239]:       </nova:owner>
Jul 31 14:58:33 user nova-compute[72239]:       <nova:ports>
Jul 31 14:58:33 user nova-compute[72239]:         <nova:port uuid="b00e3e0f-7501-4350-a065-d15b1d9e760a">
Jul 31 14:58:33 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 31 14:58:33 user nova-compute[72239]:         </nova:port>
Jul 31 14:58:33 user nova-compute[72239]:       </nova:ports>
Jul 31 14:58:33 user nova-compute[72239]:     </nova:instance>
Jul 31 14:58:33 user nova-compute[72239]:   </metadata>
Jul 31 14:58:33 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:58:33 user nova-compute[72239]:     <system>
Jul 31 14:58:33 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:58:33 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:58:33 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:58:33 user nova-compute[72239]:       <entry name="serial">12c719bf-b770-4e41-b1f4-314eed1180c3</entry>
Jul 31 14:58:33 user nova-compute[72239]:       <entry name="uuid">12c719bf-b770-4e41-b1f4-314eed1180c3</entry>
Jul 31 14:58:33 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:58:33 user nova-compute[72239]:     </system>
Jul 31 14:58:33 user nova-compute[72239]:   </sysinfo>
Jul 31 14:58:33 user nova-compute[72239]:   <os>
Jul 31 14:58:33 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:58:33 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:58:33 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:58:33 user nova-compute[72239]:   </os>
Jul 31 14:58:33 user nova-compute[72239]:   <features>
Jul 31 14:58:33 user nova-compute[72239]:     <acpi/>
Jul 31 14:58:33 user nova-compute[72239]:     <apic/>
Jul 31 14:58:33 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:58:33 user nova-compute[72239]:   </features>
Jul 31 14:58:33 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:58:33 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:58:33 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:58:33 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:58:33 user nova-compute[72239]:   </clock>
Jul 31 14:58:33 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:58:33 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:58:33 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:58:33 user nova-compute[72239]:   </cpu>
Jul 31 14:58:33 user nova-compute[72239]:   <devices>
Jul 31 14:58:33 user nova-compute[72239]:     <disk type="block" device="disk">
Jul 31 14:58:33 user nova-compute[72239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 14:58:33 user nova-compute[72239]:       <source dev="/dev/sdd"/>
Jul 31 14:58:33 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:58:33 user nova-compute[72239]:       <serial>0fa80825-8675-4494-a7fe-82e943c2e2a9</serial>
Jul 31 14:58:33 user nova-compute[72239]:     </disk>
Jul 31 14:58:33 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:58:33 user nova-compute[72239]:       <mac address="fa:16:3e:ce:de:f0"/>
Jul 31 14:58:33 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:58:33 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:58:33 user nova-compute[72239]:       <target dev="tapb00e3e0f-75"/>
Jul 31 14:58:33 user nova-compute[72239]:     </interface>
Jul 31 14:58:33 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:58:33 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/12c719bf-b770-4e41-b1f4-314eed1180c3/console.log" append="off"/>
Jul 31 14:58:33 user nova-compute[72239]:     </serial>
Jul 31 14:58:33 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:58:33 user nova-compute[72239]:     <video>
Jul 31 14:58:33 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:58:33 user nova-compute[72239]:     </video>
Jul 31 14:58:33 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:58:33 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:58:33 user nova-compute[72239]:     </rng>
Jul 31 14:58:33 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:58:33 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:58:33 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:58:33 user nova-compute[72239]:     </memballoon>
Jul 31 14:58:33 user nova-compute[72239]:   </devices>
Jul 31 14:58:33 user nova-compute[72239]: </domain>
Jul 31 14:58:33 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:58:34 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T14:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1132747549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1158607357',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOefbRzMHFRHe/taYVNRZdQ1lM3IwZrqbCHgRPaUWK30x1oz/dcn1gnm5m9yHdPFwXBxgCljdwQcUohfGqXNL+C58VJsKHYKFOGAUE4NcwzQ4SM+cFj8p3SAcs0gkt76tw==',key_name='tempest-keypair-1078194837',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:56:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='b0fbc9073ba94f6e93d8491accb42231',ramdisk_id='',reservation_id='r-ovcgrtjz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-339927996',owner_user_name='tempest-ServerActionsV293TestJSON-339927996-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:58:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='946df3f784544702b6b057e66e23a97d',uuid=12c719bf-b770-4e41-b1f4-314eed1180c3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b00e3e0f-7501-4350-a065-d15b1d9e760a", "address": "fa:16:3e:ce:de:f0", "network": {"id": "ef3b3133-c6fe-4492-84f9-211f520dd339", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-428761984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0fbc9073ba94f6e93d8491accb42231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00e3e0f-75", "ovs_interfaceid": "b00e3e0f-7501-4350-a065-d15b1d9e760a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:58:34 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Converting VIF {"id": "b00e3e0f-7501-4350-a065-d15b1d9e760a", "address": "fa:16:3e:ce:de:f0", "network": {"id": "ef3b3133-c6fe-4492-84f9-211f520dd339", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-428761984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0fbc9073ba94f6e93d8491accb42231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00e3e0f-75", "ovs_interfaceid": "b00e3e0f-7501-4350-a065-d15b1d9e760a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:58:34 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:de:f0,bridge_name='br-int',has_traffic_filtering=True,id=b00e3e0f-7501-4350-a065-d15b1d9e760a,network=Network(ef3b3133-c6fe-4492-84f9-211f520dd339),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00e3e0f-75') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:58:34 user nova-compute[72239]: DEBUG os_vif [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:de:f0,bridge_name='br-int',has_traffic_filtering=True,id=b00e3e0f-7501-4350-a065-d15b1d9e760a,network=Network(ef3b3133-c6fe-4492-84f9-211f520dd339),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00e3e0f-75') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:58:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:58:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:58:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb00e3e0f-75, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:58:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb00e3e0f-75, col_values=(('external_ids', {'iface-id': 'b00e3e0f-7501-4350-a065-d15b1d9e760a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:de:f0', 'vm-uuid': '12c719bf-b770-4e41-b1f4-314eed1180c3'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:58:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:58:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:34 user nova-compute[72239]: INFO os_vif [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:de:f0,bridge_name='br-int',has_traffic_filtering=True,id=b00e3e0f-7501-4350-a065-d15b1d9e760a,network=Network(ef3b3133-c6fe-4492-84f9-211f520dd339),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00e3e0f-75')
Jul 31 14:58:34 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:58:34 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] No VIF found with MAC fa:16:3e:ce:de:f0, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:58:34 user nova-compute[72239]: DEBUG nova.compute.manager [req-53fbab2a-3ac6-43c6-839d-ec1611af3046 req-83d2a21f-bd3c-46f0-ad19-5d8c7b48a7e9 service nova] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Received event network-vif-plugged-b3ad3fcc-4893-4a8d-b571-56531232aa38 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:58:34 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-53fbab2a-3ac6-43c6-839d-ec1611af3046 req-83d2a21f-bd3c-46f0-ad19-5d8c7b48a7e9 service nova] Acquiring lock "87dd3b4b-c511-4784-acf9-ad21534c8337-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:58:34 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-53fbab2a-3ac6-43c6-839d-ec1611af3046 req-83d2a21f-bd3c-46f0-ad19-5d8c7b48a7e9 service nova] Lock "87dd3b4b-c511-4784-acf9-ad21534c8337-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:58:34 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-53fbab2a-3ac6-43c6-839d-ec1611af3046 req-83d2a21f-bd3c-46f0-ad19-5d8c7b48a7e9 service nova] Lock "87dd3b4b-c511-4784-acf9-ad21534c8337-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:58:34 user nova-compute[72239]: DEBUG nova.compute.manager [req-53fbab2a-3ac6-43c6-839d-ec1611af3046 req-83d2a21f-bd3c-46f0-ad19-5d8c7b48a7e9 service nova] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] No waiting events found dispatching network-vif-plugged-b3ad3fcc-4893-4a8d-b571-56531232aa38 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:58:34 user nova-compute[72239]: WARNING nova.compute.manager [req-53fbab2a-3ac6-43c6-839d-ec1611af3046 req-83d2a21f-bd3c-46f0-ad19-5d8c7b48a7e9 service nova] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Received unexpected event network-vif-plugged-b3ad3fcc-4893-4a8d-b571-56531232aa38 for instance with vm_state deleted and task_state None.
Jul 31 14:58:34 user nova-compute[72239]: DEBUG nova.compute.manager [req-53fbab2a-3ac6-43c6-839d-ec1611af3046 req-83d2a21f-bd3c-46f0-ad19-5d8c7b48a7e9 service nova] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Received event network-vif-deleted-b3ad3fcc-4893-4a8d-b571-56531232aa38 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:58:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:36 user nova-compute[72239]: DEBUG nova.compute.manager [req-a1a4104d-00c2-4d3b-8167-8e2c14333c57 req-6a469da0-5b1a-42a2-9078-fc7017d4e423 service nova] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Received event network-vif-plugged-b00e3e0f-7501-4350-a065-d15b1d9e760a {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:58:36 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a1a4104d-00c2-4d3b-8167-8e2c14333c57 req-6a469da0-5b1a-42a2-9078-fc7017d4e423 service nova] Acquiring lock "12c719bf-b770-4e41-b1f4-314eed1180c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:58:36 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a1a4104d-00c2-4d3b-8167-8e2c14333c57 req-6a469da0-5b1a-42a2-9078-fc7017d4e423 service nova] Lock "12c719bf-b770-4e41-b1f4-314eed1180c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:58:36 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a1a4104d-00c2-4d3b-8167-8e2c14333c57 req-6a469da0-5b1a-42a2-9078-fc7017d4e423 service nova] Lock "12c719bf-b770-4e41-b1f4-314eed1180c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:58:36 user nova-compute[72239]: DEBUG nova.compute.manager [req-a1a4104d-00c2-4d3b-8167-8e2c14333c57 req-6a469da0-5b1a-42a2-9078-fc7017d4e423 service nova] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] No waiting events found dispatching network-vif-plugged-b00e3e0f-7501-4350-a065-d15b1d9e760a {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:58:36 user nova-compute[72239]: WARNING nova.compute.manager [req-a1a4104d-00c2-4d3b-8167-8e2c14333c57 req-6a469da0-5b1a-42a2-9078-fc7017d4e423 service nova] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Received unexpected event network-vif-plugged-b00e3e0f-7501-4350-a065-d15b1d9e760a for instance with vm_state active and task_state rebuild_spawning.
Jul 31 14:58:37 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815517.409284, 12c719bf-b770-4e41-b1f4-314eed1180c3 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:58:37 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] VM Resumed (Lifecycle Event)
Jul 31 14:58:37 user nova-compute[72239]: DEBUG nova.compute.manager [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:58:37 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 14:58:37 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Instance spawned successfully.
Jul 31 14:58:37 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 14:58:37 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:58:37 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:58:37 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:58:37 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:58:37 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:58:37 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:58:37 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:58:37 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:58:37 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 31 14:58:37 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815517.4132867, 12c719bf-b770-4e41-b1f4-314eed1180c3 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:58:37 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] VM Started (Lifecycle Event)
Jul 31 14:58:37 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:58:37 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:58:37 user nova-compute[72239]: DEBUG nova.compute.manager [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:58:37 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 31 14:58:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:58:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:58:37 user nova-compute[72239]: DEBUG nova.objects.instance [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Trying to apply a migration context that does not seem to be set for this instance {{(pid=72239) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 31 14:58:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-32216f82-9b6a-4c9a-b62d-1076e6d87160 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.068s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:58:38 user nova-compute[72239]: DEBUG nova.compute.manager [req-efe923d2-af0d-4a08-a445-2e748d8ee547 req-d6a9c10f-5db1-4536-a064-17e4aabc6f6c service nova] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Received event network-vif-plugged-b00e3e0f-7501-4350-a065-d15b1d9e760a {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:58:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-efe923d2-af0d-4a08-a445-2e748d8ee547 req-d6a9c10f-5db1-4536-a064-17e4aabc6f6c service nova] Acquiring lock "12c719bf-b770-4e41-b1f4-314eed1180c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:58:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-efe923d2-af0d-4a08-a445-2e748d8ee547 req-d6a9c10f-5db1-4536-a064-17e4aabc6f6c service nova] Lock "12c719bf-b770-4e41-b1f4-314eed1180c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:58:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-efe923d2-af0d-4a08-a445-2e748d8ee547 req-d6a9c10f-5db1-4536-a064-17e4aabc6f6c service nova] Lock "12c719bf-b770-4e41-b1f4-314eed1180c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:58:38 user nova-compute[72239]: DEBUG nova.compute.manager [req-efe923d2-af0d-4a08-a445-2e748d8ee547 req-d6a9c10f-5db1-4536-a064-17e4aabc6f6c service nova] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] No waiting events found dispatching network-vif-plugged-b00e3e0f-7501-4350-a065-d15b1d9e760a {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:58:38 user nova-compute[72239]: WARNING nova.compute.manager [req-efe923d2-af0d-4a08-a445-2e748d8ee547 req-d6a9c10f-5db1-4536-a064-17e4aabc6f6c service nova] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Received unexpected event network-vif-plugged-b00e3e0f-7501-4350-a065-d15b1d9e760a for instance with vm_state active and task_state None.
Jul 31 14:58:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f4b11879-cfca-4ffc-94fa-abb110a4bc70 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:58:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f4b11879-cfca-4ffc-94fa-abb110a4bc70 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:58:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f4b11879-cfca-4ffc-94fa-abb110a4bc70 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:58:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f4b11879-cfca-4ffc-94fa-abb110a4bc70 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:58:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f4b11879-cfca-4ffc-94fa-abb110a4bc70 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:58:46 user nova-compute[72239]: INFO nova.compute.manager [None req-f4b11879-cfca-4ffc-94fa-abb110a4bc70 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Terminating instance
Jul 31 14:58:46 user nova-compute[72239]: DEBUG nova.compute.manager [None req-f4b11879-cfca-4ffc-94fa-abb110a4bc70 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 14:58:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:46 user nova-compute[72239]: DEBUG nova.compute.manager [req-602c0289-f352-4639-9c35-5beb8a390a34 req-02605b29-a129-4ecb-96bd-827621c4db64 service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Received event network-vif-unplugged-4a60ced2-5c35-4f83-9734-e812bce6fad2 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:58:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-602c0289-f352-4639-9c35-5beb8a390a34 req-02605b29-a129-4ecb-96bd-827621c4db64 service nova] Acquiring lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:58:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-602c0289-f352-4639-9c35-5beb8a390a34 req-02605b29-a129-4ecb-96bd-827621c4db64 service nova] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:58:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-602c0289-f352-4639-9c35-5beb8a390a34 req-02605b29-a129-4ecb-96bd-827621c4db64 service nova] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:58:46 user nova-compute[72239]: DEBUG nova.compute.manager [req-602c0289-f352-4639-9c35-5beb8a390a34 req-02605b29-a129-4ecb-96bd-827621c4db64 service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] No waiting events found dispatching network-vif-unplugged-4a60ced2-5c35-4f83-9734-e812bce6fad2 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:58:46 user nova-compute[72239]: DEBUG nova.compute.manager [req-602c0289-f352-4639-9c35-5beb8a390a34 req-02605b29-a129-4ecb-96bd-827621c4db64 service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Received event network-vif-unplugged-4a60ced2-5c35-4f83-9734-e812bce6fad2 for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 14:58:47 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Instance destroyed successfully.
Jul 31 14:58:47 user nova-compute[72239]: DEBUG nova.objects.instance [None req-f4b11879-cfca-4ffc-94fa-abb110a4bc70 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lazy-loading 'resources' on Instance uuid db15ad45-8f28-4e0c-8d7e-7db75f33fe92 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:58:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-f4b11879-cfca-4ffc-94fa-abb110a4bc70 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:49:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1651644081',display_name='tempest-AttachVolumeTestJSON-server-1651644081',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1651644081',id=17,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLc/1qoHPqiofv/4pq100FlHUUylmOhucQEOjm11Kc1EqvJcfHvM7rWQswLn8aCkbuoEn1btWVn/JCFreVgCA/Qh5g2ERD7C+D0EfwpykQR0pThmq61xI0NeRT3g5N4h2A==',key_name='tempest-keypair-1206654507',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:49:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a18e5e2cd6854f0985aa161b1e8a6db7',ramdisk_id='',reservation_id='r-32farejl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-853601938',owner_user_name='tempest-AttachVolumeTestJSON-853601938-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:57:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f8df817a91d41c8a421e2ba562c5015',uuid=db15ad45-8f28-4e0c-8d7e-7db75f33fe92,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "address": "fa:16:3e:55:1a:9a", "network": {"id": "50e01a2d-5e91-4aca-a74c-7687f91ed21e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-937098047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e5e2cd6854f0985aa161b1e8a6db7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a60ced2-5c", "ovs_interfaceid": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:58:47 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-f4b11879-cfca-4ffc-94fa-abb110a4bc70 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Converting VIF {"id": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "address": "fa:16:3e:55:1a:9a", "network": {"id": "50e01a2d-5e91-4aca-a74c-7687f91ed21e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-937098047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.150", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e5e2cd6854f0985aa161b1e8a6db7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a60ced2-5c", "ovs_interfaceid": "4a60ced2-5c35-4f83-9734-e812bce6fad2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:58:47 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-f4b11879-cfca-4ffc-94fa-abb110a4bc70 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:1a:9a,bridge_name='br-int',has_traffic_filtering=True,id=4a60ced2-5c35-4f83-9734-e812bce6fad2,network=Network(50e01a2d-5e91-4aca-a74c-7687f91ed21e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a60ced2-5c') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:58:47 user nova-compute[72239]: DEBUG os_vif [None req-f4b11879-cfca-4ffc-94fa-abb110a4bc70 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:1a:9a,bridge_name='br-int',has_traffic_filtering=True,id=4a60ced2-5c35-4f83-9734-e812bce6fad2,network=Network(50e01a2d-5e91-4aca-a74c-7687f91ed21e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a60ced2-5c') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:58:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a60ced2-5c, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:58:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:58:47 user nova-compute[72239]: INFO os_vif [None req-f4b11879-cfca-4ffc-94fa-abb110a4bc70 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:1a:9a,bridge_name='br-int',has_traffic_filtering=True,id=4a60ced2-5c35-4f83-9734-e812bce6fad2,network=Network(50e01a2d-5e91-4aca-a74c-7687f91ed21e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4a60ced2-5c')
Jul 31 14:58:47 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-f4b11879-cfca-4ffc-94fa-abb110a4bc70 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Deleting instance files /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92_del
Jul 31 14:58:47 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-f4b11879-cfca-4ffc-94fa-abb110a4bc70 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Deletion of /opt/stack/data/nova/instances/db15ad45-8f28-4e0c-8d7e-7db75f33fe92_del complete
Jul 31 14:58:47 user nova-compute[72239]: INFO nova.compute.manager [None req-f4b11879-cfca-4ffc-94fa-abb110a4bc70 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Took 0.69 seconds to destroy the instance on the hypervisor.
Jul 31 14:58:47 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-f4b11879-cfca-4ffc-94fa-abb110a4bc70 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 14:58:47 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 14:58:47 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 14:58:47 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690815512.4276066, 87dd3b4b-c511-4784-acf9-ad21534c8337 => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:58:47 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] VM Stopped (Lifecycle Event)
Jul 31 14:58:47 user nova-compute[72239]: DEBUG nova.compute.manager [None req-6915a48b-3950-4d57-8285-d51cfd928ead None None] [instance: 87dd3b4b-c511-4784-acf9-ad21534c8337] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:58:48 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:58:48 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Took 0.93 seconds to deallocate network for instance.
Jul 31 14:58:48 user nova-compute[72239]: DEBUG nova.compute.manager [req-fbccc391-95fd-4e99-b645-fc1fdc69f3a8 req-6d8b8980-7a43-49d5-88f9-0e704fd0d3e7 service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Received event network-vif-deleted-4a60ced2-5c35-4f83-9734-e812bce6fad2 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:58:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f4b11879-cfca-4ffc-94fa-abb110a4bc70 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:58:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f4b11879-cfca-4ffc-94fa-abb110a4bc70 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:58:48 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-f4b11879-cfca-4ffc-94fa-abb110a4bc70 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:58:48 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-f4b11879-cfca-4ffc-94fa-abb110a4bc70 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:58:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f4b11879-cfca-4ffc-94fa-abb110a4bc70 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.423s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:58:48 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-f4b11879-cfca-4ffc-94fa-abb110a4bc70 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Deleted allocations for instance db15ad45-8f28-4e0c-8d7e-7db75f33fe92
Jul 31 14:58:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-f4b11879-cfca-4ffc-94fa-abb110a4bc70 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.258s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:58:48 user nova-compute[72239]: DEBUG nova.compute.manager [req-19c7a799-1648-41dd-a4b3-2e4db471ce26 req-c066f757-180f-44a6-b5f3-1abcc5e2bb1b service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Received event network-vif-plugged-4a60ced2-5c35-4f83-9734-e812bce6fad2 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:58:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-19c7a799-1648-41dd-a4b3-2e4db471ce26 req-c066f757-180f-44a6-b5f3-1abcc5e2bb1b service nova] Acquiring lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:58:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-19c7a799-1648-41dd-a4b3-2e4db471ce26 req-c066f757-180f-44a6-b5f3-1abcc5e2bb1b service nova] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:58:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-19c7a799-1648-41dd-a4b3-2e4db471ce26 req-c066f757-180f-44a6-b5f3-1abcc5e2bb1b service nova] Lock "db15ad45-8f28-4e0c-8d7e-7db75f33fe92-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:58:48 user nova-compute[72239]: DEBUG nova.compute.manager [req-19c7a799-1648-41dd-a4b3-2e4db471ce26 req-c066f757-180f-44a6-b5f3-1abcc5e2bb1b service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] No waiting events found dispatching network-vif-plugged-4a60ced2-5c35-4f83-9734-e812bce6fad2 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:58:48 user nova-compute[72239]: WARNING nova.compute.manager [req-19c7a799-1648-41dd-a4b3-2e4db471ce26 req-c066f757-180f-44a6-b5f3-1abcc5e2bb1b service nova] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Received unexpected event network-vif-plugged-4a60ced2-5c35-4f83-9734-e812bce6fad2 for instance with vm_state deleted and task_state None.
Jul 31 14:58:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:58:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:02 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690815527.11477, db15ad45-8f28-4e0c-8d7e-7db75f33fe92 => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:59:02 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] VM Stopped (Lifecycle Event)
Jul 31 14:59:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:02 user nova-compute[72239]: DEBUG nova.compute.manager [None req-342f5572-6e40-4993-a0b0-3a02e574bf46 None None] [instance: db15ad45-8f28-4e0c-8d7e-7db75f33fe92] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:59:04 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:59:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-cb35f6e1-3580-416d-8221-d0498f59a4af tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Acquiring lock "bc1b9270-ccf7-4127-a3fd-cab56d362f0d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-cb35f6e1-3580-416d-8221-d0498f59a4af tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Lock "bc1b9270-ccf7-4127-a3fd-cab56d362f0d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-cb35f6e1-3580-416d-8221-d0498f59a4af tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Acquiring lock "bc1b9270-ccf7-4127-a3fd-cab56d362f0d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-cb35f6e1-3580-416d-8221-d0498f59a4af tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Lock "bc1b9270-ccf7-4127-a3fd-cab56d362f0d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-cb35f6e1-3580-416d-8221-d0498f59a4af tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Lock "bc1b9270-ccf7-4127-a3fd-cab56d362f0d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:06 user nova-compute[72239]: INFO nova.compute.manager [None req-cb35f6e1-3580-416d-8221-d0498f59a4af tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Terminating instance
Jul 31 14:59:06 user nova-compute[72239]: DEBUG nova.compute.manager [None req-cb35f6e1-3580-416d-8221-d0498f59a4af tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 14:59:06 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:06 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:06 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:06 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:06 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:59:06 user nova-compute[72239]: DEBUG nova.compute.manager [req-ed432dde-b246-43c2-b4d9-200a82c5a8b4 req-9a6663ba-17a8-4727-872e-bdf6c44764d9 service nova] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Received event network-vif-unplugged-84f0ba8c-8039-4217-9a8b-1f4e2b40e027 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:59:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ed432dde-b246-43c2-b4d9-200a82c5a8b4 req-9a6663ba-17a8-4727-872e-bdf6c44764d9 service nova] Acquiring lock "bc1b9270-ccf7-4127-a3fd-cab56d362f0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ed432dde-b246-43c2-b4d9-200a82c5a8b4 req-9a6663ba-17a8-4727-872e-bdf6c44764d9 service nova] Lock "bc1b9270-ccf7-4127-a3fd-cab56d362f0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ed432dde-b246-43c2-b4d9-200a82c5a8b4 req-9a6663ba-17a8-4727-872e-bdf6c44764d9 service nova] Lock "bc1b9270-ccf7-4127-a3fd-cab56d362f0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:06 user nova-compute[72239]: DEBUG nova.compute.manager [req-ed432dde-b246-43c2-b4d9-200a82c5a8b4 req-9a6663ba-17a8-4727-872e-bdf6c44764d9 service nova] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] No waiting events found dispatching network-vif-unplugged-84f0ba8c-8039-4217-9a8b-1f4e2b40e027 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:59:06 user nova-compute[72239]: DEBUG nova.compute.manager [req-ed432dde-b246-43c2-b4d9-200a82c5a8b4 req-9a6663ba-17a8-4727-872e-bdf6c44764d9 service nova] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Received event network-vif-unplugged-84f0ba8c-8039-4217-9a8b-1f4e2b40e027 for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 14:59:06 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Instance destroyed successfully.
Jul 31 14:59:06 user nova-compute[72239]: DEBUG nova.objects.instance [None req-cb35f6e1-3580-416d-8221-d0498f59a4af tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Lazy-loading 'resources' on Instance uuid bc1b9270-ccf7-4127-a3fd-cab56d362f0d {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:59:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-cb35f6e1-3580-416d-8221-d0498f59a4af tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:57:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-33641494',display_name='tempest-VolumesNegativeTest-instance-33641494',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-33641494',id=30,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:57:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c951e0df58d342ecb09fe0cd5a78faf1',ramdisk_id='',reservation_id='r-dnttx2f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-783587187',owner_user_name='tempest-VolumesNegativeTest-783587187-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:57:24Z,user_data=None,user_id='0d9b82d0ef5c4d3eb979876c7d5d55f5',uuid=bc1b9270-ccf7-4127-a3fd-cab56d362f0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84f0ba8c-8039-4217-9a8b-1f4e2b40e027", "address": "fa:16:3e:36:0b:3a", "network": {"id": "bbf0bef1-878c-4e9c-96d1-0c54c8b0ff68", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "be985e778f1041c8a2378f305504c462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f0ba8c-80", "ovs_interfaceid": "84f0ba8c-8039-4217-9a8b-1f4e2b40e027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:59:06 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-cb35f6e1-3580-416d-8221-d0498f59a4af tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Converting VIF {"id": "84f0ba8c-8039-4217-9a8b-1f4e2b40e027", "address": "fa:16:3e:36:0b:3a", "network": {"id": "bbf0bef1-878c-4e9c-96d1-0c54c8b0ff68", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.176", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "be985e778f1041c8a2378f305504c462", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f0ba8c-80", "ovs_interfaceid": "84f0ba8c-8039-4217-9a8b-1f4e2b40e027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:59:06 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-cb35f6e1-3580-416d-8221-d0498f59a4af tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:0b:3a,bridge_name='br-int',has_traffic_filtering=True,id=84f0ba8c-8039-4217-9a8b-1f4e2b40e027,network=Network(bbf0bef1-878c-4e9c-96d1-0c54c8b0ff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84f0ba8c-80') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:59:06 user nova-compute[72239]: DEBUG os_vif [None req-cb35f6e1-3580-416d-8221-d0498f59a4af tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:0b:3a,bridge_name='br-int',has_traffic_filtering=True,id=84f0ba8c-8039-4217-9a8b-1f4e2b40e027,network=Network(bbf0bef1-878c-4e9c-96d1-0c54c8b0ff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84f0ba8c-80') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:59:06 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:06 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84f0ba8c-80, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:59:06 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:06 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:59:06 user nova-compute[72239]: INFO os_vif [None req-cb35f6e1-3580-416d-8221-d0498f59a4af tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:0b:3a,bridge_name='br-int',has_traffic_filtering=True,id=84f0ba8c-8039-4217-9a8b-1f4e2b40e027,network=Network(bbf0bef1-878c-4e9c-96d1-0c54c8b0ff68),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84f0ba8c-80')
Jul 31 14:59:06 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-cb35f6e1-3580-416d-8221-d0498f59a4af tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Deleting instance files /opt/stack/data/nova/instances/bc1b9270-ccf7-4127-a3fd-cab56d362f0d_del
Jul 31 14:59:06 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-cb35f6e1-3580-416d-8221-d0498f59a4af tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Deletion of /opt/stack/data/nova/instances/bc1b9270-ccf7-4127-a3fd-cab56d362f0d_del complete
Jul 31 14:59:07 user nova-compute[72239]: INFO nova.compute.manager [None req-cb35f6e1-3580-416d-8221-d0498f59a4af tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 31 14:59:07 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-cb35f6e1-3580-416d-8221-d0498f59a4af tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 14:59:07 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 14:59:07 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 14:59:07 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:59:07 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:59:07 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:59:07 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Took 0.60 seconds to deallocate network for instance.
Jul 31 14:59:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-cb35f6e1-3580-416d-8221-d0498f59a4af tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-cb35f6e1-3580-416d-8221-d0498f59a4af tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:07 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-cb35f6e1-3580-416d-8221-d0498f59a4af tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:59:07 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-cb35f6e1-3580-416d-8221-d0498f59a4af tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:59:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-cb35f6e1-3580-416d-8221-d0498f59a4af tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:08 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-cb35f6e1-3580-416d-8221-d0498f59a4af tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Deleted allocations for instance bc1b9270-ccf7-4127-a3fd-cab56d362f0d
Jul 31 14:59:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-cb35f6e1-3580-416d-8221-d0498f59a4af tempest-VolumesNegativeTest-783587187 tempest-VolumesNegativeTest-783587187-project-member] Lock "bc1b9270-ccf7-4127-a3fd-cab56d362f0d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.020s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:08 user nova-compute[72239]: DEBUG nova.compute.manager [req-bd88dfea-7a3d-42e7-b4b4-bcdd58c5ca14 req-4ae10f03-af0a-4378-ae11-844b9ac79c80 service nova] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Received event network-vif-plugged-84f0ba8c-8039-4217-9a8b-1f4e2b40e027 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:59:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-bd88dfea-7a3d-42e7-b4b4-bcdd58c5ca14 req-4ae10f03-af0a-4378-ae11-844b9ac79c80 service nova] Acquiring lock "bc1b9270-ccf7-4127-a3fd-cab56d362f0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-bd88dfea-7a3d-42e7-b4b4-bcdd58c5ca14 req-4ae10f03-af0a-4378-ae11-844b9ac79c80 service nova] Lock "bc1b9270-ccf7-4127-a3fd-cab56d362f0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-bd88dfea-7a3d-42e7-b4b4-bcdd58c5ca14 req-4ae10f03-af0a-4378-ae11-844b9ac79c80 service nova] Lock "bc1b9270-ccf7-4127-a3fd-cab56d362f0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:08 user nova-compute[72239]: DEBUG nova.compute.manager [req-bd88dfea-7a3d-42e7-b4b4-bcdd58c5ca14 req-4ae10f03-af0a-4378-ae11-844b9ac79c80 service nova] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] No waiting events found dispatching network-vif-plugged-84f0ba8c-8039-4217-9a8b-1f4e2b40e027 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:59:08 user nova-compute[72239]: WARNING nova.compute.manager [req-bd88dfea-7a3d-42e7-b4b4-bcdd58c5ca14 req-4ae10f03-af0a-4378-ae11-844b9ac79c80 service nova] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Received unexpected event network-vif-plugged-84f0ba8c-8039-4217-9a8b-1f4e2b40e027 for instance with vm_state deleted and task_state None.
Jul 31 14:59:08 user nova-compute[72239]: DEBUG nova.compute.manager [req-bd88dfea-7a3d-42e7-b4b4-bcdd58c5ca14 req-4ae10f03-af0a-4378-ae11-844b9ac79c80 service nova] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Received event network-vif-deleted-84f0ba8c-8039-4217-9a8b-1f4e2b40e027 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:59:09 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:59:09 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 14:59:09 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Rebuilding the list of instances to heal {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 14:59:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-20abf743-de5b-4122-aad0-e2124c7804b7" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:59:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-20abf743-de5b-4122-aad0-e2124c7804b7" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:59:09 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 14:59:09 user nova-compute[72239]: DEBUG nova.objects.instance [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lazy-loading 'info_cache' on Instance uuid 20abf743-de5b-4122-aad0-e2124c7804b7 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:59:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:10 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Updating instance_info_cache with network_info: [{"id": "025cadd3-7b0b-4a32-a973-d48a5ce7cfb4", "address": "fa:16:3e:5e:74:46", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap025cadd3-7b", "ovs_interfaceid": "025cadd3-7b0b-4a32-a973-d48a5ce7cfb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:59:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-20abf743-de5b-4122-aad0-e2124c7804b7" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:59:10 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 14:59:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "b8652db6-b595-497f-a55d-8c0520bc18aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "b8652db6-b595-497f-a55d-8c0520bc18aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:10 user nova-compute[72239]: DEBUG nova.compute.manager [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 14:59:10 user nova-compute[72239]: INFO nova.compute.manager [None req-6fe421f8-250c-407d-a67c-502925154fde tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Unrescuing
Jul 31 14:59:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6fe421f8-250c-407d-a67c-502925154fde tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "refresh_cache-e6f6d85d-ffa0-4d72-b521-e855afa23a09" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:59:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6fe421f8-250c-407d-a67c-502925154fde tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquired lock "refresh_cache-e6f6d85d-ffa0-4d72-b521-e855afa23a09" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:59:10 user nova-compute[72239]: DEBUG nova.network.neutron [None req-6fe421f8-250c-407d-a67c-502925154fde tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:59:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:10 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:59:10 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:59:10 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:59:10 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 14:59:10 user nova-compute[72239]: INFO nova.compute.claims [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Claim successful on node user
Jul 31 14:59:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:10 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:59:10 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:59:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.446s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:10 user nova-compute[72239]: DEBUG nova.compute.manager [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 14:59:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.420s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:10 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 14:59:10 user nova-compute[72239]: DEBUG nova.compute.manager [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 14:59:10 user nova-compute[72239]: DEBUG nova.network.neutron [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 14:59:10 user nova-compute[72239]: DEBUG nova.network.neutron [None req-6fe421f8-250c-407d-a67c-502925154fde tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Updating instance_info_cache with network_info: [{"id": "5c7f836e-274b-4a20-915a-d28d7e70d2a3", "address": "fa:16:3e:78:53:e9", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7f836e-27", "ovs_interfaceid": "5c7f836e-274b-4a20-915a-d28d7e70d2a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:59:10 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 14:59:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6fe421f8-250c-407d-a67c-502925154fde tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Releasing lock "refresh_cache-e6f6d85d-ffa0-4d72-b521-e855afa23a09" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:59:10 user nova-compute[72239]: DEBUG nova.objects.instance [None req-6fe421f8-250c-407d-a67c-502925154fde tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lazy-loading 'flavor' on Instance uuid e6f6d85d-ffa0-4d72-b521-e855afa23a09 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:59:10 user nova-compute[72239]: DEBUG nova.compute.manager [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG nova.policy [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '70c6001a7ac5434fbc5ac7d003edd4eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a6715a7ff38401d844b620cb8d8769e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG nova.compute.manager [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 14:59:11 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Creating image(s)
Jul 31 14:59:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "/opt/stack/data/nova/instances/b8652db6-b595-497f-a55d-8c0520bc18aa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "/opt/stack/data/nova/instances/b8652db6-b595-497f-a55d-8c0520bc18aa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "/opt/stack/data/nova/instances/b8652db6-b595-497f-a55d-8c0520bc18aa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.140s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "ca449065000c92aac3b7b9fa685f9a7710929444" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG nova.compute.manager [req-8a0de9f9-06b9-4283-8621-32c24c9063bf req-34eb25d7-6731-4f49-9c71-8d5990a3dc74 service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Received event network-vif-unplugged-5c7f836e-274b-4a20-915a-d28d7e70d2a3 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-8a0de9f9-06b9-4283-8621-32c24c9063bf req-34eb25d7-6731-4f49-9c71-8d5990a3dc74 service nova] Acquiring lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-8a0de9f9-06b9-4283-8621-32c24c9063bf req-34eb25d7-6731-4f49-9c71-8d5990a3dc74 service nova] Lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-8a0de9f9-06b9-4283-8621-32c24c9063bf req-34eb25d7-6731-4f49-9c71-8d5990a3dc74 service nova] Lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG nova.compute.manager [req-8a0de9f9-06b9-4283-8621-32c24c9063bf req-34eb25d7-6731-4f49-9c71-8d5990a3dc74 service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] No waiting events found dispatching network-vif-unplugged-5c7f836e-274b-4a20-915a-d28d7e70d2a3 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:59:11 user nova-compute[72239]: WARNING nova.compute.manager [req-8a0de9f9-06b9-4283-8621-32c24c9063bf req-34eb25d7-6731-4f49-9c71-8d5990a3dc74 service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Received unexpected event network-vif-unplugged-5c7f836e-274b-4a20-915a-d28d7e70d2a3 for instance with vm_state rescued and task_state unrescuing.
Jul 31 14:59:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.141s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/b8652db6-b595-497f-a55d-8c0520bc18aa/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/b8652db6-b595-497f-a55d-8c0520bc18aa/disk 1073741824" returned: 0 in 0.063s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f6d85d-ffa0-4d72-b521-e855afa23a09/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.144s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b8652db6-b595-497f-a55d-8c0520bc18aa/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8652db6-b595-497f-a55d-8c0520bc18aa/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f6d85d-ffa0-4d72-b521-e855afa23a09/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f6d85d-ffa0-4d72-b521-e855afa23a09/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8652db6-b595-497f-a55d-8c0520bc18aa/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG nova.network.neutron [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Successfully created port: 7c709373-3d22-47b8-84d4-2a66ab39628a {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Cannot resize image /opt/stack/data/nova/instances/b8652db6-b595-497f-a55d-8c0520bc18aa/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG nova.objects.instance [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lazy-loading 'migration_context' on Instance uuid b8652db6-b595-497f-a55d-8c0520bc18aa {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:59:11 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Instance destroyed successfully.
Jul 31 14:59:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Ensure instance console log exists: /opt/stack/data/nova/instances/b8652db6-b595-497f-a55d-8c0520bc18aa/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e6f6d85d-ffa0-4d72-b521-e855afa23a09/disk.rescue --force-share --output=json" returned: 0 in 0.151s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:59:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json" returned: 0 in 0.141s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:12 user nova-compute[72239]: DEBUG nova.network.neutron [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Successfully updated port: 7c709373-3d22-47b8-84d4-2a66ab39628a {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:59:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "refresh_cache-b8652db6-b595-497f-a55d-8c0520bc18aa" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:59:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquired lock "refresh_cache-b8652db6-b595-497f-a55d-8c0520bc18aa" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:59:12 user nova-compute[72239]: DEBUG nova.network.neutron [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:59:12 user nova-compute[72239]: DEBUG nova.compute.manager [req-0aac7445-49ed-4abc-aa6f-e9f676e56ba4 req-0750a4bf-f318-427e-b0d6-5a1ab1ee51bd service nova] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Received event network-changed-7c709373-3d22-47b8-84d4-2a66ab39628a {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:59:12 user nova-compute[72239]: DEBUG nova.compute.manager [req-0aac7445-49ed-4abc-aa6f-e9f676e56ba4 req-0750a4bf-f318-427e-b0d6-5a1ab1ee51bd service nova] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Refreshing instance network info cache due to event network-changed-7c709373-3d22-47b8-84d4-2a66ab39628a. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:59:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0aac7445-49ed-4abc-aa6f-e9f676e56ba4 req-0750a4bf-f318-427e-b0d6-5a1ab1ee51bd service nova] Acquiring lock "refresh_cache-b8652db6-b595-497f-a55d-8c0520bc18aa" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:59:12 user nova-compute[72239]: DEBUG nova.network.neutron [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:59:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG nova.network.neutron [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Updating instance_info_cache with network_info: [{"id": "7c709373-3d22-47b8-84d4-2a66ab39628a", "address": "fa:16:3e:9c:a0:63", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c709373-3d", "ovs_interfaceid": "7c709373-3d22-47b8-84d4-2a66ab39628a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Releasing lock "refresh_cache-b8652db6-b595-497f-a55d-8c0520bc18aa" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG nova.compute.manager [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Instance network_info: |[{"id": "7c709373-3d22-47b8-84d4-2a66ab39628a", "address": "fa:16:3e:9c:a0:63", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c709373-3d", "ovs_interfaceid": "7c709373-3d22-47b8-84d4-2a66ab39628a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0aac7445-49ed-4abc-aa6f-e9f676e56ba4 req-0750a4bf-f318-427e-b0d6-5a1ab1ee51bd service nova] Acquired lock "refresh_cache-b8652db6-b595-497f-a55d-8c0520bc18aa" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG nova.network.neutron [req-0aac7445-49ed-4abc-aa6f-e9f676e56ba4 req-0750a4bf-f318-427e-b0d6-5a1ab1ee51bd service nova] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Refreshing network info cache for port 7c709373-3d22-47b8-84d4-2a66ab39628a {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Start _get_guest_xml network_info=[{"id": "7c709373-3d22-47b8-84d4-2a66ab39628a", "address": "fa:16:3e:9c:a0:63", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c709373-3d", "ovs_interfaceid": "7c709373-3d22-47b8-84d4-2a66ab39628a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:13 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:59:13 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:59:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:59:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1746021859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1746021859',id=32,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnHcaugoyVumipcH9iWbR1lH6GyUbvVWTu+gfxF3nDw9/alFMI2osrbpxmfLtRTIlFFqqtkJSfR4W10naiWe1TJWlwBT0OPz5w5h/X7U2hW973fUJVazvi3CvbACNSR5w==',key_name='tempest-keypair-1252123597',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a6715a7ff38401d844b620cb8d8769e',ramdisk_id='',reservation_id='r-twj02w4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-599528407',owner_user_name='tempest-AttachVolumeShelveTestJSON-599528407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:59:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70c6001a7ac5434fbc5ac7d003edd4eb',uuid=b8652db6-b595-497f-a55d-8c0520bc18aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c709373-3d22-47b8-84d4-2a66ab39628a", "address": "fa:16:3e:9c:a0:63", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c709373-3d", "ovs_interfaceid": "7c709373-3d22-47b8-84d4-2a66ab39628a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Converting VIF {"id": "7c709373-3d22-47b8-84d4-2a66ab39628a", "address": "fa:16:3e:9c:a0:63", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c709373-3d", "ovs_interfaceid": "7c709373-3d22-47b8-84d4-2a66ab39628a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:a0:63,bridge_name='br-int',has_traffic_filtering=True,id=7c709373-3d22-47b8-84d4-2a66ab39628a,network=Network(37a946a3-d20a-4694-8647-73e84d2b0cb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c709373-3d') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG nova.objects.instance [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lazy-loading 'pci_devices' on Instance uuid b8652db6-b595-497f-a55d-8c0520bc18aa {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:59:13 user nova-compute[72239]:   <uuid>b8652db6-b595-497f-a55d-8c0520bc18aa</uuid>
Jul 31 14:59:13 user nova-compute[72239]:   <name>instance-00000020</name>
Jul 31 14:59:13 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:59:13 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:59:13 user nova-compute[72239]:   <metadata>
Jul 31 14:59:13 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:59:13 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:59:13 user nova-compute[72239]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1746021859</nova:name>
Jul 31 14:59:13 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:59:13</nova:creationTime>
Jul 31 14:59:13 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:59:13 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:59:13 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:59:13 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:59:13 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:59:13 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:59:13 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:59:13 user nova-compute[72239]:       <nova:owner>
Jul 31 14:59:13 user nova-compute[72239]:         <nova:user uuid="70c6001a7ac5434fbc5ac7d003edd4eb">tempest-AttachVolumeShelveTestJSON-599528407-project-member</nova:user>
Jul 31 14:59:13 user nova-compute[72239]:         <nova:project uuid="5a6715a7ff38401d844b620cb8d8769e">tempest-AttachVolumeShelveTestJSON-599528407</nova:project>
Jul 31 14:59:13 user nova-compute[72239]:       </nova:owner>
Jul 31 14:59:13 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:59:13 user nova-compute[72239]:       <nova:ports>
Jul 31 14:59:13 user nova-compute[72239]:         <nova:port uuid="7c709373-3d22-47b8-84d4-2a66ab39628a">
Jul 31 14:59:13 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 31 14:59:13 user nova-compute[72239]:         </nova:port>
Jul 31 14:59:13 user nova-compute[72239]:       </nova:ports>
Jul 31 14:59:13 user nova-compute[72239]:     </nova:instance>
Jul 31 14:59:13 user nova-compute[72239]:   </metadata>
Jul 31 14:59:13 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:59:13 user nova-compute[72239]:     <system>
Jul 31 14:59:13 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:59:13 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:59:13 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:59:13 user nova-compute[72239]:       <entry name="serial">b8652db6-b595-497f-a55d-8c0520bc18aa</entry>
Jul 31 14:59:13 user nova-compute[72239]:       <entry name="uuid">b8652db6-b595-497f-a55d-8c0520bc18aa</entry>
Jul 31 14:59:13 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:59:13 user nova-compute[72239]:     </system>
Jul 31 14:59:13 user nova-compute[72239]:   </sysinfo>
Jul 31 14:59:13 user nova-compute[72239]:   <os>
Jul 31 14:59:13 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:59:13 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:59:13 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:59:13 user nova-compute[72239]:   </os>
Jul 31 14:59:13 user nova-compute[72239]:   <features>
Jul 31 14:59:13 user nova-compute[72239]:     <acpi/>
Jul 31 14:59:13 user nova-compute[72239]:     <apic/>
Jul 31 14:59:13 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:59:13 user nova-compute[72239]:   </features>
Jul 31 14:59:13 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:59:13 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:59:13 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:59:13 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:59:13 user nova-compute[72239]:   </clock>
Jul 31 14:59:13 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:59:13 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:59:13 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:59:13 user nova-compute[72239]:   </cpu>
Jul 31 14:59:13 user nova-compute[72239]:   <devices>
Jul 31 14:59:13 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:59:13 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:59:13 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/b8652db6-b595-497f-a55d-8c0520bc18aa/disk"/>
Jul 31 14:59:13 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:59:13 user nova-compute[72239]:     </disk>
Jul 31 14:59:13 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:59:13 user nova-compute[72239]:       <mac address="fa:16:3e:9c:a0:63"/>
Jul 31 14:59:13 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:59:13 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:59:13 user nova-compute[72239]:       <target dev="tap7c709373-3d"/>
Jul 31 14:59:13 user nova-compute[72239]:     </interface>
Jul 31 14:59:13 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:59:13 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/b8652db6-b595-497f-a55d-8c0520bc18aa/console.log" append="off"/>
Jul 31 14:59:13 user nova-compute[72239]:     </serial>
Jul 31 14:59:13 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:59:13 user nova-compute[72239]:     <video>
Jul 31 14:59:13 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:59:13 user nova-compute[72239]:     </video>
Jul 31 14:59:13 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:59:13 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:59:13 user nova-compute[72239]:     </rng>
Jul 31 14:59:13 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:59:13 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:59:13 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:59:13 user nova-compute[72239]:     </memballoon>
Jul 31 14:59:13 user nova-compute[72239]:   </devices>
Jul 31 14:59:13 user nova-compute[72239]: </domain>
Jul 31 14:59:13 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:59:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1746021859',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1746021859',id=32,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnHcaugoyVumipcH9iWbR1lH6GyUbvVWTu+gfxF3nDw9/alFMI2osrbpxmfLtRTIlFFqqtkJSfR4W10naiWe1TJWlwBT0OPz5w5h/X7U2hW973fUJVazvi3CvbACNSR5w==',key_name='tempest-keypair-1252123597',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a6715a7ff38401d844b620cb8d8769e',ramdisk_id='',reservation_id='r-twj02w4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-599528407',owner_user_name='tempest-AttachVolumeShelveTestJSON-599528407-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:59:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70c6001a7ac5434fbc5ac7d003edd4eb',uuid=b8652db6-b595-497f-a55d-8c0520bc18aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c709373-3d22-47b8-84d4-2a66ab39628a", "address": "fa:16:3e:9c:a0:63", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c709373-3d", "ovs_interfaceid": "7c709373-3d22-47b8-84d4-2a66ab39628a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Converting VIF {"id": "7c709373-3d22-47b8-84d4-2a66ab39628a", "address": "fa:16:3e:9c:a0:63", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c709373-3d", "ovs_interfaceid": "7c709373-3d22-47b8-84d4-2a66ab39628a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:a0:63,bridge_name='br-int',has_traffic_filtering=True,id=7c709373-3d22-47b8-84d4-2a66ab39628a,network=Network(37a946a3-d20a-4694-8647-73e84d2b0cb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c709373-3d') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG os_vif [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:a0:63,bridge_name='br-int',has_traffic_filtering=True,id=7c709373-3d22-47b8-84d4-2a66ab39628a,network=Network(37a946a3-d20a-4694-8647-73e84d2b0cb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c709373-3d') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c709373-3d, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7c709373-3d, col_values=(('external_ids', {'iface-id': '7c709373-3d22-47b8-84d4-2a66ab39628a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:a0:63', 'vm-uuid': 'b8652db6-b595-497f-a55d-8c0520bc18aa'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:13 user nova-compute[72239]: INFO os_vif [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:a0:63,bridge_name='br-int',has_traffic_filtering=True,id=7c709373-3d22-47b8-84d4-2a66ab39628a,network=Network(37a946a3-d20a-4694-8647-73e84d2b0cb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c709373-3d')
Jul 31 14:59:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] No VIF found with MAC fa:16:3e:9c:a0:63, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG nova.compute.manager [req-b2c1eac4-f1ac-4d96-b4eb-6016e151cd0f req-1b3d6614-45c0-4639-b747-823652779ac6 service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Received event network-vif-plugged-5c7f836e-274b-4a20-915a-d28d7e70d2a3 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b2c1eac4-f1ac-4d96-b4eb-6016e151cd0f req-1b3d6614-45c0-4639-b747-823652779ac6 service nova] Acquiring lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b2c1eac4-f1ac-4d96-b4eb-6016e151cd0f req-1b3d6614-45c0-4639-b747-823652779ac6 service nova] Lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b2c1eac4-f1ac-4d96-b4eb-6016e151cd0f req-1b3d6614-45c0-4639-b747-823652779ac6 service nova] Lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG nova.compute.manager [req-b2c1eac4-f1ac-4d96-b4eb-6016e151cd0f req-1b3d6614-45c0-4639-b747-823652779ac6 service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] No waiting events found dispatching network-vif-plugged-5c7f836e-274b-4a20-915a-d28d7e70d2a3 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:59:13 user nova-compute[72239]: WARNING nova.compute.manager [req-b2c1eac4-f1ac-4d96-b4eb-6016e151cd0f req-1b3d6614-45c0-4639-b747-823652779ac6 service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Received unexpected event network-vif-plugged-5c7f836e-274b-4a20-915a-d28d7e70d2a3 for instance with vm_state rescued and task_state unrescuing.
Jul 31 14:59:13 user nova-compute[72239]: DEBUG nova.compute.manager [req-b2c1eac4-f1ac-4d96-b4eb-6016e151cd0f req-1b3d6614-45c0-4639-b747-823652779ac6 service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Received event network-vif-plugged-5c7f836e-274b-4a20-915a-d28d7e70d2a3 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b2c1eac4-f1ac-4d96-b4eb-6016e151cd0f req-1b3d6614-45c0-4639-b747-823652779ac6 service nova] Acquiring lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b2c1eac4-f1ac-4d96-b4eb-6016e151cd0f req-1b3d6614-45c0-4639-b747-823652779ac6 service nova] Lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b2c1eac4-f1ac-4d96-b4eb-6016e151cd0f req-1b3d6614-45c0-4639-b747-823652779ac6 service nova] Lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG nova.compute.manager [req-b2c1eac4-f1ac-4d96-b4eb-6016e151cd0f req-1b3d6614-45c0-4639-b747-823652779ac6 service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] No waiting events found dispatching network-vif-plugged-5c7f836e-274b-4a20-915a-d28d7e70d2a3 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:59:13 user nova-compute[72239]: WARNING nova.compute.manager [req-b2c1eac4-f1ac-4d96-b4eb-6016e151cd0f req-1b3d6614-45c0-4639-b747-823652779ac6 service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Received unexpected event network-vif-plugged-5c7f836e-274b-4a20-915a-d28d7e70d2a3 for instance with vm_state rescued and task_state unrescuing.
Jul 31 14:59:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG nova.network.neutron [req-0aac7445-49ed-4abc-aa6f-e9f676e56ba4 req-0750a4bf-f318-427e-b0d6-5a1ab1ee51bd service nova] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Updated VIF entry in instance network info cache for port 7c709373-3d22-47b8-84d4-2a66ab39628a. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG nova.network.neutron [req-0aac7445-49ed-4abc-aa6f-e9f676e56ba4 req-0750a4bf-f318-427e-b0d6-5a1ab1ee51bd service nova] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Updating instance_info_cache with network_info: [{"id": "7c709373-3d22-47b8-84d4-2a66ab39628a", "address": "fa:16:3e:9c:a0:63", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c709373-3d", "ovs_interfaceid": "7c709373-3d22-47b8-84d4-2a66ab39628a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0aac7445-49ed-4abc-aa6f-e9f676e56ba4 req-0750a4bf-f318-427e-b0d6-5a1ab1ee51bd service nova] Releasing lock "refresh_cache-b8652db6-b595-497f-a55d-8c0520bc18aa" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dcd718a-280f-4b0e-b54f-616ee983ad16/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dcd718a-280f-4b0e-b54f-616ee983ad16/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dcd718a-280f-4b0e-b54f-616ee983ad16/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dcd718a-280f-4b0e-b54f-616ee983ad16/disk --force-share --output=json" returned: 0 in 0.131s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:14 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:59:14 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:59:14 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=7412MB free_disk=25.10944366455078GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 14:59:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:14 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 20abf743-de5b-4122-aad0-e2124c7804b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:59:14 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 7d81b881-b44e-4fb3-8245-9dea634bdec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:59:14 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 079a5ed7-ee25-495b-a2a4-924d830a670a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:59:14 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 2f11022e-a007-4d4c-adc1-b54ea59b9e6a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:59:14 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance c10918e9-9731-48ea-860e-8a02cb6a0ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:59:14 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance c2b3c85b-e939-41d0-8bf0-3a7f650177b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:59:14 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 3559f541-ed61-41b2-9a9d-8b10e18f7375 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:59:14 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 7dcd718a-280f-4b0e-b54f-616ee983ad16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:59:14 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance e6f6d85d-ffa0-4d72-b521-e855afa23a09 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:59:14 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 12c719bf-b770-4e41-b1f4-314eed1180c3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:59:14 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 3d70608b-fc54-4178-9aa6-98ca6198a37b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:59:14 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance b8652db6-b595-497f-a55d-8c0520bc18aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 14:59:14 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 14:59:14 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 14:59:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:15 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:59:15 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:59:15 user nova-compute[72239]: DEBUG nova.compute.manager [req-0b8fcbfc-7d14-4410-9f75-6930c60b9d97 req-42b0b343-4f66-4ab8-ba03-5dfc0d9e4eda service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Received event network-vif-plugged-5c7f836e-274b-4a20-915a-d28d7e70d2a3 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:59:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0b8fcbfc-7d14-4410-9f75-6930c60b9d97 req-42b0b343-4f66-4ab8-ba03-5dfc0d9e4eda service nova] Acquiring lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0b8fcbfc-7d14-4410-9f75-6930c60b9d97 req-42b0b343-4f66-4ab8-ba03-5dfc0d9e4eda service nova] Lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0b8fcbfc-7d14-4410-9f75-6930c60b9d97 req-42b0b343-4f66-4ab8-ba03-5dfc0d9e4eda service nova] Lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:15 user nova-compute[72239]: DEBUG nova.compute.manager [req-0b8fcbfc-7d14-4410-9f75-6930c60b9d97 req-42b0b343-4f66-4ab8-ba03-5dfc0d9e4eda service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] No waiting events found dispatching network-vif-plugged-5c7f836e-274b-4a20-915a-d28d7e70d2a3 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:59:15 user nova-compute[72239]: WARNING nova.compute.manager [req-0b8fcbfc-7d14-4410-9f75-6930c60b9d97 req-42b0b343-4f66-4ab8-ba03-5dfc0d9e4eda service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Received unexpected event network-vif-plugged-5c7f836e-274b-4a20-915a-d28d7e70d2a3 for instance with vm_state rescued and task_state unrescuing.
Jul 31 14:59:15 user nova-compute[72239]: DEBUG nova.compute.manager [req-0b8fcbfc-7d14-4410-9f75-6930c60b9d97 req-42b0b343-4f66-4ab8-ba03-5dfc0d9e4eda service nova] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Received event network-vif-plugged-7c709373-3d22-47b8-84d4-2a66ab39628a {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:59:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0b8fcbfc-7d14-4410-9f75-6930c60b9d97 req-42b0b343-4f66-4ab8-ba03-5dfc0d9e4eda service nova] Acquiring lock "b8652db6-b595-497f-a55d-8c0520bc18aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0b8fcbfc-7d14-4410-9f75-6930c60b9d97 req-42b0b343-4f66-4ab8-ba03-5dfc0d9e4eda service nova] Lock "b8652db6-b595-497f-a55d-8c0520bc18aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0b8fcbfc-7d14-4410-9f75-6930c60b9d97 req-42b0b343-4f66-4ab8-ba03-5dfc0d9e4eda service nova] Lock "b8652db6-b595-497f-a55d-8c0520bc18aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:15 user nova-compute[72239]: DEBUG nova.compute.manager [req-0b8fcbfc-7d14-4410-9f75-6930c60b9d97 req-42b0b343-4f66-4ab8-ba03-5dfc0d9e4eda service nova] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] No waiting events found dispatching network-vif-plugged-7c709373-3d22-47b8-84d4-2a66ab39628a {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:59:15 user nova-compute[72239]: WARNING nova.compute.manager [req-0b8fcbfc-7d14-4410-9f75-6930c60b9d97 req-42b0b343-4f66-4ab8-ba03-5dfc0d9e4eda service nova] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Received unexpected event network-vif-plugged-7c709373-3d22-47b8-84d4-2a66ab39628a for instance with vm_state building and task_state spawning.
Jul 31 14:59:15 user nova-compute[72239]: DEBUG nova.compute.manager [req-0b8fcbfc-7d14-4410-9f75-6930c60b9d97 req-42b0b343-4f66-4ab8-ba03-5dfc0d9e4eda service nova] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Received event network-vif-plugged-7c709373-3d22-47b8-84d4-2a66ab39628a {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:59:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0b8fcbfc-7d14-4410-9f75-6930c60b9d97 req-42b0b343-4f66-4ab8-ba03-5dfc0d9e4eda service nova] Acquiring lock "b8652db6-b595-497f-a55d-8c0520bc18aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0b8fcbfc-7d14-4410-9f75-6930c60b9d97 req-42b0b343-4f66-4ab8-ba03-5dfc0d9e4eda service nova] Lock "b8652db6-b595-497f-a55d-8c0520bc18aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0b8fcbfc-7d14-4410-9f75-6930c60b9d97 req-42b0b343-4f66-4ab8-ba03-5dfc0d9e4eda service nova] Lock "b8652db6-b595-497f-a55d-8c0520bc18aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:15 user nova-compute[72239]: DEBUG nova.compute.manager [req-0b8fcbfc-7d14-4410-9f75-6930c60b9d97 req-42b0b343-4f66-4ab8-ba03-5dfc0d9e4eda service nova] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] No waiting events found dispatching network-vif-plugged-7c709373-3d22-47b8-84d4-2a66ab39628a {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:59:15 user nova-compute[72239]: WARNING nova.compute.manager [req-0b8fcbfc-7d14-4410-9f75-6930c60b9d97 req-42b0b343-4f66-4ab8-ba03-5dfc0d9e4eda service nova] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Received unexpected event network-vif-plugged-7c709373-3d22-47b8-84d4-2a66ab39628a for instance with vm_state building and task_state spawning.
Jul 31 14:59:15 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 14:59:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.661s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Removed pending event for e6f6d85d-ffa0-4d72-b521-e855afa23a09 due to event {{(pid=72239) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 14:59:16 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815556.226756, e6f6d85d-ffa0-4d72-b521-e855afa23a09 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:59:16 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] VM Resumed (Lifecycle Event)
Jul 31 14:59:16 user nova-compute[72239]: DEBUG nova.compute.manager [None req-6fe421f8-250c-407d-a67c-502925154fde tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:59:16 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:59:16 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:59:16 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 31 14:59:16 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815556.2283957, e6f6d85d-ffa0-4d72-b521-e855afa23a09 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:59:16 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] VM Started (Lifecycle Event)
Jul 31 14:59:16 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:59:16 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:59:16 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815556.8335268, b8652db6-b595-497f-a55d-8c0520bc18aa => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:59:16 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] VM Resumed (Lifecycle Event)
Jul 31 14:59:16 user nova-compute[72239]: DEBUG nova.compute.manager [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:59:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 14:59:16 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Instance spawned successfully.
Jul 31 14:59:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 14:59:16 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:59:16 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:59:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:59:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:59:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:59:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:59:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:59:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:59:16 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:59:16 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815556.8371387, b8652db6-b595-497f-a55d-8c0520bc18aa => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:59:16 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] VM Started (Lifecycle Event)
Jul 31 14:59:16 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:59:16 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:59:16 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:59:16 user nova-compute[72239]: INFO nova.compute.manager [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Took 5.87 seconds to spawn the instance on the hypervisor.
Jul 31 14:59:16 user nova-compute[72239]: DEBUG nova.compute.manager [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:59:17 user nova-compute[72239]: INFO nova.compute.manager [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Took 6.63 seconds to build instance.
Jul 31 14:59:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6b7bd122-7c13-4fbf-8033-ddb5f8ced879 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "b8652db6-b595-497f-a55d-8c0520bc18aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.724s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d47a8b99-8f3f-43cb-a835-d9b2280ea147 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "3559f541-ed61-41b2-9a9d-8b10e18f7375" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d47a8b99-8f3f-43cb-a835-d9b2280ea147 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "3559f541-ed61-41b2-9a9d-8b10e18f7375" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d47a8b99-8f3f-43cb-a835-d9b2280ea147 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "3559f541-ed61-41b2-9a9d-8b10e18f7375-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d47a8b99-8f3f-43cb-a835-d9b2280ea147 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "3559f541-ed61-41b2-9a9d-8b10e18f7375-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d47a8b99-8f3f-43cb-a835-d9b2280ea147 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "3559f541-ed61-41b2-9a9d-8b10e18f7375-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:18 user nova-compute[72239]: INFO nova.compute.manager [None req-d47a8b99-8f3f-43cb-a835-d9b2280ea147 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Terminating instance
Jul 31 14:59:18 user nova-compute[72239]: DEBUG nova.compute.manager [None req-d47a8b99-8f3f-43cb-a835-d9b2280ea147 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 14:59:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-92c19ad5-04c9-4cd0-850d-a620e87b62b2 req-924a7af9-b563-46bf-9168-2728f7f6c374 service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Received event network-vif-unplugged-a7009a29-6a23-4d7d-a2ff-046c040e5b73 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:59:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-92c19ad5-04c9-4cd0-850d-a620e87b62b2 req-924a7af9-b563-46bf-9168-2728f7f6c374 service nova] Acquiring lock "3559f541-ed61-41b2-9a9d-8b10e18f7375-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-92c19ad5-04c9-4cd0-850d-a620e87b62b2 req-924a7af9-b563-46bf-9168-2728f7f6c374 service nova] Lock "3559f541-ed61-41b2-9a9d-8b10e18f7375-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-92c19ad5-04c9-4cd0-850d-a620e87b62b2 req-924a7af9-b563-46bf-9168-2728f7f6c374 service nova] Lock "3559f541-ed61-41b2-9a9d-8b10e18f7375-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-92c19ad5-04c9-4cd0-850d-a620e87b62b2 req-924a7af9-b563-46bf-9168-2728f7f6c374 service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] No waiting events found dispatching network-vif-unplugged-a7009a29-6a23-4d7d-a2ff-046c040e5b73 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:59:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-92c19ad5-04c9-4cd0-850d-a620e87b62b2 req-924a7af9-b563-46bf-9168-2728f7f6c374 service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Received event network-vif-unplugged-a7009a29-6a23-4d7d-a2ff-046c040e5b73 for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 14:59:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:19 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Instance destroyed successfully.
Jul 31 14:59:19 user nova-compute[72239]: DEBUG nova.objects.instance [None req-d47a8b99-8f3f-43cb-a835-d9b2280ea147 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lazy-loading 'resources' on Instance uuid 3559f541-ed61-41b2-9a9d-8b10e18f7375 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:59:19 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-d47a8b99-8f3f-43cb-a835-d9b2280ea147 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:52:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1636003015',display_name='tempest-ServerRescueNegativeTestJSON-server-1636003015',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1636003015',id=22,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK59e+d5JqumngaIMi1TV1wAIjY4qlZDueF8eTW9V/NagCSHh+6Q46Dd9TNXG9DTJ1/F9v1GrrnmsbG+Dt2W4Pc1Zib0fWf7ng2HzCNCWTnfv8Bn1MhOYVcWKw+442VpYA==',key_name='tempest-keypair-2040187038',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:54:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='959107d575f04ba2b0ac800ed2ef61fa',ramdisk_id='',reservation_id='r-jcl47agl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1296361049',owner_user_name='tempest-ServerRescueNegativeTestJSON-1296361049-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:56:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f10fd7b9c1d34ca5b37150f34ea09ffa',uuid=3559f541-ed61-41b2-9a9d-8b10e18f7375,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a7009a29-6a23-4d7d-a2ff-046c040e5b73", "address": "fa:16:3e:f5:e4:b4", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7009a29-6a", "ovs_interfaceid": "a7009a29-6a23-4d7d-a2ff-046c040e5b73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:59:19 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-d47a8b99-8f3f-43cb-a835-d9b2280ea147 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Converting VIF {"id": "a7009a29-6a23-4d7d-a2ff-046c040e5b73", "address": "fa:16:3e:f5:e4:b4", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.234", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa7009a29-6a", "ovs_interfaceid": "a7009a29-6a23-4d7d-a2ff-046c040e5b73", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:59:19 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-d47a8b99-8f3f-43cb-a835-d9b2280ea147 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:e4:b4,bridge_name='br-int',has_traffic_filtering=True,id=a7009a29-6a23-4d7d-a2ff-046c040e5b73,network=Network(02dfd673-dd23-4768-9c30-291cdbecbb64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7009a29-6a') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:59:19 user nova-compute[72239]: DEBUG os_vif [None req-d47a8b99-8f3f-43cb-a835-d9b2280ea147 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:e4:b4,bridge_name='br-int',has_traffic_filtering=True,id=a7009a29-6a23-4d7d-a2ff-046c040e5b73,network=Network(02dfd673-dd23-4768-9c30-291cdbecbb64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7009a29-6a') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:59:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa7009a29-6a, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:59:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:59:19 user nova-compute[72239]: INFO os_vif [None req-d47a8b99-8f3f-43cb-a835-d9b2280ea147 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:e4:b4,bridge_name='br-int',has_traffic_filtering=True,id=a7009a29-6a23-4d7d-a2ff-046c040e5b73,network=Network(02dfd673-dd23-4768-9c30-291cdbecbb64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa7009a29-6a')
Jul 31 14:59:19 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-d47a8b99-8f3f-43cb-a835-d9b2280ea147 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Deleting instance files /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375_del
Jul 31 14:59:19 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-d47a8b99-8f3f-43cb-a835-d9b2280ea147 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Deletion of /opt/stack/data/nova/instances/3559f541-ed61-41b2-9a9d-8b10e18f7375_del complete
Jul 31 14:59:19 user nova-compute[72239]: INFO nova.compute.manager [None req-d47a8b99-8f3f-43cb-a835-d9b2280ea147 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Took 0.87 seconds to destroy the instance on the hypervisor.
Jul 31 14:59:19 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-d47a8b99-8f3f-43cb-a835-d9b2280ea147 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 14:59:19 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 14:59:19 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 14:59:20 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 14:59:20 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 14:59:20 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:59:20 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Took 1.02 seconds to deallocate network for instance.
Jul 31 14:59:20 user nova-compute[72239]: DEBUG nova.compute.manager [req-62c57379-80bb-4e67-82ea-e5567b27b654 req-6a80c17a-6a86-4694-ad9d-4690add2b628 service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Received event network-vif-deleted-a7009a29-6a23-4d7d-a2ff-046c040e5b73 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:59:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d47a8b99-8f3f-43cb-a835-d9b2280ea147 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d47a8b99-8f3f-43cb-a835-d9b2280ea147 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:21 user nova-compute[72239]: DEBUG nova.compute.manager [req-5c86caaf-6034-412d-8186-6b13fe11a52b req-fae1e65b-3359-46ad-b18e-8573fb0df14f service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Received event network-vif-plugged-a7009a29-6a23-4d7d-a2ff-046c040e5b73 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:59:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5c86caaf-6034-412d-8186-6b13fe11a52b req-fae1e65b-3359-46ad-b18e-8573fb0df14f service nova] Acquiring lock "3559f541-ed61-41b2-9a9d-8b10e18f7375-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5c86caaf-6034-412d-8186-6b13fe11a52b req-fae1e65b-3359-46ad-b18e-8573fb0df14f service nova] Lock "3559f541-ed61-41b2-9a9d-8b10e18f7375-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5c86caaf-6034-412d-8186-6b13fe11a52b req-fae1e65b-3359-46ad-b18e-8573fb0df14f service nova] Lock "3559f541-ed61-41b2-9a9d-8b10e18f7375-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:21 user nova-compute[72239]: DEBUG nova.compute.manager [req-5c86caaf-6034-412d-8186-6b13fe11a52b req-fae1e65b-3359-46ad-b18e-8573fb0df14f service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] No waiting events found dispatching network-vif-plugged-a7009a29-6a23-4d7d-a2ff-046c040e5b73 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:59:21 user nova-compute[72239]: WARNING nova.compute.manager [req-5c86caaf-6034-412d-8186-6b13fe11a52b req-fae1e65b-3359-46ad-b18e-8573fb0df14f service nova] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Received unexpected event network-vif-plugged-a7009a29-6a23-4d7d-a2ff-046c040e5b73 for instance with vm_state deleted and task_state None.
Jul 31 14:59:21 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-d47a8b99-8f3f-43cb-a835-d9b2280ea147 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:59:21 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-d47a8b99-8f3f-43cb-a835-d9b2280ea147 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:59:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d47a8b99-8f3f-43cb-a835-d9b2280ea147 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.554s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:21 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-d47a8b99-8f3f-43cb-a835-d9b2280ea147 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Deleted allocations for instance 3559f541-ed61-41b2-9a9d-8b10e18f7375
Jul 31 14:59:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d47a8b99-8f3f-43cb-a835-d9b2280ea147 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "3559f541-ed61-41b2-9a9d-8b10e18f7375" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.643s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:21 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690815546.9086902, bc1b9270-ccf7-4127-a3fd-cab56d362f0d => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:59:21 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] VM Stopped (Lifecycle Event)
Jul 31 14:59:21 user nova-compute[72239]: DEBUG nova.compute.manager [None req-488ec8b1-c6f7-4058-b0df-799119363bdf None None] [instance: bc1b9270-ccf7-4127-a3fd-cab56d362f0d] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:59:24 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "443f846e-09ed-47d3-813d-62fc8cea96c2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "443f846e-09ed-47d3-813d-62fc8cea96c2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:25 user nova-compute[72239]: DEBUG nova.compute.manager [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 14:59:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:25 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 14:59:25 user nova-compute[72239]: INFO nova.compute.claims [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Claim successful on node user
Jul 31 14:59:25 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:59:25 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:59:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:25 user nova-compute[72239]: DEBUG nova.compute.manager [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 14:59:26 user nova-compute[72239]: DEBUG nova.compute.manager [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 14:59:26 user nova-compute[72239]: DEBUG nova.network.neutron [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 14:59:26 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 14:59:26 user nova-compute[72239]: DEBUG nova.compute.manager [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 14:59:26 user nova-compute[72239]: DEBUG nova.policy [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99f609389e884d5490ba160d9fff28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e4fe9e81724b9cb6b9d73748f9bdee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 14:59:26 user nova-compute[72239]: DEBUG nova.compute.manager [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 14:59:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 14:59:26 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Creating image(s)
Jul 31 14:59:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "/opt/stack/data/nova/instances/443f846e-09ed-47d3-813d-62fc8cea96c2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "/opt/stack/data/nova/instances/443f846e-09ed-47d3-813d-62fc8cea96c2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "/opt/stack/data/nova/instances/443f846e-09ed-47d3-813d-62fc8cea96c2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.139s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "ca449065000c92aac3b7b9fa685f9a7710929444" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.147s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/443f846e-09ed-47d3-813d-62fc8cea96c2/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/443f846e-09ed-47d3-813d-62fc8cea96c2/disk 1073741824" returned: 0 in 0.052s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.151s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:26 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Checking if we can resize image /opt/stack/data/nova/instances/443f846e-09ed-47d3-813d-62fc8cea96c2/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 14:59:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443f846e-09ed-47d3-813d-62fc8cea96c2/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:26 user nova-compute[72239]: DEBUG nova.network.neutron [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Successfully created port: 3d5bc442-d5a6-4dcb-aec4-8674a732bb8f {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:59:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443f846e-09ed-47d3-813d-62fc8cea96c2/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:26 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Cannot resize image /opt/stack/data/nova/instances/443f846e-09ed-47d3-813d-62fc8cea96c2/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 14:59:26 user nova-compute[72239]: DEBUG nova.objects.instance [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lazy-loading 'migration_context' on Instance uuid 443f846e-09ed-47d3-813d-62fc8cea96c2 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:59:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 14:59:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Ensure instance console log exists: /opt/stack/data/nova/instances/443f846e-09ed-47d3-813d-62fc8cea96c2/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 14:59:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:27 user nova-compute[72239]: DEBUG nova.network.neutron [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Successfully updated port: 3d5bc442-d5a6-4dcb-aec4-8674a732bb8f {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:59:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "refresh_cache-443f846e-09ed-47d3-813d-62fc8cea96c2" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:59:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquired lock "refresh_cache-443f846e-09ed-47d3-813d-62fc8cea96c2" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:59:27 user nova-compute[72239]: DEBUG nova.network.neutron [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:59:27 user nova-compute[72239]: DEBUG nova.compute.manager [req-05ce4b16-549c-4d37-832d-d7d85249d02b req-fbaba8ee-c6f9-4442-83ac-410874453c56 service nova] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Received event network-changed-3d5bc442-d5a6-4dcb-aec4-8674a732bb8f {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:59:27 user nova-compute[72239]: DEBUG nova.compute.manager [req-05ce4b16-549c-4d37-832d-d7d85249d02b req-fbaba8ee-c6f9-4442-83ac-410874453c56 service nova] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Refreshing instance network info cache due to event network-changed-3d5bc442-d5a6-4dcb-aec4-8674a732bb8f. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:59:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-05ce4b16-549c-4d37-832d-d7d85249d02b req-fbaba8ee-c6f9-4442-83ac-410874453c56 service nova] Acquiring lock "refresh_cache-443f846e-09ed-47d3-813d-62fc8cea96c2" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:59:27 user nova-compute[72239]: DEBUG nova.network.neutron [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG nova.network.neutron [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Updating instance_info_cache with network_info: [{"id": "3d5bc442-d5a6-4dcb-aec4-8674a732bb8f", "address": "fa:16:3e:65:8e:56", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5bc442-d5", "ovs_interfaceid": "3d5bc442-d5a6-4dcb-aec4-8674a732bb8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Releasing lock "refresh_cache-443f846e-09ed-47d3-813d-62fc8cea96c2" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG nova.compute.manager [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Instance network_info: |[{"id": "3d5bc442-d5a6-4dcb-aec4-8674a732bb8f", "address": "fa:16:3e:65:8e:56", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5bc442-d5", "ovs_interfaceid": "3d5bc442-d5a6-4dcb-aec4-8674a732bb8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-05ce4b16-549c-4d37-832d-d7d85249d02b req-fbaba8ee-c6f9-4442-83ac-410874453c56 service nova] Acquired lock "refresh_cache-443f846e-09ed-47d3-813d-62fc8cea96c2" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG nova.network.neutron [req-05ce4b16-549c-4d37-832d-d7d85249d02b req-fbaba8ee-c6f9-4442-83ac-410874453c56 service nova] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Refreshing network info cache for port 3d5bc442-d5a6-4dcb-aec4-8674a732bb8f {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Start _get_guest_xml network_info=[{"id": "3d5bc442-d5a6-4dcb-aec4-8674a732bb8f", "address": "fa:16:3e:65:8e:56", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5bc442-d5", "ovs_interfaceid": "3d5bc442-d5a6-4dcb-aec4-8674a732bb8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:59:28 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:59:28 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:59:28 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-580943295',display_name='tempest-AttachVolumeNegativeTest-server-580943295',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-580943295',id=33,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4uxgFQP5PkYEpeXD4PwG1Dtwyrt48Kq4VA7cJUq7b/lVOW2FJ5PVlYSi5ahnx2CNFL6soIekTWcJfuQG5P1co37WarF9A9b/vb4/ijX9Br6UtatBVJmQytVWelCiWDAg==',key_name='tempest-keypair-539756932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48e4fe9e81724b9cb6b9d73748f9bdee',ramdisk_id='',reservation_id='r-4onqv11y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-620954585',owner_user_name='tempest-AttachVolumeNegativeTest-620954585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:59:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99f609389e884d5490ba160d9fff28e3',uuid=443f846e-09ed-47d3-813d-62fc8cea96c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d5bc442-d5a6-4dcb-aec4-8674a732bb8f", "address": "fa:16:3e:65:8e:56", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5bc442-d5", "ovs_interfaceid": "3d5bc442-d5a6-4dcb-aec4-8674a732bb8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Converting VIF {"id": "3d5bc442-d5a6-4dcb-aec4-8674a732bb8f", "address": "fa:16:3e:65:8e:56", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5bc442-d5", "ovs_interfaceid": "3d5bc442-d5a6-4dcb-aec4-8674a732bb8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:8e:56,bridge_name='br-int',has_traffic_filtering=True,id=3d5bc442-d5a6-4dcb-aec4-8674a732bb8f,network=Network(f83cfb34-b1ca-4a7c-9a36-3654372585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5bc442-d5') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG nova.objects.instance [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lazy-loading 'pci_devices' on Instance uuid 443f846e-09ed-47d3-813d-62fc8cea96c2 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:59:28 user nova-compute[72239]:   <uuid>443f846e-09ed-47d3-813d-62fc8cea96c2</uuid>
Jul 31 14:59:28 user nova-compute[72239]:   <name>instance-00000021</name>
Jul 31 14:59:28 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:59:28 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:59:28 user nova-compute[72239]:   <metadata>
Jul 31 14:59:28 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:59:28 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:59:28 user nova-compute[72239]:       <nova:name>tempest-AttachVolumeNegativeTest-server-580943295</nova:name>
Jul 31 14:59:28 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:59:28</nova:creationTime>
Jul 31 14:59:28 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:59:28 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:59:28 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:59:28 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:59:28 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:59:28 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:59:28 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:59:28 user nova-compute[72239]:       <nova:owner>
Jul 31 14:59:28 user nova-compute[72239]:         <nova:user uuid="99f609389e884d5490ba160d9fff28e3">tempest-AttachVolumeNegativeTest-620954585-project-member</nova:user>
Jul 31 14:59:28 user nova-compute[72239]:         <nova:project uuid="48e4fe9e81724b9cb6b9d73748f9bdee">tempest-AttachVolumeNegativeTest-620954585</nova:project>
Jul 31 14:59:28 user nova-compute[72239]:       </nova:owner>
Jul 31 14:59:28 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:59:28 user nova-compute[72239]:       <nova:ports>
Jul 31 14:59:28 user nova-compute[72239]:         <nova:port uuid="3d5bc442-d5a6-4dcb-aec4-8674a732bb8f">
Jul 31 14:59:28 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 31 14:59:28 user nova-compute[72239]:         </nova:port>
Jul 31 14:59:28 user nova-compute[72239]:       </nova:ports>
Jul 31 14:59:28 user nova-compute[72239]:     </nova:instance>
Jul 31 14:59:28 user nova-compute[72239]:   </metadata>
Jul 31 14:59:28 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:59:28 user nova-compute[72239]:     <system>
Jul 31 14:59:28 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:59:28 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:59:28 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:59:28 user nova-compute[72239]:       <entry name="serial">443f846e-09ed-47d3-813d-62fc8cea96c2</entry>
Jul 31 14:59:28 user nova-compute[72239]:       <entry name="uuid">443f846e-09ed-47d3-813d-62fc8cea96c2</entry>
Jul 31 14:59:28 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:59:28 user nova-compute[72239]:     </system>
Jul 31 14:59:28 user nova-compute[72239]:   </sysinfo>
Jul 31 14:59:28 user nova-compute[72239]:   <os>
Jul 31 14:59:28 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:59:28 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:59:28 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:59:28 user nova-compute[72239]:   </os>
Jul 31 14:59:28 user nova-compute[72239]:   <features>
Jul 31 14:59:28 user nova-compute[72239]:     <acpi/>
Jul 31 14:59:28 user nova-compute[72239]:     <apic/>
Jul 31 14:59:28 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:59:28 user nova-compute[72239]:   </features>
Jul 31 14:59:28 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:59:28 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:59:28 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:59:28 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:59:28 user nova-compute[72239]:   </clock>
Jul 31 14:59:28 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:59:28 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:59:28 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:59:28 user nova-compute[72239]:   </cpu>
Jul 31 14:59:28 user nova-compute[72239]:   <devices>
Jul 31 14:59:28 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:59:28 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:59:28 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/443f846e-09ed-47d3-813d-62fc8cea96c2/disk"/>
Jul 31 14:59:28 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:59:28 user nova-compute[72239]:     </disk>
Jul 31 14:59:28 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:59:28 user nova-compute[72239]:       <mac address="fa:16:3e:65:8e:56"/>
Jul 31 14:59:28 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:59:28 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:59:28 user nova-compute[72239]:       <target dev="tap3d5bc442-d5"/>
Jul 31 14:59:28 user nova-compute[72239]:     </interface>
Jul 31 14:59:28 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:59:28 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/443f846e-09ed-47d3-813d-62fc8cea96c2/console.log" append="off"/>
Jul 31 14:59:28 user nova-compute[72239]:     </serial>
Jul 31 14:59:28 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:59:28 user nova-compute[72239]:     <video>
Jul 31 14:59:28 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:59:28 user nova-compute[72239]:     </video>
Jul 31 14:59:28 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:59:28 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:59:28 user nova-compute[72239]:     </rng>
Jul 31 14:59:28 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:59:28 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:59:28 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:59:28 user nova-compute[72239]:     </memballoon>
Jul 31 14:59:28 user nova-compute[72239]:   </devices>
Jul 31 14:59:28 user nova-compute[72239]: </domain>
Jul 31 14:59:28 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-580943295',display_name='tempest-AttachVolumeNegativeTest-server-580943295',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-580943295',id=33,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4uxgFQP5PkYEpeXD4PwG1Dtwyrt48Kq4VA7cJUq7b/lVOW2FJ5PVlYSi5ahnx2CNFL6soIekTWcJfuQG5P1co37WarF9A9b/vb4/ijX9Br6UtatBVJmQytVWelCiWDAg==',key_name='tempest-keypair-539756932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48e4fe9e81724b9cb6b9d73748f9bdee',ramdisk_id='',reservation_id='r-4onqv11y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-620954585',owner_user_name='tempest-AttachVolumeNegativeTest-620954585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:59:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99f609389e884d5490ba160d9fff28e3',uuid=443f846e-09ed-47d3-813d-62fc8cea96c2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3d5bc442-d5a6-4dcb-aec4-8674a732bb8f", "address": "fa:16:3e:65:8e:56", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5bc442-d5", "ovs_interfaceid": "3d5bc442-d5a6-4dcb-aec4-8674a732bb8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Converting VIF {"id": "3d5bc442-d5a6-4dcb-aec4-8674a732bb8f", "address": "fa:16:3e:65:8e:56", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5bc442-d5", "ovs_interfaceid": "3d5bc442-d5a6-4dcb-aec4-8674a732bb8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:8e:56,bridge_name='br-int',has_traffic_filtering=True,id=3d5bc442-d5a6-4dcb-aec4-8674a732bb8f,network=Network(f83cfb34-b1ca-4a7c-9a36-3654372585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5bc442-d5') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG os_vif [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:8e:56,bridge_name='br-int',has_traffic_filtering=True,id=3d5bc442-d5a6-4dcb-aec4-8674a732bb8f,network=Network(f83cfb34-b1ca-4a7c-9a36-3654372585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5bc442-d5') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3d5bc442-d5, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3d5bc442-d5, col_values=(('external_ids', {'iface-id': '3d5bc442-d5a6-4dcb-aec4-8674a732bb8f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:8e:56', 'vm-uuid': '443f846e-09ed-47d3-813d-62fc8cea96c2'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:28 user nova-compute[72239]: INFO os_vif [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:8e:56,bridge_name='br-int',has_traffic_filtering=True,id=3d5bc442-d5a6-4dcb-aec4-8674a732bb8f,network=Network(f83cfb34-b1ca-4a7c-9a36-3654372585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5bc442-d5')
Jul 31 14:59:28 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] No VIF found with MAC fa:16:3e:65:8e:56, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG nova.network.neutron [req-05ce4b16-549c-4d37-832d-d7d85249d02b req-fbaba8ee-c6f9-4442-83ac-410874453c56 service nova] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Updated VIF entry in instance network info cache for port 3d5bc442-d5a6-4dcb-aec4-8674a732bb8f. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG nova.network.neutron [req-05ce4b16-549c-4d37-832d-d7d85249d02b req-fbaba8ee-c6f9-4442-83ac-410874453c56 service nova] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Updating instance_info_cache with network_info: [{"id": "3d5bc442-d5a6-4dcb-aec4-8674a732bb8f", "address": "fa:16:3e:65:8e:56", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5bc442-d5", "ovs_interfaceid": "3d5bc442-d5a6-4dcb-aec4-8674a732bb8f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:59:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-05ce4b16-549c-4d37-832d-d7d85249d02b req-fbaba8ee-c6f9-4442-83ac-410874453c56 service nova] Releasing lock "refresh_cache-443f846e-09ed-47d3-813d-62fc8cea96c2" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:59:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:29 user nova-compute[72239]: DEBUG nova.compute.manager [req-19d9a5bb-0a77-41a7-be56-4413f6261844 req-829ea13e-9a0e-47e9-9a2c-a4483253930e service nova] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Received event network-vif-plugged-3d5bc442-d5a6-4dcb-aec4-8674a732bb8f {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:59:29 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-19d9a5bb-0a77-41a7-be56-4413f6261844 req-829ea13e-9a0e-47e9-9a2c-a4483253930e service nova] Acquiring lock "443f846e-09ed-47d3-813d-62fc8cea96c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:29 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-19d9a5bb-0a77-41a7-be56-4413f6261844 req-829ea13e-9a0e-47e9-9a2c-a4483253930e service nova] Lock "443f846e-09ed-47d3-813d-62fc8cea96c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:29 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-19d9a5bb-0a77-41a7-be56-4413f6261844 req-829ea13e-9a0e-47e9-9a2c-a4483253930e service nova] Lock "443f846e-09ed-47d3-813d-62fc8cea96c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:29 user nova-compute[72239]: DEBUG nova.compute.manager [req-19d9a5bb-0a77-41a7-be56-4413f6261844 req-829ea13e-9a0e-47e9-9a2c-a4483253930e service nova] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] No waiting events found dispatching network-vif-plugged-3d5bc442-d5a6-4dcb-aec4-8674a732bb8f {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:59:29 user nova-compute[72239]: WARNING nova.compute.manager [req-19d9a5bb-0a77-41a7-be56-4413f6261844 req-829ea13e-9a0e-47e9-9a2c-a4483253930e service nova] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Received unexpected event network-vif-plugged-3d5bc442-d5a6-4dcb-aec4-8674a732bb8f for instance with vm_state building and task_state spawning.
Jul 31 14:59:30 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:30 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:30 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:31 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815571.87935, 443f846e-09ed-47d3-813d-62fc8cea96c2 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:59:31 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] VM Resumed (Lifecycle Event)
Jul 31 14:59:31 user nova-compute[72239]: DEBUG nova.compute.manager [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:59:31 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 14:59:31 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Instance spawned successfully.
Jul 31 14:59:31 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 14:59:31 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:59:31 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:59:31 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:59:31 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:59:31 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:59:31 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:59:31 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:59:31 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:59:31 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:59:31 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815571.8824847, 443f846e-09ed-47d3-813d-62fc8cea96c2 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:59:31 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] VM Started (Lifecycle Event)
Jul 31 14:59:31 user nova-compute[72239]: DEBUG nova.compute.manager [req-9700cafa-fc6c-4320-83d0-91a3b49debd6 req-92c96f92-ba72-4ee3-93d3-9f07fce84af0 service nova] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Received event network-vif-plugged-3d5bc442-d5a6-4dcb-aec4-8674a732bb8f {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:59:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-9700cafa-fc6c-4320-83d0-91a3b49debd6 req-92c96f92-ba72-4ee3-93d3-9f07fce84af0 service nova] Acquiring lock "443f846e-09ed-47d3-813d-62fc8cea96c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-9700cafa-fc6c-4320-83d0-91a3b49debd6 req-92c96f92-ba72-4ee3-93d3-9f07fce84af0 service nova] Lock "443f846e-09ed-47d3-813d-62fc8cea96c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-9700cafa-fc6c-4320-83d0-91a3b49debd6 req-92c96f92-ba72-4ee3-93d3-9f07fce84af0 service nova] Lock "443f846e-09ed-47d3-813d-62fc8cea96c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:31 user nova-compute[72239]: DEBUG nova.compute.manager [req-9700cafa-fc6c-4320-83d0-91a3b49debd6 req-92c96f92-ba72-4ee3-93d3-9f07fce84af0 service nova] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] No waiting events found dispatching network-vif-plugged-3d5bc442-d5a6-4dcb-aec4-8674a732bb8f {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:59:31 user nova-compute[72239]: WARNING nova.compute.manager [req-9700cafa-fc6c-4320-83d0-91a3b49debd6 req-92c96f92-ba72-4ee3-93d3-9f07fce84af0 service nova] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Received unexpected event network-vif-plugged-3d5bc442-d5a6-4dcb-aec4-8674a732bb8f for instance with vm_state building and task_state spawning.
Jul 31 14:59:31 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:59:31 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:59:31 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:59:31 user nova-compute[72239]: INFO nova.compute.manager [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Took 5.80 seconds to spawn the instance on the hypervisor.
Jul 31 14:59:31 user nova-compute[72239]: DEBUG nova.compute.manager [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:59:32 user nova-compute[72239]: INFO nova.compute.manager [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Took 6.55 seconds to build instance.
Jul 31 14:59:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-891b984f-a2bb-45fd-847d-875fdb570248 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "443f846e-09ed-47d3-813d-62fc8cea96c2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.655s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:33 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:34 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690815559.636445, 3559f541-ed61-41b2-9a9d-8b10e18f7375 => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:59:34 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] VM Stopped (Lifecycle Event)
Jul 31 14:59:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:34 user nova-compute[72239]: DEBUG nova.compute.manager [None req-2468f933-feda-4e48-a56d-f8ce0eb7980a None None] [instance: 3559f541-ed61-41b2-9a9d-8b10e18f7375] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:59:38 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:40 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:40 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:40 user nova-compute[72239]: DEBUG nova.compute.manager [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 14:59:40 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:40 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:40 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 14:59:40 user nova-compute[72239]: INFO nova.compute.claims [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Claim successful on node user
Jul 31 14:59:40 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:59:40 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:59:40 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.449s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:40 user nova-compute[72239]: DEBUG nova.compute.manager [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 14:59:40 user nova-compute[72239]: DEBUG nova.compute.manager [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 14:59:40 user nova-compute[72239]: DEBUG nova.network.neutron [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 14:59:40 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 14:59:40 user nova-compute[72239]: DEBUG nova.compute.manager [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 14:59:40 user nova-compute[72239]: DEBUG nova.policy [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2f8df817a91d41c8a421e2ba562c5015', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a18e5e2cd6854f0985aa161b1e8a6db7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 14:59:40 user nova-compute[72239]: DEBUG nova.compute.manager [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 14:59:40 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 14:59:40 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Creating image(s)
Jul 31 14:59:40 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "/opt/stack/data/nova/instances/aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:40 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "/opt/stack/data/nova/instances/aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:40 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "/opt/stack/data/nova/instances/aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:40 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.174s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "ca449065000c92aac3b7b9fa685f9a7710929444" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.135s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73/disk 1073741824" returned: 0 in 0.054s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.132s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:41 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 14:59:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:41 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Cannot resize image /opt/stack/data/nova/instances/aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 14:59:41 user nova-compute[72239]: DEBUG nova.objects.instance [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lazy-loading 'migration_context' on Instance uuid aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:59:41 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 14:59:41 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Ensure instance console log exists: /opt/stack/data/nova/instances/aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 14:59:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:41 user nova-compute[72239]: DEBUG nova.network.neutron [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Successfully created port: badab919-e57c-44e5-a3af-9cebe02e9ed5 {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG nova.network.neutron [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Successfully updated port: badab919-e57c-44e5-a3af-9cebe02e9ed5 {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "refresh_cache-aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquired lock "refresh_cache-aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG nova.network.neutron [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG nova.network.neutron [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG nova.compute.manager [req-648beaad-77f1-4c30-812c-636c65c0bfe8 req-8de74e8f-ae22-4349-9b6c-751c03119725 service nova] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Received event network-changed-badab919-e57c-44e5-a3af-9cebe02e9ed5 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG nova.compute.manager [req-648beaad-77f1-4c30-812c-636c65c0bfe8 req-8de74e8f-ae22-4349-9b6c-751c03119725 service nova] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Refreshing instance network info cache due to event network-changed-badab919-e57c-44e5-a3af-9cebe02e9ed5. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-648beaad-77f1-4c30-812c-636c65c0bfe8 req-8de74e8f-ae22-4349-9b6c-751c03119725 service nova] Acquiring lock "refresh_cache-aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG nova.network.neutron [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Updating instance_info_cache with network_info: [{"id": "badab919-e57c-44e5-a3af-9cebe02e9ed5", "address": "fa:16:3e:bf:16:bd", "network": {"id": "50e01a2d-5e91-4aca-a74c-7687f91ed21e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-937098047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e5e2cd6854f0985aa161b1e8a6db7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbadab919-e5", "ovs_interfaceid": "badab919-e57c-44e5-a3af-9cebe02e9ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Releasing lock "refresh_cache-aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG nova.compute.manager [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Instance network_info: |[{"id": "badab919-e57c-44e5-a3af-9cebe02e9ed5", "address": "fa:16:3e:bf:16:bd", "network": {"id": "50e01a2d-5e91-4aca-a74c-7687f91ed21e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-937098047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e5e2cd6854f0985aa161b1e8a6db7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbadab919-e5", "ovs_interfaceid": "badab919-e57c-44e5-a3af-9cebe02e9ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-648beaad-77f1-4c30-812c-636c65c0bfe8 req-8de74e8f-ae22-4349-9b6c-751c03119725 service nova] Acquired lock "refresh_cache-aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG nova.network.neutron [req-648beaad-77f1-4c30-812c-636c65c0bfe8 req-8de74e8f-ae22-4349-9b6c-751c03119725 service nova] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Refreshing network info cache for port badab919-e57c-44e5-a3af-9cebe02e9ed5 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Start _get_guest_xml network_info=[{"id": "badab919-e57c-44e5-a3af-9cebe02e9ed5", "address": "fa:16:3e:bf:16:bd", "network": {"id": "50e01a2d-5e91-4aca-a74c-7687f91ed21e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-937098047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e5e2cd6854f0985aa161b1e8a6db7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbadab919-e5", "ovs_interfaceid": "badab919-e57c-44e5-a3af-9cebe02e9ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 14:59:42 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:59:42 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 14:59:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:59:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1296584085',display_name='tempest-AttachVolumeTestJSON-server-1296584085',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1296584085',id=34,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCq78cPBqNdpWKW3Y/Pi5jvcUIugJsocenwA35z/GGKYQ5PWVnEird2iYvLSl7/6N4nzkNy1x4Va+eVCB3qmR4+2PdPbBxKl6UjerWzceywpduAoF422YFNTzQTGt1dWvQ==',key_name='tempest-keypair-2002484080',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a18e5e2cd6854f0985aa161b1e8a6db7',ramdisk_id='',reservation_id='r-ps4jj0f1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-853601938',owner_user_name='tempest-AttachVolumeTestJSON-853601938-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:59:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f8df817a91d41c8a421e2ba562c5015',uuid=aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "badab919-e57c-44e5-a3af-9cebe02e9ed5", "address": "fa:16:3e:bf:16:bd", "network": {"id": "50e01a2d-5e91-4aca-a74c-7687f91ed21e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-937098047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e5e2cd6854f0985aa161b1e8a6db7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbadab919-e5", "ovs_interfaceid": "badab919-e57c-44e5-a3af-9cebe02e9ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Converting VIF {"id": "badab919-e57c-44e5-a3af-9cebe02e9ed5", "address": "fa:16:3e:bf:16:bd", "network": {"id": "50e01a2d-5e91-4aca-a74c-7687f91ed21e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-937098047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e5e2cd6854f0985aa161b1e8a6db7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbadab919-e5", "ovs_interfaceid": "badab919-e57c-44e5-a3af-9cebe02e9ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:16:bd,bridge_name='br-int',has_traffic_filtering=True,id=badab919-e57c-44e5-a3af-9cebe02e9ed5,network=Network(50e01a2d-5e91-4aca-a74c-7687f91ed21e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbadab919-e5') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG nova.objects.instance [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lazy-loading 'pci_devices' on Instance uuid aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] End _get_guest_xml xml=<domain type="kvm">
Jul 31 14:59:42 user nova-compute[72239]:   <uuid>aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73</uuid>
Jul 31 14:59:42 user nova-compute[72239]:   <name>instance-00000022</name>
Jul 31 14:59:42 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 14:59:42 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 14:59:42 user nova-compute[72239]:   <metadata>
Jul 31 14:59:42 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 14:59:42 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 14:59:42 user nova-compute[72239]:       <nova:name>tempest-AttachVolumeTestJSON-server-1296584085</nova:name>
Jul 31 14:59:42 user nova-compute[72239]:       <nova:creationTime>2023-07-31 14:59:42</nova:creationTime>
Jul 31 14:59:42 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 14:59:42 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 14:59:42 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 14:59:42 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 14:59:42 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 14:59:42 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 14:59:42 user nova-compute[72239]:       </nova:flavor>
Jul 31 14:59:42 user nova-compute[72239]:       <nova:owner>
Jul 31 14:59:42 user nova-compute[72239]:         <nova:user uuid="2f8df817a91d41c8a421e2ba562c5015">tempest-AttachVolumeTestJSON-853601938-project-member</nova:user>
Jul 31 14:59:42 user nova-compute[72239]:         <nova:project uuid="a18e5e2cd6854f0985aa161b1e8a6db7">tempest-AttachVolumeTestJSON-853601938</nova:project>
Jul 31 14:59:42 user nova-compute[72239]:       </nova:owner>
Jul 31 14:59:42 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 14:59:42 user nova-compute[72239]:       <nova:ports>
Jul 31 14:59:42 user nova-compute[72239]:         <nova:port uuid="badab919-e57c-44e5-a3af-9cebe02e9ed5">
Jul 31 14:59:42 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 31 14:59:42 user nova-compute[72239]:         </nova:port>
Jul 31 14:59:42 user nova-compute[72239]:       </nova:ports>
Jul 31 14:59:42 user nova-compute[72239]:     </nova:instance>
Jul 31 14:59:42 user nova-compute[72239]:   </metadata>
Jul 31 14:59:42 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 14:59:42 user nova-compute[72239]:     <system>
Jul 31 14:59:42 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 14:59:42 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 14:59:42 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 14:59:42 user nova-compute[72239]:       <entry name="serial">aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73</entry>
Jul 31 14:59:42 user nova-compute[72239]:       <entry name="uuid">aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73</entry>
Jul 31 14:59:42 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 14:59:42 user nova-compute[72239]:     </system>
Jul 31 14:59:42 user nova-compute[72239]:   </sysinfo>
Jul 31 14:59:42 user nova-compute[72239]:   <os>
Jul 31 14:59:42 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 14:59:42 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 14:59:42 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 14:59:42 user nova-compute[72239]:   </os>
Jul 31 14:59:42 user nova-compute[72239]:   <features>
Jul 31 14:59:42 user nova-compute[72239]:     <acpi/>
Jul 31 14:59:42 user nova-compute[72239]:     <apic/>
Jul 31 14:59:42 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 14:59:42 user nova-compute[72239]:   </features>
Jul 31 14:59:42 user nova-compute[72239]:   <clock offset="utc">
Jul 31 14:59:42 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 14:59:42 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 14:59:42 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 14:59:42 user nova-compute[72239]:   </clock>
Jul 31 14:59:42 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 14:59:42 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 14:59:42 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 14:59:42 user nova-compute[72239]:   </cpu>
Jul 31 14:59:42 user nova-compute[72239]:   <devices>
Jul 31 14:59:42 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 14:59:42 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 14:59:42 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73/disk"/>
Jul 31 14:59:42 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 14:59:42 user nova-compute[72239]:     </disk>
Jul 31 14:59:42 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 14:59:42 user nova-compute[72239]:       <mac address="fa:16:3e:bf:16:bd"/>
Jul 31 14:59:42 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:59:42 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 14:59:42 user nova-compute[72239]:       <target dev="tapbadab919-e5"/>
Jul 31 14:59:42 user nova-compute[72239]:     </interface>
Jul 31 14:59:42 user nova-compute[72239]:     <serial type="pty">
Jul 31 14:59:42 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73/console.log" append="off"/>
Jul 31 14:59:42 user nova-compute[72239]:     </serial>
Jul 31 14:59:42 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 14:59:42 user nova-compute[72239]:     <video>
Jul 31 14:59:42 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 14:59:42 user nova-compute[72239]:     </video>
Jul 31 14:59:42 user nova-compute[72239]:     <rng model="virtio">
Jul 31 14:59:42 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 14:59:42 user nova-compute[72239]:     </rng>
Jul 31 14:59:42 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 14:59:42 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 14:59:42 user nova-compute[72239]:       <stats period="10"/>
Jul 31 14:59:42 user nova-compute[72239]:     </memballoon>
Jul 31 14:59:42 user nova-compute[72239]:   </devices>
Jul 31 14:59:42 user nova-compute[72239]: </domain>
Jul 31 14:59:42 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:59:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1296584085',display_name='tempest-AttachVolumeTestJSON-server-1296584085',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1296584085',id=34,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCq78cPBqNdpWKW3Y/Pi5jvcUIugJsocenwA35z/GGKYQ5PWVnEird2iYvLSl7/6N4nzkNy1x4Va+eVCB3qmR4+2PdPbBxKl6UjerWzceywpduAoF422YFNTzQTGt1dWvQ==',key_name='tempest-keypair-2002484080',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a18e5e2cd6854f0985aa161b1e8a6db7',ramdisk_id='',reservation_id='r-ps4jj0f1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-853601938',owner_user_name='tempest-AttachVolumeTestJSON-853601938-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T14:59:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f8df817a91d41c8a421e2ba562c5015',uuid=aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "badab919-e57c-44e5-a3af-9cebe02e9ed5", "address": "fa:16:3e:bf:16:bd", "network": {"id": "50e01a2d-5e91-4aca-a74c-7687f91ed21e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-937098047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e5e2cd6854f0985aa161b1e8a6db7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbadab919-e5", "ovs_interfaceid": "badab919-e57c-44e5-a3af-9cebe02e9ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Converting VIF {"id": "badab919-e57c-44e5-a3af-9cebe02e9ed5", "address": "fa:16:3e:bf:16:bd", "network": {"id": "50e01a2d-5e91-4aca-a74c-7687f91ed21e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-937098047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e5e2cd6854f0985aa161b1e8a6db7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbadab919-e5", "ovs_interfaceid": "badab919-e57c-44e5-a3af-9cebe02e9ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:16:bd,bridge_name='br-int',has_traffic_filtering=True,id=badab919-e57c-44e5-a3af-9cebe02e9ed5,network=Network(50e01a2d-5e91-4aca-a74c-7687f91ed21e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbadab919-e5') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG os_vif [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:16:bd,bridge_name='br-int',has_traffic_filtering=True,id=badab919-e57c-44e5-a3af-9cebe02e9ed5,network=Network(50e01a2d-5e91-4aca-a74c-7687f91ed21e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbadab919-e5') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbadab919-e5, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:59:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbadab919-e5, col_values=(('external_ids', {'iface-id': 'badab919-e57c-44e5-a3af-9cebe02e9ed5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:16:bd', 'vm-uuid': 'aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:59:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:59:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:43 user nova-compute[72239]: INFO os_vif [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:16:bd,bridge_name='br-int',has_traffic_filtering=True,id=badab919-e57c-44e5-a3af-9cebe02e9ed5,network=Network(50e01a2d-5e91-4aca-a74c-7687f91ed21e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbadab919-e5')
Jul 31 14:59:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 14:59:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] No VIF found with MAC fa:16:3e:bf:16:bd, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 14:59:43 user nova-compute[72239]: DEBUG nova.compute.manager [req-17f2f884-29fb-4404-b8f6-d93fda4a8e78 req-8636a26d-8c10-438d-aef2-3936624bbbf8 service nova] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Received event network-changed-8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:59:43 user nova-compute[72239]: DEBUG nova.compute.manager [req-17f2f884-29fb-4404-b8f6-d93fda4a8e78 req-8636a26d-8c10-438d-aef2-3936624bbbf8 service nova] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Refreshing instance network info cache due to event network-changed-8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:59:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-17f2f884-29fb-4404-b8f6-d93fda4a8e78 req-8636a26d-8c10-438d-aef2-3936624bbbf8 service nova] Acquiring lock "refresh_cache-c10918e9-9731-48ea-860e-8a02cb6a0ad9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:59:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-17f2f884-29fb-4404-b8f6-d93fda4a8e78 req-8636a26d-8c10-438d-aef2-3936624bbbf8 service nova] Acquired lock "refresh_cache-c10918e9-9731-48ea-860e-8a02cb6a0ad9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:59:43 user nova-compute[72239]: DEBUG nova.network.neutron [req-17f2f884-29fb-4404-b8f6-d93fda4a8e78 req-8636a26d-8c10-438d-aef2-3936624bbbf8 service nova] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Refreshing network info cache for port 8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:59:43 user nova-compute[72239]: DEBUG nova.network.neutron [req-648beaad-77f1-4c30-812c-636c65c0bfe8 req-8de74e8f-ae22-4349-9b6c-751c03119725 service nova] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Updated VIF entry in instance network info cache for port badab919-e57c-44e5-a3af-9cebe02e9ed5. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:59:43 user nova-compute[72239]: DEBUG nova.network.neutron [req-648beaad-77f1-4c30-812c-636c65c0bfe8 req-8de74e8f-ae22-4349-9b6c-751c03119725 service nova] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Updating instance_info_cache with network_info: [{"id": "badab919-e57c-44e5-a3af-9cebe02e9ed5", "address": "fa:16:3e:bf:16:bd", "network": {"id": "50e01a2d-5e91-4aca-a74c-7687f91ed21e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-937098047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e5e2cd6854f0985aa161b1e8a6db7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbadab919-e5", "ovs_interfaceid": "badab919-e57c-44e5-a3af-9cebe02e9ed5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:59:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-648beaad-77f1-4c30-812c-636c65c0bfe8 req-8de74e8f-ae22-4349-9b6c-751c03119725 service nova] Releasing lock "refresh_cache-aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:59:44 user nova-compute[72239]: DEBUG nova.network.neutron [req-17f2f884-29fb-4404-b8f6-d93fda4a8e78 req-8636a26d-8c10-438d-aef2-3936624bbbf8 service nova] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Updated VIF entry in instance network info cache for port 8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:59:44 user nova-compute[72239]: DEBUG nova.network.neutron [req-17f2f884-29fb-4404-b8f6-d93fda4a8e78 req-8636a26d-8c10-438d-aef2-3936624bbbf8 service nova] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Updating instance_info_cache with network_info: [{"id": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "address": "fa:16:3e:56:1c:d6", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8307e7-0d", "ovs_interfaceid": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:59:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-17f2f884-29fb-4404-b8f6-d93fda4a8e78 req-8636a26d-8c10-438d-aef2-3936624bbbf8 service nova] Releasing lock "refresh_cache-c10918e9-9731-48ea-860e-8a02cb6a0ad9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:59:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:44 user nova-compute[72239]: DEBUG nova.compute.manager [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Stashing vm_state: active {{(pid=72239) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Jul 31 14:59:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:45 user nova-compute[72239]: DEBUG nova.objects.instance [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lazy-loading 'pci_requests' on Instance uuid 3d70608b-fc54-4178-9aa6-98ca6198a37b {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:59:45 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 14:59:45 user nova-compute[72239]: INFO nova.compute.claims [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Claim successful on node user
Jul 31 14:59:45 user nova-compute[72239]: DEBUG nova.objects.instance [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lazy-loading 'resources' on Instance uuid 3d70608b-fc54-4178-9aa6-98ca6198a37b {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:59:45 user nova-compute[72239]: DEBUG nova.compute.manager [req-4231894e-50a4-47cc-9943-3e81f586cc93 req-6f566d84-2923-44b4-9195-4300065f7a7f service nova] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Received event network-changed-d115f55c-2a02-4b41-88b0-0922039e58ba {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:59:45 user nova-compute[72239]: DEBUG nova.compute.manager [req-4231894e-50a4-47cc-9943-3e81f586cc93 req-6f566d84-2923-44b4-9195-4300065f7a7f service nova] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Refreshing instance network info cache due to event network-changed-d115f55c-2a02-4b41-88b0-0922039e58ba. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 14:59:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-4231894e-50a4-47cc-9943-3e81f586cc93 req-6f566d84-2923-44b4-9195-4300065f7a7f service nova] Acquiring lock "refresh_cache-3d70608b-fc54-4178-9aa6-98ca6198a37b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:59:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-4231894e-50a4-47cc-9943-3e81f586cc93 req-6f566d84-2923-44b4-9195-4300065f7a7f service nova] Acquired lock "refresh_cache-3d70608b-fc54-4178-9aa6-98ca6198a37b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:59:45 user nova-compute[72239]: DEBUG nova.network.neutron [req-4231894e-50a4-47cc-9943-3e81f586cc93 req-6f566d84-2923-44b4-9195-4300065f7a7f service nova] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Refreshing network info cache for port d115f55c-2a02-4b41-88b0-0922039e58ba {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 14:59:45 user nova-compute[72239]: DEBUG nova.objects.instance [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d70608b-fc54-4178-9aa6-98ca6198a37b {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:59:45 user nova-compute[72239]: INFO nova.compute.resource_tracker [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Updating resource usage from migration b5e0640f-1435-4245-8d6a-90da81aa3b08
Jul 31 14:59:45 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 14:59:45 user nova-compute[72239]: DEBUG nova.network.neutron [req-4231894e-50a4-47cc-9943-3e81f586cc93 req-6f566d84-2923-44b4-9195-4300065f7a7f service nova] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Updated VIF entry in instance network info cache for port d115f55c-2a02-4b41-88b0-0922039e58ba. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 14:59:45 user nova-compute[72239]: DEBUG nova.network.neutron [req-4231894e-50a4-47cc-9943-3e81f586cc93 req-6f566d84-2923-44b4-9195-4300065f7a7f service nova] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Updating instance_info_cache with network_info: [{"id": "d115f55c-2a02-4b41-88b0-0922039e58ba", "address": "fa:16:3e:15:91:63", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115f55c-2a", "ovs_interfaceid": "d115f55c-2a02-4b41-88b0-0922039e58ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:59:45 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 14:59:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-4231894e-50a4-47cc-9943-3e81f586cc93 req-6f566d84-2923-44b4-9195-4300065f7a7f service nova] Releasing lock "refresh_cache-3d70608b-fc54-4178-9aa6-98ca6198a37b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:59:45 user nova-compute[72239]: DEBUG nova.compute.manager [req-4231894e-50a4-47cc-9943-3e81f586cc93 req-6f566d84-2923-44b4-9195-4300065f7a7f service nova] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Received event network-vif-plugged-badab919-e57c-44e5-a3af-9cebe02e9ed5 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:59:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-4231894e-50a4-47cc-9943-3e81f586cc93 req-6f566d84-2923-44b4-9195-4300065f7a7f service nova] Acquiring lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-4231894e-50a4-47cc-9943-3e81f586cc93 req-6f566d84-2923-44b4-9195-4300065f7a7f service nova] Lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-4231894e-50a4-47cc-9943-3e81f586cc93 req-6f566d84-2923-44b4-9195-4300065f7a7f service nova] Lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:45 user nova-compute[72239]: DEBUG nova.compute.manager [req-4231894e-50a4-47cc-9943-3e81f586cc93 req-6f566d84-2923-44b4-9195-4300065f7a7f service nova] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] No waiting events found dispatching network-vif-plugged-badab919-e57c-44e5-a3af-9cebe02e9ed5 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:59:45 user nova-compute[72239]: WARNING nova.compute.manager [req-4231894e-50a4-47cc-9943-3e81f586cc93 req-6f566d84-2923-44b4-9195-4300065f7a7f service nova] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Received unexpected event network-vif-plugged-badab919-e57c-44e5-a3af-9cebe02e9ed5 for instance with vm_state building and task_state spawning.
Jul 31 14:59:45 user nova-compute[72239]: DEBUG nova.compute.manager [req-4231894e-50a4-47cc-9943-3e81f586cc93 req-6f566d84-2923-44b4-9195-4300065f7a7f service nova] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Received event network-vif-plugged-badab919-e57c-44e5-a3af-9cebe02e9ed5 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:59:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-4231894e-50a4-47cc-9943-3e81f586cc93 req-6f566d84-2923-44b4-9195-4300065f7a7f service nova] Acquiring lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-4231894e-50a4-47cc-9943-3e81f586cc93 req-6f566d84-2923-44b4-9195-4300065f7a7f service nova] Lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-4231894e-50a4-47cc-9943-3e81f586cc93 req-6f566d84-2923-44b4-9195-4300065f7a7f service nova] Lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:45 user nova-compute[72239]: DEBUG nova.compute.manager [req-4231894e-50a4-47cc-9943-3e81f586cc93 req-6f566d84-2923-44b4-9195-4300065f7a7f service nova] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] No waiting events found dispatching network-vif-plugged-badab919-e57c-44e5-a3af-9cebe02e9ed5 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:59:45 user nova-compute[72239]: WARNING nova.compute.manager [req-4231894e-50a4-47cc-9943-3e81f586cc93 req-6f566d84-2923-44b4-9195-4300065f7a7f service nova] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Received unexpected event network-vif-plugged-badab919-e57c-44e5-a3af-9cebe02e9ed5 for instance with vm_state building and task_state spawning.
Jul 31 14:59:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.574s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:45 user nova-compute[72239]: INFO nova.compute.manager [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Migrating
Jul 31 14:59:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "refresh_cache-3d70608b-fc54-4178-9aa6-98ca6198a37b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:59:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquired lock "refresh_cache-3d70608b-fc54-4178-9aa6-98ca6198a37b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:59:45 user nova-compute[72239]: DEBUG nova.network.neutron [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:59:46 user nova-compute[72239]: DEBUG nova.network.neutron [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Updating instance_info_cache with network_info: [{"id": "d115f55c-2a02-4b41-88b0-0922039e58ba", "address": "fa:16:3e:15:91:63", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115f55c-2a", "ovs_interfaceid": "d115f55c-2a02-4b41-88b0-0922039e58ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:59:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Releasing lock "refresh_cache-3d70608b-fc54-4178-9aa6-98ca6198a37b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:59:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Starting migrate_disk_and_power_off {{(pid=72239) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Jul 31 14:59:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:46 user nova-compute[72239]: DEBUG nova.compute.manager [req-94ffca86-3b6f-437e-ae29-c80944b4aa07 req-4c0e93f9-15c9-437c-8840-6ef1bacc63e6 service nova] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Received event network-vif-unplugged-d115f55c-2a02-4b41-88b0-0922039e58ba {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:59:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-94ffca86-3b6f-437e-ae29-c80944b4aa07 req-4c0e93f9-15c9-437c-8840-6ef1bacc63e6 service nova] Acquiring lock "3d70608b-fc54-4178-9aa6-98ca6198a37b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-94ffca86-3b6f-437e-ae29-c80944b4aa07 req-4c0e93f9-15c9-437c-8840-6ef1bacc63e6 service nova] Lock "3d70608b-fc54-4178-9aa6-98ca6198a37b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-94ffca86-3b6f-437e-ae29-c80944b4aa07 req-4c0e93f9-15c9-437c-8840-6ef1bacc63e6 service nova] Lock "3d70608b-fc54-4178-9aa6-98ca6198a37b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:46 user nova-compute[72239]: DEBUG nova.compute.manager [req-94ffca86-3b6f-437e-ae29-c80944b4aa07 req-4c0e93f9-15c9-437c-8840-6ef1bacc63e6 service nova] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] No waiting events found dispatching network-vif-unplugged-d115f55c-2a02-4b41-88b0-0922039e58ba {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:59:46 user nova-compute[72239]: WARNING nova.compute.manager [req-94ffca86-3b6f-437e-ae29-c80944b4aa07 req-4c0e93f9-15c9-437c-8840-6ef1bacc63e6 service nova] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Received unexpected event network-vif-unplugged-d115f55c-2a02-4b41-88b0-0922039e58ba for instance with vm_state active and task_state resize_migrating.
Jul 31 14:59:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:46 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815586.6763573, aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:59:46 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] VM Resumed (Lifecycle Event)
Jul 31 14:59:46 user nova-compute[72239]: DEBUG nova.compute.manager [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 14:59:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 14:59:46 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Instance spawned successfully.
Jul 31 14:59:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 14:59:46 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:59:46 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:59:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:59:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:59:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:59:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:59:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:59:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 14:59:46 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:59:46 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815586.6788104, aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 14:59:46 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] VM Started (Lifecycle Event)
Jul 31 14:59:46 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:59:46 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 14:59:46 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 14:59:46 user nova-compute[72239]: INFO nova.compute.manager [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Took 5.94 seconds to spawn the instance on the hypervisor.
Jul 31 14:59:46 user nova-compute[72239]: DEBUG nova.compute.manager [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 14:59:46 user nova-compute[72239]: INFO nova.compute.manager [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Took 6.69 seconds to build instance.
Jul 31 14:59:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-354bcab0-db72-4565-a2c7-9c32991dbcbd tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.782s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:47 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Instance destroyed successfully.
Jul 31 14:59:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:57:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2050515265',display_name='tempest-ServerActionsTestOtherA-server-2050515265',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2050515265',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcC0f3guhYTNzECKpfyNk4cXj6Y8F4GpucRwb/0EBaXIalClpDyM69s13M23SyVQiCvr0tglg8FRaf5C4ibRcE2Gd6CEj06wnsuSnTBc8jPOcwf8pDTnQMrdikVLzRidg==',key_name='tempest-keypair-538819016',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:58:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='217b0eef1c154602850f4cf2d81b7ead',ramdisk_id='',reservation_id='r-4t9012f3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-456571617',owner_user_name='tempest-ServerActionsTestOtherA-456571617-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:59:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0e2796894b249cc868a888fac759983',uuid=3d70608b-fc54-4178-9aa6-98ca6198a37b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d115f55c-2a02-4b41-88b0-0922039e58ba", "address": "fa:16:3e:15:91:63", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-482963277-network", "vif_mac": "fa:16:3e:15:91:63"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115f55c-2a", "ovs_interfaceid": "d115f55c-2a02-4b41-88b0-0922039e58ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Converting VIF {"id": "d115f55c-2a02-4b41-88b0-0922039e58ba", "address": "fa:16:3e:15:91:63", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-482963277-network", "vif_mac": "fa:16:3e:15:91:63"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115f55c-2a", "ovs_interfaceid": "d115f55c-2a02-4b41-88b0-0922039e58ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:91:63,bridge_name='br-int',has_traffic_filtering=True,id=d115f55c-2a02-4b41-88b0-0922039e58ba,network=Network(6d954fa8-21ae-4438-b6c0-6ae7fb37718c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd115f55c-2a') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG os_vif [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:91:63,bridge_name='br-int',has_traffic_filtering=True,id=d115f55c-2a02-4b41-88b0-0922039e58ba,network=Network(6d954fa8-21ae-4438-b6c0-6ae7fb37718c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd115f55c-2a') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd115f55c-2a, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:59:47 user nova-compute[72239]: INFO os_vif [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:91:63,bridge_name='br-int',has_traffic_filtering=True,id=d115f55c-2a02-4b41-88b0-0922039e58ba,network=Network(6d954fa8-21ae-4438-b6c0-6ae7fb37718c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd115f55c-2a')
Jul 31 14:59:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SEvDcOrt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:59:47 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:59:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[521658cb-f74b-46c7-a1c3-33575b523494]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa9c143-0b2c-4730-bfc8-7f18b3f1be54]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:59:47 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 14:59:47 user nova-compute[72239]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 14:59:47 user nova-compute[72239]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 (non-flash)
Jul 31 14:59:47 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:59:47 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 14:59:47 user nova-compute[72239]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 14:59:47 user nova-compute[72239]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 (non-flash)
Jul 31 14:59:47 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4126ab5630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468'): ({'sdc'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Removing single pathed devices sdc {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7906d5fb-b37d-4f9a-871d-cfd6426602ff]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c432334c-5ee9-4bac-a72c-e8450da632d3]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Flushing IO for device /dev/sdc {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a35804-704e-4256-b18a-e119624fb2bd]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.059s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fac770a-11b3-4a59-a201-fdc7f907d3f2]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] SCSI volumes sdc have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c2d81a1-1a04-4afe-924e-7309adcbe4f8]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1b8bdf8-f678-451e-ac0b-94490db3f5c8]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468, portal: 172.16.0.220,3260]
Jul 31 14:59:47 user nova-compute[72239]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468, portal: 172.16.0.220,3260] successful.
Jul 31 14:59:47 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bbe28c-1619-4219-abe3-434f9920429d]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] <== disconnect_volume: return (300ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 14:59:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 14:59:48 user nova-compute[72239]: DEBUG nova.network.neutron [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Port d115f55c-2a02-4b41-88b0-0922039e58ba binding to destination host user is already ACTIVE {{(pid=72239) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 31 14:59:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "3d70608b-fc54-4178-9aa6-98ca6198a37b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "3d70608b-fc54-4178-9aa6-98ca6198a37b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "3d70608b-fc54-4178-9aa6-98ca6198a37b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:48 user nova-compute[72239]: DEBUG nova.compute.manager [req-cfceea41-46aa-4772-a018-10bfc0ad92ce req-f0fc30d2-07d9-49f4-bafb-2c881b93689b service nova] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Received event network-vif-plugged-d115f55c-2a02-4b41-88b0-0922039e58ba {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:59:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-cfceea41-46aa-4772-a018-10bfc0ad92ce req-f0fc30d2-07d9-49f4-bafb-2c881b93689b service nova] Acquiring lock "3d70608b-fc54-4178-9aa6-98ca6198a37b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-cfceea41-46aa-4772-a018-10bfc0ad92ce req-f0fc30d2-07d9-49f4-bafb-2c881b93689b service nova] Lock "3d70608b-fc54-4178-9aa6-98ca6198a37b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-cfceea41-46aa-4772-a018-10bfc0ad92ce req-f0fc30d2-07d9-49f4-bafb-2c881b93689b service nova] Lock "3d70608b-fc54-4178-9aa6-98ca6198a37b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:48 user nova-compute[72239]: DEBUG nova.compute.manager [req-cfceea41-46aa-4772-a018-10bfc0ad92ce req-f0fc30d2-07d9-49f4-bafb-2c881b93689b service nova] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] No waiting events found dispatching network-vif-plugged-d115f55c-2a02-4b41-88b0-0922039e58ba {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:59:48 user nova-compute[72239]: WARNING nova.compute.manager [req-cfceea41-46aa-4772-a018-10bfc0ad92ce req-f0fc30d2-07d9-49f4-bafb-2c881b93689b service nova] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Received unexpected event network-vif-plugged-d115f55c-2a02-4b41-88b0-0922039e58ba for instance with vm_state active and task_state resize_migrated.
Jul 31 14:59:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "refresh_cache-3d70608b-fc54-4178-9aa6-98ca6198a37b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 14:59:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquired lock "refresh_cache-3d70608b-fc54-4178-9aa6-98ca6198a37b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 14:59:48 user nova-compute[72239]: DEBUG nova.network.neutron [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 14:59:49 user nova-compute[72239]: DEBUG nova.network.neutron [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Updating instance_info_cache with network_info: [{"id": "d115f55c-2a02-4b41-88b0-0922039e58ba", "address": "fa:16:3e:15:91:63", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115f55c-2a", "ovs_interfaceid": "d115f55c-2a02-4b41-88b0-0922039e58ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:59:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Releasing lock "refresh_cache-3d70608b-fc54-4178-9aa6-98ca6198a37b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 14:59:49 user nova-compute[72239]: DEBUG os_brick.utils [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:59:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:49 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0476ee-b4e1-4a80-aa7a-e20557325c01]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:59:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:49 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb096f12-0b05-45bc-a4df-b3548b5b26e1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:59:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:49 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[44296e4d-973f-4e37-bed7-8868d8f06109]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:59:49 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5902d5-7a1a-4dc6-a7ac-774df3d42645]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:59:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:59:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 14:59:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 14:59:49 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 14:59:49 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd29d1f-7177-4fa9-a2af-64091626756a]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:59:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 14:59:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 14:59:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 14:59:49 user nova-compute[72239]: DEBUG os_brick.utils [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:59:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Acquiring lock "12c719bf-b770-4e41-b1f4-314eed1180c3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "12c719bf-b770-4e41-b1f4-314eed1180c3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Acquiring lock "12c719bf-b770-4e41-b1f4-314eed1180c3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "12c719bf-b770-4e41-b1f4-314eed1180c3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "12c719bf-b770-4e41-b1f4-314eed1180c3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:56 user nova-compute[72239]: INFO nova.compute.manager [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Terminating instance
Jul 31 14:59:56 user nova-compute[72239]: DEBUG nova.compute.manager [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 14:59:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:57 user nova-compute[72239]: DEBUG nova.compute.manager [req-98b7f465-8ff7-4b6d-be21-62a23553755f req-a2e83741-a8e2-4742-984f-fb16bd9487ef service nova] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Received event network-vif-unplugged-b00e3e0f-7501-4350-a065-d15b1d9e760a {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:59:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-98b7f465-8ff7-4b6d-be21-62a23553755f req-a2e83741-a8e2-4742-984f-fb16bd9487ef service nova] Acquiring lock "12c719bf-b770-4e41-b1f4-314eed1180c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-98b7f465-8ff7-4b6d-be21-62a23553755f req-a2e83741-a8e2-4742-984f-fb16bd9487ef service nova] Lock "12c719bf-b770-4e41-b1f4-314eed1180c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-98b7f465-8ff7-4b6d-be21-62a23553755f req-a2e83741-a8e2-4742-984f-fb16bd9487ef service nova] Lock "12c719bf-b770-4e41-b1f4-314eed1180c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:57 user nova-compute[72239]: DEBUG nova.compute.manager [req-98b7f465-8ff7-4b6d-be21-62a23553755f req-a2e83741-a8e2-4742-984f-fb16bd9487ef service nova] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] No waiting events found dispatching network-vif-unplugged-b00e3e0f-7501-4350-a065-d15b1d9e760a {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:59:57 user nova-compute[72239]: DEBUG nova.compute.manager [req-98b7f465-8ff7-4b6d-be21-62a23553755f req-a2e83741-a8e2-4742-984f-fb16bd9487ef service nova] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Received event network-vif-unplugged-b00e3e0f-7501-4350-a065-d15b1d9e760a for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 14:59:57 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Instance destroyed successfully.
Jul 31 14:59:57 user nova-compute[72239]: DEBUG nova.objects.instance [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lazy-loading 'resources' on Instance uuid 12c719bf-b770-4e41-b1f4-314eed1180c3 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 14:59:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T14:56:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1132747549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1158607357',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOefbRzMHFRHe/taYVNRZdQ1lM3IwZrqbCHgRPaUWK30x1oz/dcn1gnm5m9yHdPFwXBxgCljdwQcUohfGqXNL+C58VJsKHYKFOGAUE4NcwzQ4SM+cFj8p3SAcs0gkt76tw==',key_name='tempest-keypair-1078194837',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:58:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0fbc9073ba94f6e93d8491accb42231',ramdisk_id='',reservation_id='r-ovcgrtjz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-339927996',owner_user_name='tempest-ServerActionsV293TestJSON-339927996-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:58:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='946df3f784544702b6b057e66e23a97d',uuid=12c719bf-b770-4e41-b1f4-314eed1180c3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b00e3e0f-7501-4350-a065-d15b1d9e760a", "address": "fa:16:3e:ce:de:f0", "network": {"id": "ef3b3133-c6fe-4492-84f9-211f520dd339", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-428761984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0fbc9073ba94f6e93d8491accb42231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00e3e0f-75", "ovs_interfaceid": "b00e3e0f-7501-4350-a065-d15b1d9e760a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 14:59:57 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Converting VIF {"id": "b00e3e0f-7501-4350-a065-d15b1d9e760a", "address": "fa:16:3e:ce:de:f0", "network": {"id": "ef3b3133-c6fe-4492-84f9-211f520dd339", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-428761984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0fbc9073ba94f6e93d8491accb42231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00e3e0f-75", "ovs_interfaceid": "b00e3e0f-7501-4350-a065-d15b1d9e760a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 14:59:57 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:de:f0,bridge_name='br-int',has_traffic_filtering=True,id=b00e3e0f-7501-4350-a065-d15b1d9e760a,network=Network(ef3b3133-c6fe-4492-84f9-211f520dd339),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00e3e0f-75') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 14:59:57 user nova-compute[72239]: DEBUG os_vif [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:de:f0,bridge_name='br-int',has_traffic_filtering=True,id=b00e3e0f-7501-4350-a065-d15b1d9e760a,network=Network(ef3b3133-c6fe-4492-84f9-211f520dd339),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00e3e0f-75') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 14:59:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb00e3e0f-75, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 14:59:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 14:59:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 14:59:57 user nova-compute[72239]: INFO os_vif [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:de:f0,bridge_name='br-int',has_traffic_filtering=True,id=b00e3e0f-7501-4350-a065-d15b1d9e760a,network=Network(ef3b3133-c6fe-4492-84f9-211f520dd339),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00e3e0f-75')
Jul 31 14:59:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 14:59:57 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BsxrcqOj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 14:59:57 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 14:59:57 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 14:59:57 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 14:59:57 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 14:59:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:57 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ec9ce3-9417-4ee7-9bd8-e28320400fb9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:59:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:57 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[18004155-e3c3-4d33-bcfc-7168088a3c25]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:59:57 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:59:57 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 14:59:57 user nova-compute[72239]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 (non-flash)
Jul 31 14:59:57 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 14:59:57 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 14:59:57 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 14:59:57 user nova-compute[72239]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 (non-flash)
Jul 31 14:59:57 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 14:59:57 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4100607130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9'): ({'sdd'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 14:59:57 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Removing single pathed devices sdd {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 14:59:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:57 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[855f065c-73b5-418d-b21d-07f7e26692da]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:59:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:57 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f856a6a-8216-4849-9155-43df86b8e09b]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:59:57 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Flushing IO for device /dev/sdd {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 14:59:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:58 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d73eea3-9279-41b6-948b-271ce8e480e7]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:59:58 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 14:59:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:58 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b7a437-5334-4a3d-b9a7-f05630a25c04]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:59:58 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 14:59:58 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] SCSI volumes sdd have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 14:59:58 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 14:59:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:58 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5601a384-80f8-4805-a25e-807847dc8eaa]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:59:58 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:59:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:58 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[08498f12-7aa0-4116-9378-54142752214a]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:59:58 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9, portal: 172.16.0.220,3260]
Jul 31 14:59:58 user nova-compute[72239]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9, portal: 172.16.0.220,3260] successful.
Jul 31 14:59:58 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:59:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 14:59:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0fa80825-8675-4494-a7fe-82e943c2e2a9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 14:59:58 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c281821-a4d5-4dba-a41f-8ecf2b2acf37]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 14:59:58 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 14:59:58 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.534s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 14:59:58 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] <== disconnect_volume: return (537ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 14:59:58 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 14:59:58 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Deleting instance files /opt/stack/data/nova/instances/12c719bf-b770-4e41-b1f4-314eed1180c3_del
Jul 31 14:59:58 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Deletion of /opt/stack/data/nova/instances/12c719bf-b770-4e41-b1f4-314eed1180c3_del complete
Jul 31 14:59:58 user nova-compute[72239]: INFO nova.compute.manager [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Took 1.47 seconds to destroy the instance on the hypervisor.
Jul 31 14:59:58 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 14:59:58 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 14:59:58 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 14:59:59 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 14:59:59 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Took 0.92 seconds to deallocate network for instance.
Jul 31 14:59:59 user nova-compute[72239]: DEBUG nova.compute.manager [req-7d82cdad-980e-4edc-af99-b9657cb6b469 req-edfafd83-84cb-41ec-9583-ccf009018176 service nova] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Received event network-vif-plugged-b00e3e0f-7501-4350-a065-d15b1d9e760a {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:59:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7d82cdad-980e-4edc-af99-b9657cb6b469 req-edfafd83-84cb-41ec-9583-ccf009018176 service nova] Acquiring lock "12c719bf-b770-4e41-b1f4-314eed1180c3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 14:59:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7d82cdad-980e-4edc-af99-b9657cb6b469 req-edfafd83-84cb-41ec-9583-ccf009018176 service nova] Lock "12c719bf-b770-4e41-b1f4-314eed1180c3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 14:59:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7d82cdad-980e-4edc-af99-b9657cb6b469 req-edfafd83-84cb-41ec-9583-ccf009018176 service nova] Lock "12c719bf-b770-4e41-b1f4-314eed1180c3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 14:59:59 user nova-compute[72239]: DEBUG nova.compute.manager [req-7d82cdad-980e-4edc-af99-b9657cb6b469 req-edfafd83-84cb-41ec-9583-ccf009018176 service nova] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] No waiting events found dispatching network-vif-plugged-b00e3e0f-7501-4350-a065-d15b1d9e760a {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 14:59:59 user nova-compute[72239]: WARNING nova.compute.manager [req-7d82cdad-980e-4edc-af99-b9657cb6b469 req-edfafd83-84cb-41ec-9583-ccf009018176 service nova] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Received unexpected event network-vif-plugged-b00e3e0f-7501-4350-a065-d15b1d9e760a for instance with vm_state active and task_state deleting.
Jul 31 14:59:59 user nova-compute[72239]: DEBUG nova.compute.manager [req-7d82cdad-980e-4edc-af99-b9657cb6b469 req-edfafd83-84cb-41ec-9583-ccf009018176 service nova] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Received event network-vif-deleted-b00e3e0f-7501-4350-a065-d15b1d9e760a {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 14:59:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:00 user nova-compute[72239]: INFO nova.compute.manager [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Took 0.79 seconds to detach 1 volumes for instance.
Jul 31 15:00:00 user nova-compute[72239]: DEBUG nova.compute.manager [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Deleting volume: 0fa80825-8675-4494-a7fe-82e943c2e2a9 {{(pid=72239) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 31 15:00:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:00:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:00:00 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:00:00 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:00:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.485s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:00:00 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Deleted allocations for instance 12c719bf-b770-4e41-b1f4-314eed1180c3
Jul 31 15:00:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2111922b-a79c-4e5b-855d-9147cc4078e7 tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "12c719bf-b770-4e41-b1f4-314eed1180c3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.071s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:00:02 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690815587.0190127, 3d70608b-fc54-4178-9aa6-98ca6198a37b => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:00:02 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] VM Stopped (Lifecycle Event)
Jul 31 15:00:02 user nova-compute[72239]: DEBUG nova.compute.manager [None req-e3707054-a0f3-4e58-8f77-d4f808f8faa4 None None] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:00:02 user nova-compute[72239]: DEBUG nova.compute.manager [None req-e3707054-a0f3-4e58-8f77-d4f808f8faa4 None None] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:00:02 user nova-compute[72239]: INFO nova.compute.manager [None req-e3707054-a0f3-4e58-8f77-d4f808f8faa4 None None] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 31 15:00:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:04 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:00:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Cleaning up deleted instances {{(pid=72239) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] There are 0 instances to clean {{(pid=72239) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Starting finish_migration {{(pid=72239) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Instance directory exists: not creating {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 31 15:00:06 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Creating image(s)
Jul 31 15:00:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Did not create local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Ensure instance console log exists: /opt/stack/data/nova/instances/3d70608b-fc54-4178-9aa6-98ca6198a37b/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Start _get_guest_xml network_info=[{"id": "d115f55c-2a02-4b41-88b0-0922039e58ba", "address": "fa:16:3e:15:91:63", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-482963277-network", "vif_mac": "fa:16:3e:15:91:63"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115f55c-2a", "ovs_interfaceid": "d115f55c-2a02-4b41-88b0-0922039e58ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '76597da0-b95f-47ca-97d7-53ff5e389b4b', 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SEvDcOrt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '3d70608b-fc54-4178-9aa6-98ca6198a37b', 'attached_at': '2023-07-31T15:00:06.000000', 'detached_at': '', 'volume_id': '911a7119-d076-4773-9b93-ec934911c468', 'serial': '911a7119-d076-4773-9b93-ec934911c468'}, 'delete_on_termination': True, 'guest_format': None, 'volume_type': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 15:00:06 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:00:06 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:00:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:09Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG nova.objects.instance [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3d70608b-fc54-4178-9aa6-98ca6198a37b {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SEvDcOrt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:00:06 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:00:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:00:06 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:00:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:00:06 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 15:00:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0f31de-11e7-4fbe-9c6b-c663fd4e9791]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 15:00:06 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1918aa-f982-45c3-9bdb-12b2d669e98a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468] added
Jul 31 15:00:06 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fbf6c5-d112-482d-8371-944424be6e92]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6100a5e3-8082-4815-8a0d-9cd819b56ce0]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SEvDcOrt {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SEvDcOrt" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c14562eb-b10b-46f5-b480-0e98c5c778bd]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SEvDcOrt'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3aba514-0017-4dfd-aeb6-051c72a2496e]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[44509d97-7ab7-4ec0-a703-2427c13fc358]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 15:00:06 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 15:00:06 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 15:00:06 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 15:00:06 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:00:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:00:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:00:07 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6e758a-30d9-421a-bee8-9ba364cd30ad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:00:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468, portal: 172.16.0.220,3260]
Jul 31 15:00:07 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468, portal: 172.16.0.220,3260] successful.
Jul 31 15:00:07 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:00:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:00:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:00:07 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[405f8058-5506-4789-ba26-e9735bada9fd]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:00:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:00:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:00:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:00:07 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[97157251-e3c3-4e94-89c6-dd99d7b84a90]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:00:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 15:00:07 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 15:00:07 user nova-compute[72239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 15:00:07 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:00:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 15:00:07 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 15:00:07 user nova-compute[72239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 15:00:07 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:00:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:00:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 15:00:07 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] HCTL ('34', '-', '-', 0) found on session 39 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 15:00:07 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 15:00:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:00:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:00:07 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c98cc2-24b8-45cb-96d3-bf72e467d215]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:00:07 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: None {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 15:00:07 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:00:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:08 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Searching for a device in session 39 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 15:00:08 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SEvDcOrt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 15:00:08 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:00:08 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '23635636139393566', 'path': '/dev/sdc'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:00:08 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23635636139393566', 'path': '/dev/sdc'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 15:00:08 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:57:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2050515265',display_name='tempest-ServerActionsTestOtherA-server-2050515265',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2050515265',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcC0f3guhYTNzECKpfyNk4cXj6Y8F4GpucRwb/0EBaXIalClpDyM69s13M23SyVQiCvr0tglg8FRaf5C4ibRcE2Gd6CEj06wnsuSnTBc8jPOcwf8pDTnQMrdikVLzRidg==',key_name='tempest-keypair-538819016',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:58:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='217b0eef1c154602850f4cf2d81b7ead',ramdisk_id='',reservation_id='r-4t9012f3',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-456571617',owner_user_name='tempest-ServerActionsTestOtherA-456571617-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:59:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0e2796894b249cc868a888fac759983',uuid=3d70608b-fc54-4178-9aa6-98ca6198a37b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d115f55c-2a02-4b41-88b0-0922039e58ba", "address": "fa:16:3e:15:91:63", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-482963277-network", "vif_mac": "fa:16:3e:15:91:63"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115f55c-2a", "ovs_interfaceid": "d115f55c-2a02-4b41-88b0-0922039e58ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 15:00:08 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Converting VIF {"id": "d115f55c-2a02-4b41-88b0-0922039e58ba", "address": "fa:16:3e:15:91:63", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-482963277-network", "vif_mac": "fa:16:3e:15:91:63"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115f55c-2a", "ovs_interfaceid": "d115f55c-2a02-4b41-88b0-0922039e58ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:00:08 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:91:63,bridge_name='br-int',has_traffic_filtering=True,id=d115f55c-2a02-4b41-88b0-0922039e58ba,network=Network(6d954fa8-21ae-4438-b6c0-6ae7fb37718c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd115f55c-2a') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:00:08 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] End _get_guest_xml xml=<domain type="kvm">
Jul 31 15:00:08 user nova-compute[72239]:   <uuid>3d70608b-fc54-4178-9aa6-98ca6198a37b</uuid>
Jul 31 15:00:08 user nova-compute[72239]:   <name>instance-0000001f</name>
Jul 31 15:00:08 user nova-compute[72239]:   <memory>2097152</memory>
Jul 31 15:00:08 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 15:00:08 user nova-compute[72239]:   <metadata>
Jul 31 15:00:08 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 15:00:08 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 15:00:08 user nova-compute[72239]:       <nova:name>tempest-ServerActionsTestOtherA-server-2050515265</nova:name>
Jul 31 15:00:08 user nova-compute[72239]:       <nova:creationTime>2023-07-31 15:00:06</nova:creationTime>
Jul 31 15:00:08 user nova-compute[72239]:       <nova:flavor name="m1.small">
Jul 31 15:00:08 user nova-compute[72239]:         <nova:memory>2048</nova:memory>
Jul 31 15:00:08 user nova-compute[72239]:         <nova:disk>20</nova:disk>
Jul 31 15:00:08 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 15:00:08 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 15:00:08 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 15:00:08 user nova-compute[72239]:       </nova:flavor>
Jul 31 15:00:08 user nova-compute[72239]:       <nova:owner>
Jul 31 15:00:08 user nova-compute[72239]:         <nova:user uuid="d0e2796894b249cc868a888fac759983">tempest-ServerActionsTestOtherA-456571617-project-member</nova:user>
Jul 31 15:00:08 user nova-compute[72239]:         <nova:project uuid="217b0eef1c154602850f4cf2d81b7ead">tempest-ServerActionsTestOtherA-456571617</nova:project>
Jul 31 15:00:08 user nova-compute[72239]:       </nova:owner>
Jul 31 15:00:08 user nova-compute[72239]:       <nova:ports>
Jul 31 15:00:08 user nova-compute[72239]:         <nova:port uuid="d115f55c-2a02-4b41-88b0-0922039e58ba">
Jul 31 15:00:08 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 31 15:00:08 user nova-compute[72239]:         </nova:port>
Jul 31 15:00:08 user nova-compute[72239]:       </nova:ports>
Jul 31 15:00:08 user nova-compute[72239]:     </nova:instance>
Jul 31 15:00:08 user nova-compute[72239]:   </metadata>
Jul 31 15:00:08 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 15:00:08 user nova-compute[72239]:     <system>
Jul 31 15:00:08 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 15:00:08 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 15:00:08 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 15:00:08 user nova-compute[72239]:       <entry name="serial">3d70608b-fc54-4178-9aa6-98ca6198a37b</entry>
Jul 31 15:00:08 user nova-compute[72239]:       <entry name="uuid">3d70608b-fc54-4178-9aa6-98ca6198a37b</entry>
Jul 31 15:00:08 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 15:00:08 user nova-compute[72239]:     </system>
Jul 31 15:00:08 user nova-compute[72239]:   </sysinfo>
Jul 31 15:00:08 user nova-compute[72239]:   <os>
Jul 31 15:00:08 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 15:00:08 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 15:00:08 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 15:00:08 user nova-compute[72239]:   </os>
Jul 31 15:00:08 user nova-compute[72239]:   <features>
Jul 31 15:00:08 user nova-compute[72239]:     <acpi/>
Jul 31 15:00:08 user nova-compute[72239]:     <apic/>
Jul 31 15:00:08 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 15:00:08 user nova-compute[72239]:   </features>
Jul 31 15:00:08 user nova-compute[72239]:   <clock offset="utc">
Jul 31 15:00:08 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 15:00:08 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 15:00:08 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 15:00:08 user nova-compute[72239]:   </clock>
Jul 31 15:00:08 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 15:00:08 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 15:00:08 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 15:00:08 user nova-compute[72239]:   </cpu>
Jul 31 15:00:08 user nova-compute[72239]:   <devices>
Jul 31 15:00:08 user nova-compute[72239]:     <disk type="block" device="disk">
Jul 31 15:00:08 user nova-compute[72239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:00:08 user nova-compute[72239]:       <source dev="/dev/sdc"/>
Jul 31 15:00:08 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 15:00:08 user nova-compute[72239]:       <serial>911a7119-d076-4773-9b93-ec934911c468</serial>
Jul 31 15:00:08 user nova-compute[72239]:     </disk>
Jul 31 15:00:08 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 15:00:08 user nova-compute[72239]:       <mac address="fa:16:3e:15:91:63"/>
Jul 31 15:00:08 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:00:08 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 15:00:08 user nova-compute[72239]:       <target dev="tapd115f55c-2a"/>
Jul 31 15:00:08 user nova-compute[72239]:     </interface>
Jul 31 15:00:08 user nova-compute[72239]:     <serial type="pty">
Jul 31 15:00:08 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/3d70608b-fc54-4178-9aa6-98ca6198a37b/console.log" append="off"/>
Jul 31 15:00:08 user nova-compute[72239]:     </serial>
Jul 31 15:00:08 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 15:00:08 user nova-compute[72239]:     <video>
Jul 31 15:00:08 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:00:08 user nova-compute[72239]:     </video>
Jul 31 15:00:08 user nova-compute[72239]:     <rng model="virtio">
Jul 31 15:00:08 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 15:00:08 user nova-compute[72239]:     </rng>
Jul 31 15:00:08 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 15:00:08 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 15:00:08 user nova-compute[72239]:       <stats period="10"/>
Jul 31 15:00:08 user nova-compute[72239]:     </memballoon>
Jul 31 15:00:08 user nova-compute[72239]:   </devices>
Jul 31 15:00:08 user nova-compute[72239]: </domain>
Jul 31 15:00:08 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 15:00:08 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:57:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2050515265',display_name='tempest-ServerActionsTestOtherA-server-2050515265',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2050515265',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcC0f3guhYTNzECKpfyNk4cXj6Y8F4GpucRwb/0EBaXIalClpDyM69s13M23SyVQiCvr0tglg8FRaf5C4ibRcE2Gd6CEj06wnsuSnTBc8jPOcwf8pDTnQMrdikVLzRidg==',key_name='tempest-keypair-538819016',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:58:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='217b0eef1c154602850f4cf2d81b7ead',ramdisk_id='',reservation_id='r-4t9012f3',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-456571617',owner_user_name='tempest-ServerActionsTestOtherA-456571617-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:59:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0e2796894b249cc868a888fac759983',uuid=3d70608b-fc54-4178-9aa6-98ca6198a37b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d115f55c-2a02-4b41-88b0-0922039e58ba", "address": "fa:16:3e:15:91:63", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-482963277-network", "vif_mac": "fa:16:3e:15:91:63"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115f55c-2a", "ovs_interfaceid": "d115f55c-2a02-4b41-88b0-0922039e58ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 15:00:08 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Converting VIF {"id": "d115f55c-2a02-4b41-88b0-0922039e58ba", "address": "fa:16:3e:15:91:63", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-482963277-network", "vif_mac": "fa:16:3e:15:91:63"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115f55c-2a", "ovs_interfaceid": "d115f55c-2a02-4b41-88b0-0922039e58ba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:00:08 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:91:63,bridge_name='br-int',has_traffic_filtering=True,id=d115f55c-2a02-4b41-88b0-0922039e58ba,network=Network(6d954fa8-21ae-4438-b6c0-6ae7fb37718c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd115f55c-2a') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:00:08 user nova-compute[72239]: DEBUG os_vif [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:91:63,bridge_name='br-int',has_traffic_filtering=True,id=d115f55c-2a02-4b41-88b0-0922039e58ba,network=Network(6d954fa8-21ae-4438-b6c0-6ae7fb37718c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd115f55c-2a') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 15:00:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:00:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 15:00:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd115f55c-2a, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:00:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd115f55c-2a, col_values=(('external_ids', {'iface-id': 'd115f55c-2a02-4b41-88b0-0922039e58ba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:91:63', 'vm-uuid': '3d70608b-fc54-4178-9aa6-98ca6198a37b'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:00:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:00:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:08 user nova-compute[72239]: INFO os_vif [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:91:63,bridge_name='br-int',has_traffic_filtering=True,id=d115f55c-2a02-4b41-88b0-0922039e58ba,network=Network(6d954fa8-21ae-4438-b6c0-6ae7fb37718c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd115f55c-2a')
Jul 31 15:00:08 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:00:08 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] No VIF found with MAC fa:16:3e:15:91:63, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 15:00:08 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:00:08 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:00:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:09 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:00:09 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 15:00:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-7d81b881-b44e-4fb3-8245-9dea634bdec9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:00:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-7d81b881-b44e-4fb3-8245-9dea634bdec9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:00:09 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 15:00:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:09 user nova-compute[72239]: DEBUG nova.compute.manager [req-e8486124-2499-41b4-8b95-7e50016a8062 req-c7a4692f-22c9-435f-98e1-c5eee516a7c6 service nova] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Received event network-vif-plugged-d115f55c-2a02-4b41-88b0-0922039e58ba {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:00:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e8486124-2499-41b4-8b95-7e50016a8062 req-c7a4692f-22c9-435f-98e1-c5eee516a7c6 service nova] Acquiring lock "3d70608b-fc54-4178-9aa6-98ca6198a37b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:00:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e8486124-2499-41b4-8b95-7e50016a8062 req-c7a4692f-22c9-435f-98e1-c5eee516a7c6 service nova] Lock "3d70608b-fc54-4178-9aa6-98ca6198a37b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:00:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e8486124-2499-41b4-8b95-7e50016a8062 req-c7a4692f-22c9-435f-98e1-c5eee516a7c6 service nova] Lock "3d70608b-fc54-4178-9aa6-98ca6198a37b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:00:09 user nova-compute[72239]: DEBUG nova.compute.manager [req-e8486124-2499-41b4-8b95-7e50016a8062 req-c7a4692f-22c9-435f-98e1-c5eee516a7c6 service nova] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] No waiting events found dispatching network-vif-plugged-d115f55c-2a02-4b41-88b0-0922039e58ba {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:00:09 user nova-compute[72239]: WARNING nova.compute.manager [req-e8486124-2499-41b4-8b95-7e50016a8062 req-c7a4692f-22c9-435f-98e1-c5eee516a7c6 service nova] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Received unexpected event network-vif-plugged-d115f55c-2a02-4b41-88b0-0922039e58ba for instance with vm_state active and task_state resize_finish.
Jul 31 15:00:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:10 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Updating instance_info_cache with network_info: [{"id": "60f70f18-4024-4388-ae64-3c2cca0cafbc", "address": "fa:16:3e:a5:de:4b", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f70f18-40", "ovs_interfaceid": "60f70f18-4024-4388-ae64-3c2cca0cafbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:00:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-7d81b881-b44e-4fb3-8245-9dea634bdec9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:00:10 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 15:00:10 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:00:11 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:00:11 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:00:11 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Cleaning up deleted instances with incomplete migration  {{(pid=72239) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 15:00:11 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815611.7345648, 3d70608b-fc54-4178-9aa6-98ca6198a37b => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:00:11 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] VM Resumed (Lifecycle Event)
Jul 31 15:00:11 user nova-compute[72239]: DEBUG nova.compute.manager [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 15:00:11 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Instance running successfully.
Jul 31 15:00:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Failed to set time: agent not configured {{(pid=72239) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Jul 31 15:00:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e17053ae-0822-41c0-9265-1099a923880d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] finish_migration finished successfully. {{(pid=72239) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Jul 31 15:00:11 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:00:11 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:00:11 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 31 15:00:11 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815611.7377753, 3d70608b-fc54-4178-9aa6-98ca6198a37b => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:00:11 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] VM Started (Lifecycle Event)
Jul 31 15:00:11 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:00:11 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:00:11 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 31 15:00:11 user nova-compute[72239]: DEBUG nova.compute.manager [req-5f391e2d-2d79-43c0-944b-059691e531b5 req-f9c12e2a-beab-4450-aa99-7a03c5b79545 service nova] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Received event network-vif-plugged-d115f55c-2a02-4b41-88b0-0922039e58ba {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:00:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5f391e2d-2d79-43c0-944b-059691e531b5 req-f9c12e2a-beab-4450-aa99-7a03c5b79545 service nova] Acquiring lock "3d70608b-fc54-4178-9aa6-98ca6198a37b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:00:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5f391e2d-2d79-43c0-944b-059691e531b5 req-f9c12e2a-beab-4450-aa99-7a03c5b79545 service nova] Lock "3d70608b-fc54-4178-9aa6-98ca6198a37b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:00:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5f391e2d-2d79-43c0-944b-059691e531b5 req-f9c12e2a-beab-4450-aa99-7a03c5b79545 service nova] Lock "3d70608b-fc54-4178-9aa6-98ca6198a37b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:00:11 user nova-compute[72239]: DEBUG nova.compute.manager [req-5f391e2d-2d79-43c0-944b-059691e531b5 req-f9c12e2a-beab-4450-aa99-7a03c5b79545 service nova] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] No waiting events found dispatching network-vif-plugged-d115f55c-2a02-4b41-88b0-0922039e58ba {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:00:11 user nova-compute[72239]: WARNING nova.compute.manager [req-5f391e2d-2d79-43c0-944b-059691e531b5 req-f9c12e2a-beab-4450-aa99-7a03c5b79545 service nova] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Received unexpected event network-vif-plugged-d115f55c-2a02-4b41-88b0-0922039e58ba for instance with vm_state active and task_state resize_finish.
Jul 31 15:00:12 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:00:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:00:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:00:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:00:12 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 15:00:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 15:00:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 15:00:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443f846e-09ed-47d3-813d-62fc8cea96c2/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:00:12 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690815597.661945, 12c719bf-b770-4e41-b1f4-314eed1180c3 => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:00:12 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] VM Stopped (Lifecycle Event)
Jul 31 15:00:12 user nova-compute[72239]: DEBUG nova.compute.manager [None req-ec4b9cbe-8590-4e52-8ad3-6f02c0fcfde8 None None] [instance: 12c719bf-b770-4e41-b1f4-314eed1180c3] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:00:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443f846e-09ed-47d3-813d-62fc8cea96c2/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:00:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443f846e-09ed-47d3-813d-62fc8cea96c2/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:00:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443f846e-09ed-47d3-813d-62fc8cea96c2/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:00:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8652db6-b595-497f-a55d-8c0520bc18aa/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:00:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8652db6-b595-497f-a55d-8c0520bc18aa/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:00:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8652db6-b595-497f-a55d-8c0520bc18aa/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:00:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8652db6-b595-497f-a55d-8c0520bc18aa/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:00:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:00:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:00:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:00:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:00:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 15:00:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:00:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json" returned: 0 in 0.153s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:00:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:00:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:00:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:00:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:00:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:00:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:00:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:00:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:00:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:00:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:00:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:00:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:00:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:00:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:00:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:00:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:00:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:00:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:00:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dcd718a-280f-4b0e-b54f-616ee983ad16/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:00:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dcd718a-280f-4b0e-b54f-616ee983ad16/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:00:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dcd718a-280f-4b0e-b54f-616ee983ad16/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:00:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7dcd718a-280f-4b0e-b54f-616ee983ad16/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:00:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:00:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:00:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:00:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:00:16 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:00:16 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:00:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=7272MB free_disk=25.048206329345703GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 15:00:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:00:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:00:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Applying migration context for instance 3d70608b-fc54-4178-9aa6-98ca6198a37b as it has an incoming, in-progress migration b5e0640f-1435-4245-8d6a-90da81aa3b08. Migration status is finished {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Jul 31 15:00:16 user nova-compute[72239]: INFO nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Updating resource usage from migration b5e0640f-1435-4245-8d6a-90da81aa3b08
Jul 31 15:00:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 20abf743-de5b-4122-aad0-e2124c7804b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:00:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 7d81b881-b44e-4fb3-8245-9dea634bdec9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:00:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 079a5ed7-ee25-495b-a2a4-924d830a670a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:00:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 2f11022e-a007-4d4c-adc1-b54ea59b9e6a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:00:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance c10918e9-9731-48ea-860e-8a02cb6a0ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:00:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance c2b3c85b-e939-41d0-8bf0-3a7f650177b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:00:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 7dcd718a-280f-4b0e-b54f-616ee983ad16 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:00:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance e6f6d85d-ffa0-4d72-b521-e855afa23a09 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:00:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance b8652db6-b595-497f-a55d-8c0520bc18aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:00:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 443f846e-09ed-47d3-813d-62fc8cea96c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:00:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:00:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Migration b5e0640f-1435-4245-8d6a-90da81aa3b08 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Jul 31 15:00:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 3d70608b-fc54-4178-9aa6-98ca6198a37b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:00:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 15:00:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 15:00:16 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Refreshing inventories for resource provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 15:00:16 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Updating ProviderTree inventory for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 15:00:16 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Updating inventory in ProviderTree for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 15:00:16 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Refreshing aggregate associations for resource provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e, aggregates: None {{(pid=72239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 15:00:16 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Refreshing trait associations for resource provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI {{(pid=72239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 15:00:17 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:00:17 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:00:17 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 15:00:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.827s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:00:17 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:00:17 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 15:00:17 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:00:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-660deefd-e93d-484b-9393-07d9ff5bc005 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "079a5ed7-ee25-495b-a2a4-924d830a670a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:00:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-660deefd-e93d-484b-9393-07d9ff5bc005 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "079a5ed7-ee25-495b-a2a4-924d830a670a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:00:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-660deefd-e93d-484b-9393-07d9ff5bc005 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "079a5ed7-ee25-495b-a2a4-924d830a670a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:00:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-660deefd-e93d-484b-9393-07d9ff5bc005 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "079a5ed7-ee25-495b-a2a4-924d830a670a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:00:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-660deefd-e93d-484b-9393-07d9ff5bc005 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "079a5ed7-ee25-495b-a2a4-924d830a670a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:00:20 user nova-compute[72239]: INFO nova.compute.manager [None req-660deefd-e93d-484b-9393-07d9ff5bc005 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Terminating instance
Jul 31 15:00:20 user nova-compute[72239]: DEBUG nova.compute.manager [None req-660deefd-e93d-484b-9393-07d9ff5bc005 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 15:00:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:20 user nova-compute[72239]: DEBUG nova.compute.manager [req-53cbd341-fa33-4c05-8ac6-00d8679c6c7f req-14c9faf2-5fd4-4069-b347-08b3f1fc464d service nova] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Received event network-vif-unplugged-e22b0941-5069-46e7-9722-621a758253f1 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:00:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-53cbd341-fa33-4c05-8ac6-00d8679c6c7f req-14c9faf2-5fd4-4069-b347-08b3f1fc464d service nova] Acquiring lock "079a5ed7-ee25-495b-a2a4-924d830a670a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:00:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-53cbd341-fa33-4c05-8ac6-00d8679c6c7f req-14c9faf2-5fd4-4069-b347-08b3f1fc464d service nova] Lock "079a5ed7-ee25-495b-a2a4-924d830a670a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:00:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-53cbd341-fa33-4c05-8ac6-00d8679c6c7f req-14c9faf2-5fd4-4069-b347-08b3f1fc464d service nova] Lock "079a5ed7-ee25-495b-a2a4-924d830a670a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:00:20 user nova-compute[72239]: DEBUG nova.compute.manager [req-53cbd341-fa33-4c05-8ac6-00d8679c6c7f req-14c9faf2-5fd4-4069-b347-08b3f1fc464d service nova] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] No waiting events found dispatching network-vif-unplugged-e22b0941-5069-46e7-9722-621a758253f1 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:00:20 user nova-compute[72239]: DEBUG nova.compute.manager [req-53cbd341-fa33-4c05-8ac6-00d8679c6c7f req-14c9faf2-5fd4-4069-b347-08b3f1fc464d service nova] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Received event network-vif-unplugged-e22b0941-5069-46e7-9722-621a758253f1 for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 15:00:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:20 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Instance destroyed successfully.
Jul 31 15:00:20 user nova-compute[72239]: DEBUG nova.objects.instance [None req-660deefd-e93d-484b-9393-07d9ff5bc005 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lazy-loading 'resources' on Instance uuid 079a5ed7-ee25-495b-a2a4-924d830a670a {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:00:20 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-660deefd-e93d-484b-9393-07d9ff5bc005 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:44:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1703908301',display_name='tempest-ServerRescueNegativeTestJSON-server-1703908301',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1703908301',id=4,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:46:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='959107d575f04ba2b0ac800ed2ef61fa',ramdisk_id='',reservation_id='r-ay6781r8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1296361049',owner_user_name='tempest-ServerRescueNegativeTestJSON-1296361049-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:46:05Z,user_data=None,user_id='f10fd7b9c1d34ca5b37150f34ea09ffa',uuid=079a5ed7-ee25-495b-a2a4-924d830a670a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "e22b0941-5069-46e7-9722-621a758253f1", "address": "fa:16:3e:5e:88:13", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape22b0941-50", "ovs_interfaceid": "e22b0941-5069-46e7-9722-621a758253f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 15:00:20 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-660deefd-e93d-484b-9393-07d9ff5bc005 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Converting VIF {"id": "e22b0941-5069-46e7-9722-621a758253f1", "address": "fa:16:3e:5e:88:13", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape22b0941-50", "ovs_interfaceid": "e22b0941-5069-46e7-9722-621a758253f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:00:20 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-660deefd-e93d-484b-9393-07d9ff5bc005 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:88:13,bridge_name='br-int',has_traffic_filtering=True,id=e22b0941-5069-46e7-9722-621a758253f1,network=Network(02dfd673-dd23-4768-9c30-291cdbecbb64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape22b0941-50') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:00:20 user nova-compute[72239]: DEBUG os_vif [None req-660deefd-e93d-484b-9393-07d9ff5bc005 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:88:13,bridge_name='br-int',has_traffic_filtering=True,id=e22b0941-5069-46e7-9722-621a758253f1,network=Network(02dfd673-dd23-4768-9c30-291cdbecbb64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape22b0941-50') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 15:00:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape22b0941-50, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:00:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:00:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:20 user nova-compute[72239]: INFO os_vif [None req-660deefd-e93d-484b-9393-07d9ff5bc005 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:88:13,bridge_name='br-int',has_traffic_filtering=True,id=e22b0941-5069-46e7-9722-621a758253f1,network=Network(02dfd673-dd23-4768-9c30-291cdbecbb64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape22b0941-50')
Jul 31 15:00:20 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-660deefd-e93d-484b-9393-07d9ff5bc005 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Deleting instance files /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a_del
Jul 31 15:00:20 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-660deefd-e93d-484b-9393-07d9ff5bc005 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Deletion of /opt/stack/data/nova/instances/079a5ed7-ee25-495b-a2a4-924d830a670a_del complete
Jul 31 15:00:21 user nova-compute[72239]: INFO nova.compute.manager [None req-660deefd-e93d-484b-9393-07d9ff5bc005 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Took 0.77 seconds to destroy the instance on the hypervisor.
Jul 31 15:00:21 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-660deefd-e93d-484b-9393-07d9ff5bc005 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 15:00:21 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 15:00:21 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 15:00:21 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:00:21 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Took 0.56 seconds to deallocate network for instance.
Jul 31 15:00:21 user nova-compute[72239]: DEBUG nova.compute.manager [req-ebdf9476-662a-4071-aec8-3d10c9df6045 req-42ca8d7f-cc38-4f42-b70c-e01cd98c9e34 service nova] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Received event network-vif-deleted-e22b0941-5069-46e7-9722-621a758253f1 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:00:21 user nova-compute[72239]: INFO nova.compute.manager [req-ebdf9476-662a-4071-aec8-3d10c9df6045 req-42ca8d7f-cc38-4f42-b70c-e01cd98c9e34 service nova] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Neutron deleted interface e22b0941-5069-46e7-9722-621a758253f1; detaching it from the instance and deleting it from the info cache
Jul 31 15:00:21 user nova-compute[72239]: DEBUG nova.network.neutron [req-ebdf9476-662a-4071-aec8-3d10c9df6045 req-42ca8d7f-cc38-4f42-b70c-e01cd98c9e34 service nova] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:00:21 user nova-compute[72239]: DEBUG nova.compute.manager [req-ebdf9476-662a-4071-aec8-3d10c9df6045 req-42ca8d7f-cc38-4f42-b70c-e01cd98c9e34 service nova] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Detach interface failed, port_id=e22b0941-5069-46e7-9722-621a758253f1, reason: Instance 079a5ed7-ee25-495b-a2a4-924d830a670a could not be found. {{(pid=72239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 15:00:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-660deefd-e93d-484b-9393-07d9ff5bc005 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:00:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-660deefd-e93d-484b-9393-07d9ff5bc005 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:00:22 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-660deefd-e93d-484b-9393-07d9ff5bc005 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:00:22 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-660deefd-e93d-484b-9393-07d9ff5bc005 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:00:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-660deefd-e93d-484b-9393-07d9ff5bc005 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.411s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:00:22 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-660deefd-e93d-484b-9393-07d9ff5bc005 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Deleted allocations for instance 079a5ed7-ee25-495b-a2a4-924d830a670a
Jul 31 15:00:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-660deefd-e93d-484b-9393-07d9ff5bc005 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "079a5ed7-ee25-495b-a2a4-924d830a670a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.920s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:00:22 user nova-compute[72239]: DEBUG nova.compute.manager [req-482325cb-b44d-42c0-bae6-597272451a35 req-61b2ea6e-b06b-4c91-bf80-1f35b8c72706 service nova] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Received event network-vif-plugged-e22b0941-5069-46e7-9722-621a758253f1 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:00:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-482325cb-b44d-42c0-bae6-597272451a35 req-61b2ea6e-b06b-4c91-bf80-1f35b8c72706 service nova] Acquiring lock "079a5ed7-ee25-495b-a2a4-924d830a670a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:00:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-482325cb-b44d-42c0-bae6-597272451a35 req-61b2ea6e-b06b-4c91-bf80-1f35b8c72706 service nova] Lock "079a5ed7-ee25-495b-a2a4-924d830a670a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:00:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-482325cb-b44d-42c0-bae6-597272451a35 req-61b2ea6e-b06b-4c91-bf80-1f35b8c72706 service nova] Lock "079a5ed7-ee25-495b-a2a4-924d830a670a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:00:22 user nova-compute[72239]: DEBUG nova.compute.manager [req-482325cb-b44d-42c0-bae6-597272451a35 req-61b2ea6e-b06b-4c91-bf80-1f35b8c72706 service nova] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] No waiting events found dispatching network-vif-plugged-e22b0941-5069-46e7-9722-621a758253f1 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:00:22 user nova-compute[72239]: WARNING nova.compute.manager [req-482325cb-b44d-42c0-bae6-597272451a35 req-61b2ea6e-b06b-4c91-bf80-1f35b8c72706 service nova] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Received unexpected event network-vif-plugged-e22b0941-5069-46e7-9722-621a758253f1 for instance with vm_state deleted and task_state None.
Jul 31 15:00:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:30 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:35 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690815620.8936543, 079a5ed7-ee25-495b-a2a4-924d830a670a => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:00:35 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] VM Stopped (Lifecycle Event)
Jul 31 15:00:35 user nova-compute[72239]: DEBUG nova.compute.manager [None req-7f7e770d-f267-441f-9c20-0ffe88c1f62a None None] [instance: 079a5ed7-ee25-495b-a2a4-924d830a670a] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:00:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:40 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._sync_power_states {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Triggering sync for uuid 20abf743-de5b-4122-aad0-e2124c7804b7 {{(pid=72239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Triggering sync for uuid 7d81b881-b44e-4fb3-8245-9dea634bdec9 {{(pid=72239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Triggering sync for uuid 2f11022e-a007-4d4c-adc1-b54ea59b9e6a {{(pid=72239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Triggering sync for uuid c10918e9-9731-48ea-860e-8a02cb6a0ad9 {{(pid=72239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Triggering sync for uuid c2b3c85b-e939-41d0-8bf0-3a7f650177b2 {{(pid=72239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Triggering sync for uuid 7dcd718a-280f-4b0e-b54f-616ee983ad16 {{(pid=72239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Triggering sync for uuid e6f6d85d-ffa0-4d72-b521-e855afa23a09 {{(pid=72239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Triggering sync for uuid 3d70608b-fc54-4178-9aa6-98ca6198a37b {{(pid=72239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Triggering sync for uuid b8652db6-b595-497f-a55d-8c0520bc18aa {{(pid=72239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Triggering sync for uuid 443f846e-09ed-47d3-813d-62fc8cea96c2 {{(pid=72239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Triggering sync for uuid aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73 {{(pid=72239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "20abf743-de5b-4122-aad0-e2124c7804b7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "20abf743-de5b-4122-aad0-e2124c7804b7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "7d81b881-b44e-4fb3-8245-9dea634bdec9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "c2b3c85b-e939-41d0-8bf0-3a7f650177b2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "c2b3c85b-e939-41d0-8bf0-3a7f650177b2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "7dcd718a-280f-4b0e-b54f-616ee983ad16" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "7dcd718a-280f-4b0e-b54f-616ee983ad16" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "3d70608b-fc54-4178-9aa6-98ca6198a37b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "3d70608b-fc54-4178-9aa6-98ca6198a37b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "b8652db6-b595-497f-a55d-8c0520bc18aa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "b8652db6-b595-497f-a55d-8c0520bc18aa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "443f846e-09ed-47d3-813d-62fc8cea96c2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "443f846e-09ed-47d3-813d-62fc8cea96c2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.053s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "20abf743-de5b-4122-aad0-e2124c7804b7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "7dcd718a-280f-4b0e-b54f-616ee983ad16" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "c2b3c85b-e939-41d0-8bf0-3a7f650177b2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "3d70608b-fc54-4178-9aa6-98ca6198a37b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "b8652db6-b595-497f-a55d-8c0520bc18aa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.085s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.083s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "443f846e-09ed-47d3-813d-62fc8cea96c2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.086s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:00:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a3911bdd-25c9-4482-a2a0-d71e7d71f85f tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Acquiring lock "7dcd718a-280f-4b0e-b54f-616ee983ad16" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:00:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a3911bdd-25c9-4482-a2a0-d71e7d71f85f tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "7dcd718a-280f-4b0e-b54f-616ee983ad16" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:00:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a3911bdd-25c9-4482-a2a0-d71e7d71f85f tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Acquiring lock "7dcd718a-280f-4b0e-b54f-616ee983ad16-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:00:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a3911bdd-25c9-4482-a2a0-d71e7d71f85f tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "7dcd718a-280f-4b0e-b54f-616ee983ad16-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:00:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a3911bdd-25c9-4482-a2a0-d71e7d71f85f tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "7dcd718a-280f-4b0e-b54f-616ee983ad16-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:00:48 user nova-compute[72239]: INFO nova.compute.manager [None req-a3911bdd-25c9-4482-a2a0-d71e7d71f85f tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Terminating instance
Jul 31 15:00:48 user nova-compute[72239]: DEBUG nova.compute.manager [None req-a3911bdd-25c9-4482-a2a0-d71e7d71f85f tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 15:00:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:48 user nova-compute[72239]: DEBUG nova.compute.manager [req-0fd7c359-4278-4830-ace8-198c418142a3 req-372561e2-8891-4ed4-8d60-2df158ff89e9 service nova] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Received event network-vif-unplugged-3f2a8e6b-1b4c-4382-a093-865fc8151290 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:00:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0fd7c359-4278-4830-ace8-198c418142a3 req-372561e2-8891-4ed4-8d60-2df158ff89e9 service nova] Acquiring lock "7dcd718a-280f-4b0e-b54f-616ee983ad16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:00:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0fd7c359-4278-4830-ace8-198c418142a3 req-372561e2-8891-4ed4-8d60-2df158ff89e9 service nova] Lock "7dcd718a-280f-4b0e-b54f-616ee983ad16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:00:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0fd7c359-4278-4830-ace8-198c418142a3 req-372561e2-8891-4ed4-8d60-2df158ff89e9 service nova] Lock "7dcd718a-280f-4b0e-b54f-616ee983ad16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:00:48 user nova-compute[72239]: DEBUG nova.compute.manager [req-0fd7c359-4278-4830-ace8-198c418142a3 req-372561e2-8891-4ed4-8d60-2df158ff89e9 service nova] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] No waiting events found dispatching network-vif-unplugged-3f2a8e6b-1b4c-4382-a093-865fc8151290 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:00:48 user nova-compute[72239]: DEBUG nova.compute.manager [req-0fd7c359-4278-4830-ace8-198c418142a3 req-372561e2-8891-4ed4-8d60-2df158ff89e9 service nova] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Received event network-vif-unplugged-3f2a8e6b-1b4c-4382-a093-865fc8151290 for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 15:00:48 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Instance destroyed successfully.
Jul 31 15:00:48 user nova-compute[72239]: DEBUG nova.objects.instance [None req-a3911bdd-25c9-4482-a2a0-d71e7d71f85f tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lazy-loading 'resources' on Instance uuid 7dcd718a-280f-4b0e-b54f-616ee983ad16 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:00:48 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-a3911bdd-25c9-4482-a2a0-d71e7d71f85f tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:54:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1517360624',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1517360624',id=26,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBx3W4P2zAjU3Ub3TTeYMxI4tICd31ZsG+xdyUIEMCiJ6C2HMa4Zs5t+xbAX9f7zr4xygbnTvJSoUbZi0I4t3O8Na4hZbw/ELUJzuAoZF7tqPoHZSoA6lH0SKAvEiAOuWw==',key_name='tempest-keypair-330604452',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:54:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b0fbc9073ba94f6e93d8491accb42231',ramdisk_id='',reservation_id='r-pryejrft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-339927996',owner_user_name='tempest-ServerActionsV293TestJSON-339927996-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:54:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='946df3f784544702b6b057e66e23a97d',uuid=7dcd718a-280f-4b0e-b54f-616ee983ad16,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3f2a8e6b-1b4c-4382-a093-865fc8151290", "address": "fa:16:3e:fe:06:0d", "network": {"id": "ef3b3133-c6fe-4492-84f9-211f520dd339", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-428761984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0fbc9073ba94f6e93d8491accb42231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2a8e6b-1b", "ovs_interfaceid": "3f2a8e6b-1b4c-4382-a093-865fc8151290", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 15:00:48 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a3911bdd-25c9-4482-a2a0-d71e7d71f85f tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Converting VIF {"id": "3f2a8e6b-1b4c-4382-a093-865fc8151290", "address": "fa:16:3e:fe:06:0d", "network": {"id": "ef3b3133-c6fe-4492-84f9-211f520dd339", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-428761984-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b0fbc9073ba94f6e93d8491accb42231", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3f2a8e6b-1b", "ovs_interfaceid": "3f2a8e6b-1b4c-4382-a093-865fc8151290", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:00:48 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a3911bdd-25c9-4482-a2a0-d71e7d71f85f tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:06:0d,bridge_name='br-int',has_traffic_filtering=True,id=3f2a8e6b-1b4c-4382-a093-865fc8151290,network=Network(ef3b3133-c6fe-4492-84f9-211f520dd339),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f2a8e6b-1b') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:00:48 user nova-compute[72239]: DEBUG os_vif [None req-a3911bdd-25c9-4482-a2a0-d71e7d71f85f tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:06:0d,bridge_name='br-int',has_traffic_filtering=True,id=3f2a8e6b-1b4c-4382-a093-865fc8151290,network=Network(ef3b3133-c6fe-4492-84f9-211f520dd339),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f2a8e6b-1b') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 15:00:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3f2a8e6b-1b, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:00:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:00:48 user nova-compute[72239]: INFO os_vif [None req-a3911bdd-25c9-4482-a2a0-d71e7d71f85f tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:06:0d,bridge_name='br-int',has_traffic_filtering=True,id=3f2a8e6b-1b4c-4382-a093-865fc8151290,network=Network(ef3b3133-c6fe-4492-84f9-211f520dd339),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3f2a8e6b-1b')
Jul 31 15:00:48 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-a3911bdd-25c9-4482-a2a0-d71e7d71f85f tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Deleting instance files /opt/stack/data/nova/instances/7dcd718a-280f-4b0e-b54f-616ee983ad16_del
Jul 31 15:00:48 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-a3911bdd-25c9-4482-a2a0-d71e7d71f85f tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Deletion of /opt/stack/data/nova/instances/7dcd718a-280f-4b0e-b54f-616ee983ad16_del complete
Jul 31 15:00:49 user nova-compute[72239]: INFO nova.compute.manager [None req-a3911bdd-25c9-4482-a2a0-d71e7d71f85f tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Took 0.70 seconds to destroy the instance on the hypervisor.
Jul 31 15:00:49 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-a3911bdd-25c9-4482-a2a0-d71e7d71f85f tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 15:00:49 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 15:00:49 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 15:00:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:50 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:00:50 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Took 1.56 seconds to deallocate network for instance.
Jul 31 15:00:50 user nova-compute[72239]: DEBUG nova.compute.manager [req-3ad6e773-26fd-46a6-b4dd-65b37694f482 req-bc7240c6-013c-41ab-b0d5-81af6db032e0 service nova] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Received event network-vif-deleted-3f2a8e6b-1b4c-4382-a093-865fc8151290 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:00:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a3911bdd-25c9-4482-a2a0-d71e7d71f85f tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:00:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a3911bdd-25c9-4482-a2a0-d71e7d71f85f tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:00:50 user nova-compute[72239]: DEBUG nova.compute.manager [req-18c30e4d-0036-4f91-86e8-8035cb495208 req-cad8bced-1cf6-4924-8077-d3d40466ad88 service nova] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Received event network-vif-plugged-3f2a8e6b-1b4c-4382-a093-865fc8151290 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:00:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-18c30e4d-0036-4f91-86e8-8035cb495208 req-cad8bced-1cf6-4924-8077-d3d40466ad88 service nova] Acquiring lock "7dcd718a-280f-4b0e-b54f-616ee983ad16-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:00:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-18c30e4d-0036-4f91-86e8-8035cb495208 req-cad8bced-1cf6-4924-8077-d3d40466ad88 service nova] Lock "7dcd718a-280f-4b0e-b54f-616ee983ad16-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:00:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-18c30e4d-0036-4f91-86e8-8035cb495208 req-cad8bced-1cf6-4924-8077-d3d40466ad88 service nova] Lock "7dcd718a-280f-4b0e-b54f-616ee983ad16-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:00:50 user nova-compute[72239]: DEBUG nova.compute.manager [req-18c30e4d-0036-4f91-86e8-8035cb495208 req-cad8bced-1cf6-4924-8077-d3d40466ad88 service nova] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] No waiting events found dispatching network-vif-plugged-3f2a8e6b-1b4c-4382-a093-865fc8151290 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:00:50 user nova-compute[72239]: WARNING nova.compute.manager [req-18c30e4d-0036-4f91-86e8-8035cb495208 req-cad8bced-1cf6-4924-8077-d3d40466ad88 service nova] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Received unexpected event network-vif-plugged-3f2a8e6b-1b4c-4382-a093-865fc8151290 for instance with vm_state deleted and task_state None.
Jul 31 15:00:50 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-a3911bdd-25c9-4482-a2a0-d71e7d71f85f tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:00:50 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-a3911bdd-25c9-4482-a2a0-d71e7d71f85f tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:00:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a3911bdd-25c9-4482-a2a0-d71e7d71f85f tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:00:51 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-a3911bdd-25c9-4482-a2a0-d71e7d71f85f tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Deleted allocations for instance 7dcd718a-280f-4b0e-b54f-616ee983ad16
Jul 31 15:00:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a3911bdd-25c9-4482-a2a0-d71e7d71f85f tempest-ServerActionsV293TestJSON-339927996 tempest-ServerActionsV293TestJSON-339927996-project-member] Lock "7dcd718a-280f-4b0e-b54f-616ee983ad16" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.814s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:00:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:00:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:01:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:01:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:01:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:01:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:01:01 user nova-compute[72239]: INFO nova.compute.manager [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Terminating instance
Jul 31 15:01:01 user nova-compute[72239]: DEBUG nova.compute.manager [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 15:01:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:01 user nova-compute[72239]: DEBUG nova.compute.manager [req-40a2845f-29c3-4946-a635-4dba69f77ee9 req-36c08416-0c90-4804-8cbc-7816649db602 service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Received event network-vif-unplugged-5c7f836e-274b-4a20-915a-d28d7e70d2a3 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:01:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-40a2845f-29c3-4946-a635-4dba69f77ee9 req-36c08416-0c90-4804-8cbc-7816649db602 service nova] Acquiring lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:01:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-40a2845f-29c3-4946-a635-4dba69f77ee9 req-36c08416-0c90-4804-8cbc-7816649db602 service nova] Lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:01:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-40a2845f-29c3-4946-a635-4dba69f77ee9 req-36c08416-0c90-4804-8cbc-7816649db602 service nova] Lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:01:01 user nova-compute[72239]: DEBUG nova.compute.manager [req-40a2845f-29c3-4946-a635-4dba69f77ee9 req-36c08416-0c90-4804-8cbc-7816649db602 service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] No waiting events found dispatching network-vif-unplugged-5c7f836e-274b-4a20-915a-d28d7e70d2a3 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:01:01 user nova-compute[72239]: DEBUG nova.compute.manager [req-40a2845f-29c3-4946-a635-4dba69f77ee9 req-36c08416-0c90-4804-8cbc-7816649db602 service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Received event network-vif-unplugged-5c7f836e-274b-4a20-915a-d28d7e70d2a3 for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 15:01:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:02 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Instance destroyed successfully.
Jul 31 15:01:02 user nova-compute[72239]: DEBUG nova.objects.instance [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lazy-loading 'resources' on Instance uuid e6f6d85d-ffa0-4d72-b521-e855afa23a09 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:55:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-714375545',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-714375545',id=28,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:57:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d8281237f9c417a9685e55826911e1b',ramdisk_id='',reservation_id='r-a0hy000h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-148379254',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:59:16Z,user_data=None,user_id='94ab9298205143d489f678b28be5b085',uuid=e6f6d85d-ffa0-4d72-b521-e855afa23a09,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5c7f836e-274b-4a20-915a-d28d7e70d2a3", "address": "fa:16:3e:78:53:e9", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7f836e-27", "ovs_interfaceid": "5c7f836e-274b-4a20-915a-d28d7e70d2a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Converting VIF {"id": "5c7f836e-274b-4a20-915a-d28d7e70d2a3", "address": "fa:16:3e:78:53:e9", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5c7f836e-27", "ovs_interfaceid": "5c7f836e-274b-4a20-915a-d28d7e70d2a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:53:e9,bridge_name='br-int',has_traffic_filtering=True,id=5c7f836e-274b-4a20-915a-d28d7e70d2a3,network=Network(172fb80f-4bbe-4706-91cf-60540fbceb2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c7f836e-27') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG os_vif [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:53:e9,bridge_name='br-int',has_traffic_filtering=True,id=5c7f836e-274b-4a20-915a-d28d7e70d2a3,network=Network(172fb80f-4bbe-4706-91cf-60540fbceb2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c7f836e-27') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5c7f836e-27, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:01:02 user nova-compute[72239]: INFO os_vif [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:53:e9,bridge_name='br-int',has_traffic_filtering=True,id=5c7f836e-274b-4a20-915a-d28d7e70d2a3,network=Network(172fb80f-4bbe-4706-91cf-60540fbceb2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5c7f836e-27')
Jul 31 15:01:02 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kPyhpOjt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:01:02 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:01:02 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG nova.compute.manager [req-8aaa07b6-d309-4fba-a2e4-b947344759b8 req-629538e8-3547-4609-a7a6-aaa9fe130707 service nova] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Received event network-changed-7c709373-3d22-47b8-84d4-2a66ab39628a {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG nova.compute.manager [req-8aaa07b6-d309-4fba-a2e4-b947344759b8 req-629538e8-3547-4609-a7a6-aaa9fe130707 service nova] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Refreshing instance network info cache due to event network-changed-7c709373-3d22-47b8-84d4-2a66ab39628a. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-8aaa07b6-d309-4fba-a2e4-b947344759b8 req-629538e8-3547-4609-a7a6-aaa9fe130707 service nova] Acquiring lock "refresh_cache-b8652db6-b595-497f-a55d-8c0520bc18aa" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-8aaa07b6-d309-4fba-a2e4-b947344759b8 req-629538e8-3547-4609-a7a6-aaa9fe130707 service nova] Acquired lock "refresh_cache-b8652db6-b595-497f-a55d-8c0520bc18aa" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG nova.network.neutron [req-8aaa07b6-d309-4fba-a2e4-b947344759b8 req-629538e8-3547-4609-a7a6-aaa9fe130707 service nova] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Refreshing network info cache for port 7c709373-3d22-47b8-84d4-2a66ab39628a {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4ca0b0-b8a3-4596-9ccc-865a7274ff69]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd40ee1-c948-40ac-93c0-67f089d89943]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 15:01:02 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 15:01:02 user nova-compute[72239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 15:01:02 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 15:01:02 user nova-compute[72239]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae (non-flash)
Jul 31 15:01:02 user nova-compute[72239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 15:01:02 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41007d6320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae'): ({'sdb'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Removing single pathed devices sdb {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0710154-bcde-49a6-83aa-59f078b9edbb]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc61021e-617d-4fb7-81be-20659ec7470b]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Flushing IO for device /dev/sdb {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c968517-eabd-46b6-a5ce-5b5ee4eeb3fc]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a35e1780-e2ba-492c-b6f1-3743c75c2b42]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26331343864356530', '/dev/disk/by-id/scsi-1SCST_BIOfcd849a5-c148d5e06b1f11b3', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_fcd849a5') {{(pid=83493) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[269a0b27-dc9c-488e-866e-c4412afb4e1b]: (4, None) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[579be5e0-fa94-4766-881b-40e41b411a0d]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ee9b78-1655-431d-a74a-a263fc77712e]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae, portal: 172.16.0.220,3260]
Jul 31 15:01:02 user nova-compute[72239]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae, portal: 172.16.0.220,3260] successful.
Jul 31 15:01:02 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:084e3707-fde6-425e-bb74-cc8b96e427ae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[60fba907-2f9b-437c-9410-4bd2fac2fa1f]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] <== disconnect_volume: return (318ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 15:01:02 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Deleting instance files /opt/stack/data/nova/instances/e6f6d85d-ffa0-4d72-b521-e855afa23a09_del
Jul 31 15:01:02 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Deletion of /opt/stack/data/nova/instances/e6f6d85d-ffa0-4d72-b521-e855afa23a09_del complete
Jul 31 15:01:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Acquiring lock "0a89aa93-374f-4487-893b-58c15d42c84c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "0a89aa93-374f-4487-893b-58c15d42c84c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 15:01:02 user nova-compute[72239]: INFO nova.compute.manager [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Took 1.23 seconds to destroy the instance on the hypervisor.
Jul 31 15:01:02 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 15:01:02 user nova-compute[72239]: INFO nova.compute.claims [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Claim successful on node user
Jul 31 15:01:02 user nova-compute[72239]: DEBUG nova.network.neutron [req-8aaa07b6-d309-4fba-a2e4-b947344759b8 req-629538e8-3547-4609-a7a6-aaa9fe130707 service nova] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Updated VIF entry in instance network info cache for port 7c709373-3d22-47b8-84d4-2a66ab39628a. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG nova.network.neutron [req-8aaa07b6-d309-4fba-a2e4-b947344759b8 req-629538e8-3547-4609-a7a6-aaa9fe130707 service nova] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Updating instance_info_cache with network_info: [{"id": "7c709373-3d22-47b8-84d4-2a66ab39628a", "address": "fa:16:3e:9c:a0:63", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c709373-3d", "ovs_interfaceid": "7c709373-3d22-47b8-84d4-2a66ab39628a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:01:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-8aaa07b6-d309-4fba-a2e4-b947344759b8 req-629538e8-3547-4609-a7a6-aaa9fe130707 service nova] Releasing lock "refresh_cache-b8652db6-b595-497f-a55d-8c0520bc18aa" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:01:03 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:01:03 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:01:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.477s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:01:03 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 15:01:03 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 15:01:03 user nova-compute[72239]: DEBUG nova.network.neutron [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 15:01:03 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:01:03 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 15:01:03 user nova-compute[72239]: DEBUG nova.compute.manager [req-3ed1b782-81f7-47bc-ba4e-72c249937b3b req-41532c3e-5c38-4fce-9c3e-efe91d49fe79 service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Received event network-vif-deleted-5c7f836e-274b-4a20-915a-d28d7e70d2a3 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:01:03 user nova-compute[72239]: INFO nova.compute.manager [req-3ed1b782-81f7-47bc-ba4e-72c249937b3b req-41532c3e-5c38-4fce-9c3e-efe91d49fe79 service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Neutron deleted interface 5c7f836e-274b-4a20-915a-d28d7e70d2a3; detaching it from the instance and deleting it from the info cache
Jul 31 15:01:03 user nova-compute[72239]: DEBUG nova.network.neutron [req-3ed1b782-81f7-47bc-ba4e-72c249937b3b req-41532c3e-5c38-4fce-9c3e-efe91d49fe79 service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:01:03 user nova-compute[72239]: DEBUG nova.policy [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc15f7d4660746f59b6a8fb70f729521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4228abbe80ac416fbcc6013767ca9384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 15:01:03 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Took 0.99 seconds to deallocate network for instance.
Jul 31 15:01:03 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 15:01:03 user nova-compute[72239]: DEBUG nova.compute.manager [req-3ed1b782-81f7-47bc-ba4e-72c249937b3b req-41532c3e-5c38-4fce-9c3e-efe91d49fe79 service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Detach interface failed, port_id=5c7f836e-274b-4a20-915a-d28d7e70d2a3, reason: Instance e6f6d85d-ffa0-4d72-b521-e855afa23a09 could not be found. {{(pid=72239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 15:01:03 user nova-compute[72239]: DEBUG nova.compute.manager [req-dc428df1-59eb-4926-b8eb-31a32c29f709 req-8612e421-3d19-43d9-8ba7-c22928082a47 service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Received event network-vif-plugged-5c7f836e-274b-4a20-915a-d28d7e70d2a3 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:01:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-dc428df1-59eb-4926-b8eb-31a32c29f709 req-8612e421-3d19-43d9-8ba7-c22928082a47 service nova] Acquiring lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:01:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-dc428df1-59eb-4926-b8eb-31a32c29f709 req-8612e421-3d19-43d9-8ba7-c22928082a47 service nova] Lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:01:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-dc428df1-59eb-4926-b8eb-31a32c29f709 req-8612e421-3d19-43d9-8ba7-c22928082a47 service nova] Lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:01:03 user nova-compute[72239]: DEBUG nova.compute.manager [req-dc428df1-59eb-4926-b8eb-31a32c29f709 req-8612e421-3d19-43d9-8ba7-c22928082a47 service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] No waiting events found dispatching network-vif-plugged-5c7f836e-274b-4a20-915a-d28d7e70d2a3 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:01:03 user nova-compute[72239]: WARNING nova.compute.manager [req-dc428df1-59eb-4926-b8eb-31a32c29f709 req-8612e421-3d19-43d9-8ba7-c22928082a47 service nova] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Received unexpected event network-vif-plugged-5c7f836e-274b-4a20-915a-d28d7e70d2a3 for instance with vm_state active and task_state deleting.
Jul 31 15:01:03 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 15:01:03 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 15:01:03 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Creating image(s)
Jul 31 15:01:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Acquiring lock "/opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:01:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "/opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:01:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "/opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:01:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:03 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690815648.8539212, 7dcd718a-280f-4b0e-b54f-616ee983ad16 => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:01:03 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] VM Stopped (Lifecycle Event)
Jul 31 15:01:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.150s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Acquiring lock "ca449065000c92aac3b7b9fa685f9a7710929444" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:01:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:01:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:04 user nova-compute[72239]: DEBUG nova.compute.manager [None req-31b81c02-950c-4b14-8ba5-b8584ee8df5b None None] [instance: 7dcd718a-280f-4b0e-b54f-616ee983ad16] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:01:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.140s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk 1073741824" returned: 0 in 0.050s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.195s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:01:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.143s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:04 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 15:01:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:04 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Cannot resize image /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 15:01:04 user nova-compute[72239]: DEBUG nova.objects.instance [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lazy-loading 'migration_context' on Instance uuid 0a89aa93-374f-4487-893b-58c15d42c84c {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:01:04 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 15:01:04 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Ensure instance console log exists: /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 15:01:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:01:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:01:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:01:04 user nova-compute[72239]: DEBUG nova.network.neutron [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Successfully created port: 73d584f4-4986-4f0c-8483-18ef254a21f4 {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 15:01:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG nova.network.neutron [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Successfully updated port: 73d584f4-4986-4f0c-8483-18ef254a21f4 {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Acquiring lock "refresh_cache-0a89aa93-374f-4487-893b-58c15d42c84c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Acquired lock "refresh_cache-0a89aa93-374f-4487-893b-58c15d42c84c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG nova.network.neutron [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG nova.network.neutron [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG nova.compute.manager [req-900720a8-ac08-43f7-ab04-fc5b466bcaf3 req-b62de00d-31db-4259-868c-3fd81b4ca2e8 service nova] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Received event network-changed-73d584f4-4986-4f0c-8483-18ef254a21f4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG nova.compute.manager [req-900720a8-ac08-43f7-ab04-fc5b466bcaf3 req-b62de00d-31db-4259-868c-3fd81b4ca2e8 service nova] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Refreshing instance network info cache due to event network-changed-73d584f4-4986-4f0c-8483-18ef254a21f4. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-900720a8-ac08-43f7-ab04-fc5b466bcaf3 req-b62de00d-31db-4259-868c-3fd81b4ca2e8 service nova] Acquiring lock "refresh_cache-0a89aa93-374f-4487-893b-58c15d42c84c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG nova.network.neutron [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Updating instance_info_cache with network_info: [{"id": "73d584f4-4986-4f0c-8483-18ef254a21f4", "address": "fa:16:3e:22:aa:8c", "network": {"id": "39af8721-7023-4cb5-9e06-293f319d5d93", "bridge": "br-int", "label": "tempest-TestStampPattern-549999556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228abbe80ac416fbcc6013767ca9384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73d584f4-49", "ovs_interfaceid": "73d584f4-4986-4f0c-8483-18ef254a21f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Releasing lock "refresh_cache-0a89aa93-374f-4487-893b-58c15d42c84c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Instance network_info: |[{"id": "73d584f4-4986-4f0c-8483-18ef254a21f4", "address": "fa:16:3e:22:aa:8c", "network": {"id": "39af8721-7023-4cb5-9e06-293f319d5d93", "bridge": "br-int", "label": "tempest-TestStampPattern-549999556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228abbe80ac416fbcc6013767ca9384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73d584f4-49", "ovs_interfaceid": "73d584f4-4986-4f0c-8483-18ef254a21f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-900720a8-ac08-43f7-ab04-fc5b466bcaf3 req-b62de00d-31db-4259-868c-3fd81b4ca2e8 service nova] Acquired lock "refresh_cache-0a89aa93-374f-4487-893b-58c15d42c84c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG nova.network.neutron [req-900720a8-ac08-43f7-ab04-fc5b466bcaf3 req-b62de00d-31db-4259-868c-3fd81b4ca2e8 service nova] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Refreshing network info cache for port 73d584f4-4986-4f0c-8483-18ef254a21f4 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Start _get_guest_xml network_info=[{"id": "73d584f4-4986-4f0c-8483-18ef254a21f4", "address": "fa:16:3e:22:aa:8c", "network": {"id": "39af8721-7023-4cb5-9e06-293f319d5d93", "bridge": "br-int", "label": "tempest-TestStampPattern-549999556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228abbe80ac416fbcc6013767ca9384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73d584f4-49", "ovs_interfaceid": "73d584f4-4986-4f0c-8483-18ef254a21f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 15:01:05 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:01:05 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:01:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:01:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1115374225',display_name='tempest-TestStampPattern-server-1115374225',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1115374225',id=35,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtzUkuhD+wwUbFtr7G/xwzzWTycEUmu5aFIujMoqcCgETcqAHEigBAjoG6HJEMVeMKVtot/DjyoIAoKu2HGxjf4jAREiiEvxQvonoCgtEXCLIHvDszAezjEtchB2nDfpg==',key_name='tempest-TestStampPattern-1537860596',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4228abbe80ac416fbcc6013767ca9384',ramdisk_id='',reservation_id='r-mk53kv0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1615288352',owner_user_name='tempest-TestStampPattern-1615288352-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T15:01:04Z,user_data=None,user_id='fc15f7d4660746f59b6a8fb70f729521',uuid=0a89aa93-374f-4487-893b-58c15d42c84c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73d584f4-4986-4f0c-8483-18ef254a21f4", "address": "fa:16:3e:22:aa:8c", "network": {"id": "39af8721-7023-4cb5-9e06-293f319d5d93", "bridge": "br-int", "label": "tempest-TestStampPattern-549999556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228abbe80ac416fbcc6013767ca9384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73d584f4-49", "ovs_interfaceid": "73d584f4-4986-4f0c-8483-18ef254a21f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Converting VIF {"id": "73d584f4-4986-4f0c-8483-18ef254a21f4", "address": "fa:16:3e:22:aa:8c", "network": {"id": "39af8721-7023-4cb5-9e06-293f319d5d93", "bridge": "br-int", "label": "tempest-TestStampPattern-549999556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228abbe80ac416fbcc6013767ca9384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73d584f4-49", "ovs_interfaceid": "73d584f4-4986-4f0c-8483-18ef254a21f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:aa:8c,bridge_name='br-int',has_traffic_filtering=True,id=73d584f4-4986-4f0c-8483-18ef254a21f4,network=Network(39af8721-7023-4cb5-9e06-293f319d5d93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73d584f4-49') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG nova.objects.instance [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a89aa93-374f-4487-893b-58c15d42c84c {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] End _get_guest_xml xml=<domain type="kvm">
Jul 31 15:01:05 user nova-compute[72239]:   <uuid>0a89aa93-374f-4487-893b-58c15d42c84c</uuid>
Jul 31 15:01:05 user nova-compute[72239]:   <name>instance-00000023</name>
Jul 31 15:01:05 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 15:01:05 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 15:01:05 user nova-compute[72239]:   <metadata>
Jul 31 15:01:05 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 15:01:05 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 15:01:05 user nova-compute[72239]:       <nova:name>tempest-TestStampPattern-server-1115374225</nova:name>
Jul 31 15:01:05 user nova-compute[72239]:       <nova:creationTime>2023-07-31 15:01:05</nova:creationTime>
Jul 31 15:01:05 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 15:01:05 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 15:01:05 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 15:01:05 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 15:01:05 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 15:01:05 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 15:01:05 user nova-compute[72239]:       </nova:flavor>
Jul 31 15:01:05 user nova-compute[72239]:       <nova:owner>
Jul 31 15:01:05 user nova-compute[72239]:         <nova:user uuid="fc15f7d4660746f59b6a8fb70f729521">tempest-TestStampPattern-1615288352-project-member</nova:user>
Jul 31 15:01:05 user nova-compute[72239]:         <nova:project uuid="4228abbe80ac416fbcc6013767ca9384">tempest-TestStampPattern-1615288352</nova:project>
Jul 31 15:01:05 user nova-compute[72239]:       </nova:owner>
Jul 31 15:01:05 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 15:01:05 user nova-compute[72239]:       <nova:ports>
Jul 31 15:01:05 user nova-compute[72239]:         <nova:port uuid="73d584f4-4986-4f0c-8483-18ef254a21f4">
Jul 31 15:01:05 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 31 15:01:05 user nova-compute[72239]:         </nova:port>
Jul 31 15:01:05 user nova-compute[72239]:       </nova:ports>
Jul 31 15:01:05 user nova-compute[72239]:     </nova:instance>
Jul 31 15:01:05 user nova-compute[72239]:   </metadata>
Jul 31 15:01:05 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 15:01:05 user nova-compute[72239]:     <system>
Jul 31 15:01:05 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 15:01:05 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 15:01:05 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 15:01:05 user nova-compute[72239]:       <entry name="serial">0a89aa93-374f-4487-893b-58c15d42c84c</entry>
Jul 31 15:01:05 user nova-compute[72239]:       <entry name="uuid">0a89aa93-374f-4487-893b-58c15d42c84c</entry>
Jul 31 15:01:05 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 15:01:05 user nova-compute[72239]:     </system>
Jul 31 15:01:05 user nova-compute[72239]:   </sysinfo>
Jul 31 15:01:05 user nova-compute[72239]:   <os>
Jul 31 15:01:05 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 15:01:05 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 15:01:05 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 15:01:05 user nova-compute[72239]:   </os>
Jul 31 15:01:05 user nova-compute[72239]:   <features>
Jul 31 15:01:05 user nova-compute[72239]:     <acpi/>
Jul 31 15:01:05 user nova-compute[72239]:     <apic/>
Jul 31 15:01:05 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 15:01:05 user nova-compute[72239]:   </features>
Jul 31 15:01:05 user nova-compute[72239]:   <clock offset="utc">
Jul 31 15:01:05 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 15:01:05 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 15:01:05 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 15:01:05 user nova-compute[72239]:   </clock>
Jul 31 15:01:05 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 15:01:05 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 15:01:05 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 15:01:05 user nova-compute[72239]:   </cpu>
Jul 31 15:01:05 user nova-compute[72239]:   <devices>
Jul 31 15:01:05 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 15:01:05 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 15:01:05 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk"/>
Jul 31 15:01:05 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 15:01:05 user nova-compute[72239]:     </disk>
Jul 31 15:01:05 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 15:01:05 user nova-compute[72239]:       <mac address="fa:16:3e:22:aa:8c"/>
Jul 31 15:01:05 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:01:05 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 15:01:05 user nova-compute[72239]:       <target dev="tap73d584f4-49"/>
Jul 31 15:01:05 user nova-compute[72239]:     </interface>
Jul 31 15:01:05 user nova-compute[72239]:     <serial type="pty">
Jul 31 15:01:05 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/console.log" append="off"/>
Jul 31 15:01:05 user nova-compute[72239]:     </serial>
Jul 31 15:01:05 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 15:01:05 user nova-compute[72239]:     <video>
Jul 31 15:01:05 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:01:05 user nova-compute[72239]:     </video>
Jul 31 15:01:05 user nova-compute[72239]:     <rng model="virtio">
Jul 31 15:01:05 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 15:01:05 user nova-compute[72239]:     </rng>
Jul 31 15:01:05 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 15:01:05 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 15:01:05 user nova-compute[72239]:       <stats period="10"/>
Jul 31 15:01:05 user nova-compute[72239]:     </memballoon>
Jul 31 15:01:05 user nova-compute[72239]:   </devices>
Jul 31 15:01:05 user nova-compute[72239]: </domain>
Jul 31 15:01:05 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:01:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1115374225',display_name='tempest-TestStampPattern-server-1115374225',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1115374225',id=35,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtzUkuhD+wwUbFtr7G/xwzzWTycEUmu5aFIujMoqcCgETcqAHEigBAjoG6HJEMVeMKVtot/DjyoIAoKu2HGxjf4jAREiiEvxQvonoCgtEXCLIHvDszAezjEtchB2nDfpg==',key_name='tempest-TestStampPattern-1537860596',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4228abbe80ac416fbcc6013767ca9384',ramdisk_id='',reservation_id='r-mk53kv0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1615288352',owner_user_name='tempest-TestStampPattern-1615288352-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T15:01:04Z,user_data=None,user_id='fc15f7d4660746f59b6a8fb70f729521',uuid=0a89aa93-374f-4487-893b-58c15d42c84c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73d584f4-4986-4f0c-8483-18ef254a21f4", "address": "fa:16:3e:22:aa:8c", "network": {"id": "39af8721-7023-4cb5-9e06-293f319d5d93", "bridge": "br-int", "label": "tempest-TestStampPattern-549999556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228abbe80ac416fbcc6013767ca9384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73d584f4-49", "ovs_interfaceid": "73d584f4-4986-4f0c-8483-18ef254a21f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Converting VIF {"id": "73d584f4-4986-4f0c-8483-18ef254a21f4", "address": "fa:16:3e:22:aa:8c", "network": {"id": "39af8721-7023-4cb5-9e06-293f319d5d93", "bridge": "br-int", "label": "tempest-TestStampPattern-549999556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228abbe80ac416fbcc6013767ca9384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73d584f4-49", "ovs_interfaceid": "73d584f4-4986-4f0c-8483-18ef254a21f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:aa:8c,bridge_name='br-int',has_traffic_filtering=True,id=73d584f4-4986-4f0c-8483-18ef254a21f4,network=Network(39af8721-7023-4cb5-9e06-293f319d5d93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73d584f4-49') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG os_vif [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:aa:8c,bridge_name='br-int',has_traffic_filtering=True,id=73d584f4-4986-4f0c-8483-18ef254a21f4,network=Network(39af8721-7023-4cb5-9e06-293f319d5d93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73d584f4-49') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73d584f4-49, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap73d584f4-49, col_values=(('external_ids', {'iface-id': '73d584f4-4986-4f0c-8483-18ef254a21f4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:aa:8c', 'vm-uuid': '0a89aa93-374f-4487-893b-58c15d42c84c'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:05 user nova-compute[72239]: INFO os_vif [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:aa:8c,bridge_name='br-int',has_traffic_filtering=True,id=73d584f4-4986-4f0c-8483-18ef254a21f4,network=Network(39af8721-7023-4cb5-9e06-293f319d5d93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73d584f4-49')
Jul 31 15:01:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] No VIF found with MAC fa:16:3e:22:aa:8c, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 15:01:05 user nova-compute[72239]: INFO nova.compute.manager [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Took 2.12 seconds to detach 1 volumes for instance.
Jul 31 15:01:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG nova.network.neutron [req-900720a8-ac08-43f7-ab04-fc5b466bcaf3 req-b62de00d-31db-4259-868c-3fd81b4ca2e8 service nova] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Updated VIF entry in instance network info cache for port 73d584f4-4986-4f0c-8483-18ef254a21f4. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG nova.network.neutron [req-900720a8-ac08-43f7-ab04-fc5b466bcaf3 req-b62de00d-31db-4259-868c-3fd81b4ca2e8 service nova] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Updating instance_info_cache with network_info: [{"id": "73d584f4-4986-4f0c-8483-18ef254a21f4", "address": "fa:16:3e:22:aa:8c", "network": {"id": "39af8721-7023-4cb5-9e06-293f319d5d93", "bridge": "br-int", "label": "tempest-TestStampPattern-549999556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228abbe80ac416fbcc6013767ca9384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73d584f4-49", "ovs_interfaceid": "73d584f4-4986-4f0c-8483-18ef254a21f4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:01:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-900720a8-ac08-43f7-ab04-fc5b466bcaf3 req-b62de00d-31db-4259-868c-3fd81b4ca2e8 service nova] Releasing lock "refresh_cache-0a89aa93-374f-4487-893b-58c15d42c84c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:01:06 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:01:06 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:01:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.369s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:01:06 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Deleted allocations for instance e6f6d85d-ffa0-4d72-b521-e855afa23a09
Jul 31 15:01:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-95124c5c-e0e4-4240-87df-85319e6fc093 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "e6f6d85d-ffa0-4d72-b521-e855afa23a09" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.953s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:01:06 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:01:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-00b8aa2a-3f25-4f62-bb4c-b50aba46a225 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "b8652db6-b595-497f-a55d-8c0520bc18aa" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:01:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-00b8aa2a-3f25-4f62-bb4c-b50aba46a225 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "b8652db6-b595-497f-a55d-8c0520bc18aa" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:01:06 user nova-compute[72239]: INFO nova.compute.manager [None req-00b8aa2a-3f25-4f62-bb4c-b50aba46a225 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Shelving
Jul 31 15:01:06 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:07 user nova-compute[72239]: DEBUG nova.compute.manager [req-701576a0-6aae-472d-8c7c-cd77276424a2 req-12f8b80d-d94a-4a8f-8016-d73403b081f3 service nova] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Received event network-vif-unplugged-7c709373-3d22-47b8-84d4-2a66ab39628a {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:01:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-701576a0-6aae-472d-8c7c-cd77276424a2 req-12f8b80d-d94a-4a8f-8016-d73403b081f3 service nova] Acquiring lock "b8652db6-b595-497f-a55d-8c0520bc18aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:01:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-701576a0-6aae-472d-8c7c-cd77276424a2 req-12f8b80d-d94a-4a8f-8016-d73403b081f3 service nova] Lock "b8652db6-b595-497f-a55d-8c0520bc18aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:01:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-701576a0-6aae-472d-8c7c-cd77276424a2 req-12f8b80d-d94a-4a8f-8016-d73403b081f3 service nova] Lock "b8652db6-b595-497f-a55d-8c0520bc18aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:01:07 user nova-compute[72239]: DEBUG nova.compute.manager [req-701576a0-6aae-472d-8c7c-cd77276424a2 req-12f8b80d-d94a-4a8f-8016-d73403b081f3 service nova] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] No waiting events found dispatching network-vif-unplugged-7c709373-3d22-47b8-84d4-2a66ab39628a {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:01:07 user nova-compute[72239]: WARNING nova.compute.manager [req-701576a0-6aae-472d-8c7c-cd77276424a2 req-12f8b80d-d94a-4a8f-8016-d73403b081f3 service nova] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Received unexpected event network-vif-unplugged-7c709373-3d22-47b8-84d4-2a66ab39628a for instance with vm_state active and task_state shelving.
Jul 31 15:01:07 user nova-compute[72239]: DEBUG nova.compute.manager [req-53e7c20a-48a5-458d-9701-68443152340f req-a2626f2b-f752-4222-be32-3e4b87a8f8b2 service nova] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Received event network-vif-plugged-73d584f4-4986-4f0c-8483-18ef254a21f4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:01:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-53e7c20a-48a5-458d-9701-68443152340f req-a2626f2b-f752-4222-be32-3e4b87a8f8b2 service nova] Acquiring lock "0a89aa93-374f-4487-893b-58c15d42c84c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:01:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-53e7c20a-48a5-458d-9701-68443152340f req-a2626f2b-f752-4222-be32-3e4b87a8f8b2 service nova] Lock "0a89aa93-374f-4487-893b-58c15d42c84c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:01:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-53e7c20a-48a5-458d-9701-68443152340f req-a2626f2b-f752-4222-be32-3e4b87a8f8b2 service nova] Lock "0a89aa93-374f-4487-893b-58c15d42c84c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:01:07 user nova-compute[72239]: DEBUG nova.compute.manager [req-53e7c20a-48a5-458d-9701-68443152340f req-a2626f2b-f752-4222-be32-3e4b87a8f8b2 service nova] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] No waiting events found dispatching network-vif-plugged-73d584f4-4986-4f0c-8483-18ef254a21f4 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:01:07 user nova-compute[72239]: WARNING nova.compute.manager [req-53e7c20a-48a5-458d-9701-68443152340f req-a2626f2b-f752-4222-be32-3e4b87a8f8b2 service nova] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Received unexpected event network-vif-plugged-73d584f4-4986-4f0c-8483-18ef254a21f4 for instance with vm_state building and task_state spawning.
Jul 31 15:01:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:07 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Instance destroyed successfully.
Jul 31 15:01:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:07 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-00b8aa2a-3f25-4f62-bb4c-b50aba46a225 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Beginning cold snapshot process
Jul 31 15:01:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:08 user nova-compute[72239]: DEBUG nova.privsep.utils [None req-00b8aa2a-3f25-4f62-bb4c-b50aba46a225 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72239) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 15:01:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-00b8aa2a-3f25-4f62-bb4c-b50aba46a225 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/b8652db6-b595-497f-a55d-8c0520bc18aa/disk /opt/stack/data/nova/instances/snapshots/tmpnmru5e00/b563f4504efa4e4ebc1fd283b1229a49 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:08 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:01:08 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:01:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-00b8aa2a-3f25-4f62-bb4c-b50aba46a225 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/b8652db6-b595-497f-a55d-8c0520bc18aa/disk /opt/stack/data/nova/instances/snapshots/tmpnmru5e00/b563f4504efa4e4ebc1fd283b1229a49" returned: 0 in 0.797s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:08 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-00b8aa2a-3f25-4f62-bb4c-b50aba46a225 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Snapshot extracted, beginning image upload
Jul 31 15:01:09 user nova-compute[72239]: DEBUG nova.compute.manager [req-2847b5fc-77d7-491b-adc6-b097ae9cc8e4 req-11ed68ef-9756-4cdb-8600-a58010fa1f75 service nova] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Received event network-vif-plugged-7c709373-3d22-47b8-84d4-2a66ab39628a {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:01:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-2847b5fc-77d7-491b-adc6-b097ae9cc8e4 req-11ed68ef-9756-4cdb-8600-a58010fa1f75 service nova] Acquiring lock "b8652db6-b595-497f-a55d-8c0520bc18aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:01:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-2847b5fc-77d7-491b-adc6-b097ae9cc8e4 req-11ed68ef-9756-4cdb-8600-a58010fa1f75 service nova] Lock "b8652db6-b595-497f-a55d-8c0520bc18aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:01:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-2847b5fc-77d7-491b-adc6-b097ae9cc8e4 req-11ed68ef-9756-4cdb-8600-a58010fa1f75 service nova] Lock "b8652db6-b595-497f-a55d-8c0520bc18aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:01:09 user nova-compute[72239]: DEBUG nova.compute.manager [req-2847b5fc-77d7-491b-adc6-b097ae9cc8e4 req-11ed68ef-9756-4cdb-8600-a58010fa1f75 service nova] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] No waiting events found dispatching network-vif-plugged-7c709373-3d22-47b8-84d4-2a66ab39628a {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:01:09 user nova-compute[72239]: WARNING nova.compute.manager [req-2847b5fc-77d7-491b-adc6-b097ae9cc8e4 req-11ed68ef-9756-4cdb-8600-a58010fa1f75 service nova] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Received unexpected event network-vif-plugged-7c709373-3d22-47b8-84d4-2a66ab39628a for instance with vm_state active and task_state shelving_image_uploading.
Jul 31 15:01:09 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:01:09 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 15:01:09 user nova-compute[72239]: DEBUG nova.compute.manager [req-7f542f08-7193-48f7-a55c-ae7107b2e290 req-40b5d6bc-6a95-4b2a-89f8-a7484bbbc7e1 service nova] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Received event network-vif-plugged-73d584f4-4986-4f0c-8483-18ef254a21f4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:01:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7f542f08-7193-48f7-a55c-ae7107b2e290 req-40b5d6bc-6a95-4b2a-89f8-a7484bbbc7e1 service nova] Acquiring lock "0a89aa93-374f-4487-893b-58c15d42c84c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:01:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7f542f08-7193-48f7-a55c-ae7107b2e290 req-40b5d6bc-6a95-4b2a-89f8-a7484bbbc7e1 service nova] Lock "0a89aa93-374f-4487-893b-58c15d42c84c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:01:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7f542f08-7193-48f7-a55c-ae7107b2e290 req-40b5d6bc-6a95-4b2a-89f8-a7484bbbc7e1 service nova] Lock "0a89aa93-374f-4487-893b-58c15d42c84c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:01:09 user nova-compute[72239]: DEBUG nova.compute.manager [req-7f542f08-7193-48f7-a55c-ae7107b2e290 req-40b5d6bc-6a95-4b2a-89f8-a7484bbbc7e1 service nova] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] No waiting events found dispatching network-vif-plugged-73d584f4-4986-4f0c-8483-18ef254a21f4 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:01:09 user nova-compute[72239]: WARNING nova.compute.manager [req-7f542f08-7193-48f7-a55c-ae7107b2e290 req-40b5d6bc-6a95-4b2a-89f8-a7484bbbc7e1 service nova] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Received unexpected event network-vif-plugged-73d584f4-4986-4f0c-8483-18ef254a21f4 for instance with vm_state building and task_state spawning.
Jul 31 15:01:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-2f11022e-a007-4d4c-adc1-b54ea59b9e6a" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:01:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-2f11022e-a007-4d4c-adc1-b54ea59b9e6a" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:01:09 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 15:01:09 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815669.6150556, 0a89aa93-374f-4487-893b-58c15d42c84c => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:01:09 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] VM Resumed (Lifecycle Event)
Jul 31 15:01:09 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 15:01:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 15:01:09 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Instance spawned successfully.
Jul 31 15:01:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 15:01:09 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:01:09 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:01:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:01:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:01:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:01:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:01:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:01:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:01:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:09 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 15:01:09 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815669.6153176, 0a89aa93-374f-4487-893b-58c15d42c84c => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:01:09 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] VM Started (Lifecycle Event)
Jul 31 15:01:09 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:01:09 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:01:09 user nova-compute[72239]: INFO nova.compute.manager [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Took 6.02 seconds to spawn the instance on the hypervisor.
Jul 31 15:01:09 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:01:09 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 15:01:09 user nova-compute[72239]: INFO nova.compute.manager [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Took 7.23 seconds to build instance.
Jul 31 15:01:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1a821e21-b117-4a6c-bfb9-43f26b74c257 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "0a89aa93-374f-4487-893b-58c15d42c84c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.360s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:01:09 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Updating instance_info_cache with network_info: [{"id": "91cadad3-732b-4fed-af92-b54692837973", "address": "fa:16:3e:44:72:66", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91cadad3-73", "ovs_interfaceid": "91cadad3-732b-4fed-af92-b54692837973", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:01:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-2f11022e-a007-4d4c-adc1-b54ea59b9e6a" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:01:10 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 15:01:10 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:01:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c2a3f8cf-e697-4cc4-9f40-7cb74e6f1137 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "7d81b881-b44e-4fb3-8245-9dea634bdec9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:01:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c2a3f8cf-e697-4cc4-9f40-7cb74e6f1137 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:01:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c2a3f8cf-e697-4cc4-9f40-7cb74e6f1137 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:01:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c2a3f8cf-e697-4cc4-9f40-7cb74e6f1137 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:01:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c2a3f8cf-e697-4cc4-9f40-7cb74e6f1137 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:01:10 user nova-compute[72239]: INFO nova.compute.manager [None req-c2a3f8cf-e697-4cc4-9f40-7cb74e6f1137 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Terminating instance
Jul 31 15:01:10 user nova-compute[72239]: DEBUG nova.compute.manager [None req-c2a3f8cf-e697-4cc4-9f40-7cb74e6f1137 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 15:01:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:11 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-00b8aa2a-3f25-4f62-bb4c-b50aba46a225 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Snapshot image upload complete
Jul 31 15:01:11 user nova-compute[72239]: DEBUG nova.compute.manager [None req-00b8aa2a-3f25-4f62-bb4c-b50aba46a225 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:01:11 user nova-compute[72239]: INFO nova.compute.manager [None req-00b8aa2a-3f25-4f62-bb4c-b50aba46a225 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Shelve offloading
Jul 31 15:01:11 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Instance destroyed successfully.
Jul 31 15:01:11 user nova-compute[72239]: DEBUG nova.compute.manager [None req-00b8aa2a-3f25-4f62-bb4c-b50aba46a225 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:01:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-00b8aa2a-3f25-4f62-bb4c-b50aba46a225 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "refresh_cache-b8652db6-b595-497f-a55d-8c0520bc18aa" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:01:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-00b8aa2a-3f25-4f62-bb4c-b50aba46a225 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquired lock "refresh_cache-b8652db6-b595-497f-a55d-8c0520bc18aa" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:01:11 user nova-compute[72239]: DEBUG nova.network.neutron [None req-00b8aa2a-3f25-4f62-bb4c-b50aba46a225 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 15:01:11 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:01:11 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:01:11 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Instance destroyed successfully.
Jul 31 15:01:11 user nova-compute[72239]: DEBUG nova.objects.instance [None req-c2a3f8cf-e697-4cc4-9f40-7cb74e6f1137 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lazy-loading 'resources' on Instance uuid 7d81b881-b44e-4fb3-8245-9dea634bdec9 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:01:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-c2a3f8cf-e697-4cc4-9f40-7cb74e6f1137 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:44:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-263563606',display_name='tempest-ServerRescueNegativeTestJSON-server-263563606',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-263563606',id=3,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:49:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='959107d575f04ba2b0ac800ed2ef61fa',ramdisk_id='',reservation_id='r-3kc25083',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1296361049',owner_user_name='tempest-ServerRescueNegativeTestJSON-1296361049-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:50:50Z,user_data=None,user_id='f10fd7b9c1d34ca5b37150f34ea09ffa',uuid=7d81b881-b44e-4fb3-8245-9dea634bdec9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60f70f18-4024-4388-ae64-3c2cca0cafbc", "address": "fa:16:3e:a5:de:4b", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f70f18-40", "ovs_interfaceid": "60f70f18-4024-4388-ae64-3c2cca0cafbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 15:01:11 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-c2a3f8cf-e697-4cc4-9f40-7cb74e6f1137 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Converting VIF {"id": "60f70f18-4024-4388-ae64-3c2cca0cafbc", "address": "fa:16:3e:a5:de:4b", "network": {"id": "02dfd673-dd23-4768-9c30-291cdbecbb64", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-918932714-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "959107d575f04ba2b0ac800ed2ef61fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60f70f18-40", "ovs_interfaceid": "60f70f18-4024-4388-ae64-3c2cca0cafbc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:01:11 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-c2a3f8cf-e697-4cc4-9f40-7cb74e6f1137 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a5:de:4b,bridge_name='br-int',has_traffic_filtering=True,id=60f70f18-4024-4388-ae64-3c2cca0cafbc,network=Network(02dfd673-dd23-4768-9c30-291cdbecbb64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f70f18-40') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:01:11 user nova-compute[72239]: DEBUG os_vif [None req-c2a3f8cf-e697-4cc4-9f40-7cb74e6f1137 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:de:4b,bridge_name='br-int',has_traffic_filtering=True,id=60f70f18-4024-4388-ae64-3c2cca0cafbc,network=Network(02dfd673-dd23-4768-9c30-291cdbecbb64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f70f18-40') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 15:01:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60f70f18-40, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:01:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:01:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:11 user nova-compute[72239]: INFO os_vif [None req-c2a3f8cf-e697-4cc4-9f40-7cb74e6f1137 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a5:de:4b,bridge_name='br-int',has_traffic_filtering=True,id=60f70f18-4024-4388-ae64-3c2cca0cafbc,network=Network(02dfd673-dd23-4768-9c30-291cdbecbb64),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60f70f18-40')
Jul 31 15:01:11 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-c2a3f8cf-e697-4cc4-9f40-7cb74e6f1137 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Deleting instance files /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9_del
Jul 31 15:01:11 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-c2a3f8cf-e697-4cc4-9f40-7cb74e6f1137 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Deletion of /opt/stack/data/nova/instances/7d81b881-b44e-4fb3-8245-9dea634bdec9_del complete
Jul 31 15:01:11 user nova-compute[72239]: INFO nova.compute.manager [None req-c2a3f8cf-e697-4cc4-9f40-7cb74e6f1137 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Took 0.95 seconds to destroy the instance on the hypervisor.
Jul 31 15:01:11 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-c2a3f8cf-e697-4cc4-9f40-7cb74e6f1137 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 15:01:11 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 15:01:11 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 15:01:11 user nova-compute[72239]: DEBUG nova.compute.manager [req-de4bff3b-13e8-4a74-a0f9-0c89b81e259b req-e1ee2af9-cbbd-4bfa-b172-61a29fdcd2a1 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received event network-vif-unplugged-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:01:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-de4bff3b-13e8-4a74-a0f9-0c89b81e259b req-e1ee2af9-cbbd-4bfa-b172-61a29fdcd2a1 service nova] Acquiring lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:01:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-de4bff3b-13e8-4a74-a0f9-0c89b81e259b req-e1ee2af9-cbbd-4bfa-b172-61a29fdcd2a1 service nova] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:01:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-de4bff3b-13e8-4a74-a0f9-0c89b81e259b req-e1ee2af9-cbbd-4bfa-b172-61a29fdcd2a1 service nova] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:01:11 user nova-compute[72239]: DEBUG nova.compute.manager [req-de4bff3b-13e8-4a74-a0f9-0c89b81e259b req-e1ee2af9-cbbd-4bfa-b172-61a29fdcd2a1 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] No waiting events found dispatching network-vif-unplugged-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:01:11 user nova-compute[72239]: DEBUG nova.compute.manager [req-de4bff3b-13e8-4a74-a0f9-0c89b81e259b req-e1ee2af9-cbbd-4bfa-b172-61a29fdcd2a1 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received event network-vif-unplugged-60f70f18-4024-4388-ae64-3c2cca0cafbc for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 15:01:11 user nova-compute[72239]: DEBUG nova.compute.manager [req-de4bff3b-13e8-4a74-a0f9-0c89b81e259b req-e1ee2af9-cbbd-4bfa-b172-61a29fdcd2a1 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received event network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:01:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-de4bff3b-13e8-4a74-a0f9-0c89b81e259b req-e1ee2af9-cbbd-4bfa-b172-61a29fdcd2a1 service nova] Acquiring lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:01:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-de4bff3b-13e8-4a74-a0f9-0c89b81e259b req-e1ee2af9-cbbd-4bfa-b172-61a29fdcd2a1 service nova] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:01:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-de4bff3b-13e8-4a74-a0f9-0c89b81e259b req-e1ee2af9-cbbd-4bfa-b172-61a29fdcd2a1 service nova] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:01:11 user nova-compute[72239]: DEBUG nova.compute.manager [req-de4bff3b-13e8-4a74-a0f9-0c89b81e259b req-e1ee2af9-cbbd-4bfa-b172-61a29fdcd2a1 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] No waiting events found dispatching network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:01:11 user nova-compute[72239]: WARNING nova.compute.manager [req-de4bff3b-13e8-4a74-a0f9-0c89b81e259b req-e1ee2af9-cbbd-4bfa-b172-61a29fdcd2a1 service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received unexpected event network-vif-plugged-60f70f18-4024-4388-ae64-3c2cca0cafbc for instance with vm_state active and task_state deleting.
Jul 31 15:01:12 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:01:12 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Took 0.52 seconds to deallocate network for instance.
Jul 31 15:01:12 user nova-compute[72239]: DEBUG nova.network.neutron [None req-00b8aa2a-3f25-4f62-bb4c-b50aba46a225 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Updating instance_info_cache with network_info: [{"id": "7c709373-3d22-47b8-84d4-2a66ab39628a", "address": "fa:16:3e:9c:a0:63", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c709373-3d", "ovs_interfaceid": "7c709373-3d22-47b8-84d4-2a66ab39628a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:01:12 user nova-compute[72239]: DEBUG nova.compute.manager [req-2649ee48-bad8-4544-8c02-b8f00a3c2455 req-8b6a803f-297e-4287-a6f5-aabcf467afbf service nova] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Received event network-vif-deleted-60f70f18-4024-4388-ae64-3c2cca0cafbc {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:01:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-00b8aa2a-3f25-4f62-bb4c-b50aba46a225 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Releasing lock "refresh_cache-b8652db6-b595-497f-a55d-8c0520bc18aa" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:01:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c2a3f8cf-e697-4cc4-9f40-7cb74e6f1137 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:01:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c2a3f8cf-e697-4cc4-9f40-7cb74e6f1137 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:01:12 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-c2a3f8cf-e697-4cc4-9f40-7cb74e6f1137 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:01:12 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-c2a3f8cf-e697-4cc4-9f40-7cb74e6f1137 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:01:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c2a3f8cf-e697-4cc4-9f40-7cb74e6f1137 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:01:12 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-c2a3f8cf-e697-4cc4-9f40-7cb74e6f1137 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Deleted allocations for instance 7d81b881-b44e-4fb3-8245-9dea634bdec9
Jul 31 15:01:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c2a3f8cf-e697-4cc4-9f40-7cb74e6f1137 tempest-ServerRescueNegativeTestJSON-1296361049 tempest-ServerRescueNegativeTestJSON-1296361049-project-member] Lock "7d81b881-b44e-4fb3-8245-9dea634bdec9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.021s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:01:12 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Instance destroyed successfully.
Jul 31 15:01:12 user nova-compute[72239]: DEBUG nova.objects.instance [None req-00b8aa2a-3f25-4f62-bb4c-b50aba46a225 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lazy-loading 'resources' on Instance uuid b8652db6-b595-497f-a55d-8c0520bc18aa {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:01:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-00b8aa2a-3f25-4f62-bb4c-b50aba46a225 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:59:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1746021859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1746021859',id=32,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnHcaugoyVumipcH9iWbR1lH6GyUbvVWTu+gfxF3nDw9/alFMI2osrbpxmfLtRTIlFFqqtkJSfR4W10naiWe1TJWlwBT0OPz5w5h/X7U2hW973fUJVazvi3CvbACNSR5w==',key_name='tempest-keypair-1252123597',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:59:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='5a6715a7ff38401d844b620cb8d8769e',ramdisk_id='',reservation_id='r-twj02w4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-599528407',owner_user_name='tempest-AttachVolumeShelveTestJSON-599528407-project-member',shelved_at='2023-07-31T15:01:11.282619',shelved_host='user',shelved_image_id='b5e2ca71-1407-474a-89c7-c113c1c4a1a7'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T15:01:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70c6001a7ac5434fbc5ac7d003edd4eb',uuid=b8652db6-b595-497f-a55d-8c0520bc18aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "7c709373-3d22-47b8-84d4-2a66ab39628a", "address": "fa:16:3e:9c:a0:63", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c709373-3d", "ovs_interfaceid": "7c709373-3d22-47b8-84d4-2a66ab39628a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 15:01:12 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-00b8aa2a-3f25-4f62-bb4c-b50aba46a225 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Converting VIF {"id": "7c709373-3d22-47b8-84d4-2a66ab39628a", "address": "fa:16:3e:9c:a0:63", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c709373-3d", "ovs_interfaceid": "7c709373-3d22-47b8-84d4-2a66ab39628a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:01:12 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-00b8aa2a-3f25-4f62-bb4c-b50aba46a225 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:a0:63,bridge_name='br-int',has_traffic_filtering=True,id=7c709373-3d22-47b8-84d4-2a66ab39628a,network=Network(37a946a3-d20a-4694-8647-73e84d2b0cb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c709373-3d') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:01:12 user nova-compute[72239]: DEBUG os_vif [None req-00b8aa2a-3f25-4f62-bb4c-b50aba46a225 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:a0:63,bridge_name='br-int',has_traffic_filtering=True,id=7c709373-3d22-47b8-84d4-2a66ab39628a,network=Network(37a946a3-d20a-4694-8647-73e84d2b0cb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c709373-3d') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 15:01:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c709373-3d, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:01:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:01:12 user nova-compute[72239]: INFO os_vif [None req-00b8aa2a-3f25-4f62-bb4c-b50aba46a225 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:a0:63,bridge_name='br-int',has_traffic_filtering=True,id=7c709373-3d22-47b8-84d4-2a66ab39628a,network=Network(37a946a3-d20a-4694-8647-73e84d2b0cb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c709373-3d')
Jul 31 15:01:12 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-00b8aa2a-3f25-4f62-bb4c-b50aba46a225 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Deleting instance files /opt/stack/data/nova/instances/b8652db6-b595-497f-a55d-8c0520bc18aa_del
Jul 31 15:01:12 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-00b8aa2a-3f25-4f62-bb4c-b50aba46a225 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Deletion of /opt/stack/data/nova/instances/b8652db6-b595-497f-a55d-8c0520bc18aa_del complete
Jul 31 15:01:13 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-00b8aa2a-3f25-4f62-bb4c-b50aba46a225 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Deleted allocations for instance b8652db6-b595-497f-a55d-8c0520bc18aa
Jul 31 15:01:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-00b8aa2a-3f25-4f62-bb4c-b50aba46a225 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:01:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-00b8aa2a-3f25-4f62-bb4c-b50aba46a225 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:01:13 user nova-compute[72239]: DEBUG nova.objects.instance [None req-00b8aa2a-3f25-4f62-bb4c-b50aba46a225 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lazy-loading 'numa_topology' on Instance uuid b8652db6-b595-497f-a55d-8c0520bc18aa {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:01:13 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-00b8aa2a-3f25-4f62-bb4c-b50aba46a225 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:01:13 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-00b8aa2a-3f25-4f62-bb4c-b50aba46a225 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:01:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-00b8aa2a-3f25-4f62-bb4c-b50aba46a225 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.293s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:01:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-00b8aa2a-3f25-4f62-bb4c-b50aba46a225 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "b8652db6-b595-497f-a55d-8c0520bc18aa" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.541s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:01:14 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:01:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:01:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:01:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:01:14 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 15:01:14 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 15:01:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443f846e-09ed-47d3-813d-62fc8cea96c2/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443f846e-09ed-47d3-813d-62fc8cea96c2/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443f846e-09ed-47d3-813d-62fc8cea96c2/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443f846e-09ed-47d3-813d-62fc8cea96c2/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 15:01:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:16 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:01:16 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:01:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=7743MB free_disk=25.098922729492188GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 15:01:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:01:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:01:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Applying migration context for instance 3d70608b-fc54-4178-9aa6-98ca6198a37b as it has an incoming, in-progress migration b5e0640f-1435-4245-8d6a-90da81aa3b08. Migration status is finished {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Jul 31 15:01:16 user nova-compute[72239]: INFO nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Updating resource usage from migration b5e0640f-1435-4245-8d6a-90da81aa3b08
Jul 31 15:01:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 20abf743-de5b-4122-aad0-e2124c7804b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:01:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 2f11022e-a007-4d4c-adc1-b54ea59b9e6a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:01:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance c10918e9-9731-48ea-860e-8a02cb6a0ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:01:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance c2b3c85b-e939-41d0-8bf0-3a7f650177b2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:01:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 443f846e-09ed-47d3-813d-62fc8cea96c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:01:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:01:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Migration b5e0640f-1435-4245-8d6a-90da81aa3b08 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Jul 31 15:01:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 3d70608b-fc54-4178-9aa6-98ca6198a37b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:01:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 0a89aa93-374f-4487-893b-58c15d42c84c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:01:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 15:01:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 15:01:17 user nova-compute[72239]: DEBUG nova.compute.manager [req-7f393264-5333-4975-84b2-60f2fe219771 req-47e71c34-83ac-494c-b781-bc9d85f73dde service nova] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Received event network-changed-3d5bc442-d5a6-4dcb-aec4-8674a732bb8f {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:01:17 user nova-compute[72239]: DEBUG nova.compute.manager [req-7f393264-5333-4975-84b2-60f2fe219771 req-47e71c34-83ac-494c-b781-bc9d85f73dde service nova] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Refreshing instance network info cache due to event network-changed-3d5bc442-d5a6-4dcb-aec4-8674a732bb8f. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:01:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7f393264-5333-4975-84b2-60f2fe219771 req-47e71c34-83ac-494c-b781-bc9d85f73dde service nova] Acquiring lock "refresh_cache-443f846e-09ed-47d3-813d-62fc8cea96c2" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:01:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7f393264-5333-4975-84b2-60f2fe219771 req-47e71c34-83ac-494c-b781-bc9d85f73dde service nova] Acquired lock "refresh_cache-443f846e-09ed-47d3-813d-62fc8cea96c2" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:01:17 user nova-compute[72239]: DEBUG nova.network.neutron [req-7f393264-5333-4975-84b2-60f2fe219771 req-47e71c34-83ac-494c-b781-bc9d85f73dde service nova] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Refreshing network info cache for port 3d5bc442-d5a6-4dcb-aec4-8674a732bb8f {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:01:17 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690815662.1406, e6f6d85d-ffa0-4d72-b521-e855afa23a09 => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:01:17 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] VM Stopped (Lifecycle Event)
Jul 31 15:01:17 user nova-compute[72239]: DEBUG nova.compute.manager [None req-d338b6f4-5f7a-4acf-b8e9-59d83fbff745 None None] [instance: e6f6d85d-ffa0-4d72-b521-e855afa23a09] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:01:17 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:01:17 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:01:17 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 15:01:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.498s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:01:17 user nova-compute[72239]: DEBUG nova.network.neutron [req-7f393264-5333-4975-84b2-60f2fe219771 req-47e71c34-83ac-494c-b781-bc9d85f73dde service nova] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Updated VIF entry in instance network info cache for port 3d5bc442-d5a6-4dcb-aec4-8674a732bb8f. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:01:17 user nova-compute[72239]: DEBUG nova.network.neutron [req-7f393264-5333-4975-84b2-60f2fe219771 req-47e71c34-83ac-494c-b781-bc9d85f73dde service nova] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Updating instance_info_cache with network_info: [{"id": "3d5bc442-d5a6-4dcb-aec4-8674a732bb8f", "address": "fa:16:3e:65:8e:56", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5bc442-d5", "ovs_interfaceid": "3d5bc442-d5a6-4dcb-aec4-8674a732bb8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:01:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7f393264-5333-4975-84b2-60f2fe219771 req-47e71c34-83ac-494c-b781-bc9d85f73dde service nova] Releasing lock "refresh_cache-443f846e-09ed-47d3-813d-62fc8cea96c2" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:01:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:19 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:01:19 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 15:01:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "443f846e-09ed-47d3-813d-62fc8cea96c2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:01:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "443f846e-09ed-47d3-813d-62fc8cea96c2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:01:20 user nova-compute[72239]: DEBUG nova.objects.instance [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lazy-loading 'flavor' on Instance uuid 443f846e-09ed-47d3-813d-62fc8cea96c2 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:01:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "443f846e-09ed-47d3-813d-62fc8cea96c2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:01:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "443f846e-09ed-47d3-813d-62fc8cea96c2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:01:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "443f846e-09ed-47d3-813d-62fc8cea96c2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:01:21 user nova-compute[72239]: INFO nova.compute.manager [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Attaching volume 248bbf1d-22eb-40e3-ba7c-74ad7f40e581 to /dev/vdb
Jul 31 15:01:21 user nova-compute[72239]: DEBUG os_brick.utils [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:01:21 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:21 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:21 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[429f7460-a262-4738-9db6-c2cb4d2dea80]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:21 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:21 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:21 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[02286b69-8735-463a-99f8-1d6cab7a7b66]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:21 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:21 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:21 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d3caed-3088-41b5-b88c-1af99c375b93]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:21 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6a1f15-943f-4530-8eac-0f1bc0bb21d0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:21 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:21 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:01:21 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 15:01:21 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:21 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:01:21 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 15:01:21 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[261d7f83-52ff-4327-b630-2093dc4f4c7b]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:21 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 15:01:21 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 15:01:21 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 15:01:21 user nova-compute[72239]: DEBUG os_brick.utils [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:01:21 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Updating existing volume attachment record: 3ea08b1a-8f56-49de-acd8-ea3347a49fa8 {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 15:01:22 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690815667.710383, b8652db6-b595-497f-a55d-8c0520bc18aa => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:01:22 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] VM Stopped (Lifecycle Event)
Jul 31 15:01:22 user nova-compute[72239]: DEBUG nova.compute.manager [None req-2145d539-8cd1-4d2d-a5b3-7eb0ccad8dba None None] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:01:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:24 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:26 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690815671.5824888, 7d81b881-b44e-4fb3-8245-9dea634bdec9 => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:01:26 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] VM Stopped (Lifecycle Event)
Jul 31 15:01:26 user nova-compute[72239]: DEBUG nova.compute.manager [None req-2a5fe771-c88f-4448-bbac-2c231f73f58d None None] [instance: 7d81b881-b44e-4fb3-8245-9dea634bdec9] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:01:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qRsOQMJf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:01:28 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:01:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:01:28 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:01:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:01:28 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 15:01:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581 -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[834dd382-cf7c-4340-9dfa-4fcc7519c5d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 15:01:28 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581 -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cebc6b-86c9-43ff-8286-18bb797a82fb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581] added
Jul 31 15:01:28 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed76ecdd-df23-432f-88f6-a8e4cc64b845]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbc1462-fbfb-4bcd-a0f2-1d26942d2f46]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qRsOQMJf {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qRsOQMJf" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0358f324-e3ec-4bb3-b2fe-199df7bc3057]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qRsOQMJf'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[051ef678-273a-4069-b53d-0c1022734567]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[13013032-f9e2-4380-a41f-ff1dc6196054]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 15:01:28 user nova-compute[72239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 15:01:28 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 15:01:28 user nova-compute[72239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 15:01:28 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581 -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c1a828-45f2-48a1-b2e8-83eb76b13bec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581, portal: 172.16.0.220,3260]
Jul 31 15:01:28 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581, portal: 172.16.0.220,3260] successful.
Jul 31 15:01:28 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf07402c-886e-4fe9-a3f8-de08c660e5f8]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[07ceeb12-0ea7-4c28-8911-673e4b6f8cf0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 15:01:28 user nova-compute[72239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 15:01:28 user nova-compute[72239]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581 (non-flash)
Jul 31 15:01:28 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 15:01:28 user nova-compute[72239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 15:01:28 user nova-compute[72239]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581 (non-flash)
Jul 31 15:01:28 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f382567c-6ecc-4f07-9e96-c6efe95328a6]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:28 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: None {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 15:01:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:29 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 15:01:29 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qRsOQMJf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 15:01:29 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:01:29 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] <== connect_volume: return (1307ms) {'type': 'block', 'scsi_wwn': '26534613638656636', 'path': '/dev/sdb'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:01:29 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26534613638656636', 'path': '/dev/sdb'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 15:01:29 user nova-compute[72239]: DEBUG nova.objects.instance [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lazy-loading 'flavor' on Instance uuid 443f846e-09ed-47d3-813d-62fc8cea96c2 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:01:30 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 15:01:30 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:01:30 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 15:01:30 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 15:01:30 user nova-compute[72239]:   <serial>248bbf1d-22eb-40e3-ba7c-74ad7f40e581</serial>
Jul 31 15:01:30 user nova-compute[72239]: </disk>
Jul 31 15:01:30 user nova-compute[72239]:  {{(pid=72239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 15:01:30 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:01:30 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:01:30 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] No VIF found with MAC fa:16:3e:65:8e:56, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 15:01:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-baee09ed-5878-4128-b7a0-261dc716490d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "443f846e-09ed-47d3-813d-62fc8cea96c2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.472s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-19743d30-7e99-4e59-aa29-402352bf8e32 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "443f846e-09ed-47d3-813d-62fc8cea96c2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-19743d30-7e99-4e59-aa29-402352bf8e32 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "443f846e-09ed-47d3-813d-62fc8cea96c2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:01:31 user nova-compute[72239]: INFO nova.compute.manager [None req-19743d30-7e99-4e59-aa29-402352bf8e32 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Detaching volume 248bbf1d-22eb-40e3-ba7c-74ad7f40e581
Jul 31 15:01:31 user nova-compute[72239]: INFO nova.virt.block_device [None req-19743d30-7e99-4e59-aa29-402352bf8e32 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Attempting to driver detach volume 248bbf1d-22eb-40e3-ba7c-74ad7f40e581 from mountpoint /dev/vdb
Jul 31 15:01:31 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-19743d30-7e99-4e59-aa29-402352bf8e32 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Attempting to detach device vdb from instance 443f846e-09ed-47d3-813d-62fc8cea96c2 from the persistent domain config. {{(pid=72239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-19743d30-7e99-4e59-aa29-402352bf8e32 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 15:01:31 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:01:31 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 15:01:31 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 15:01:31 user nova-compute[72239]:   <serial>248bbf1d-22eb-40e3-ba7c-74ad7f40e581</serial>
Jul 31 15:01:31 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 15:01:31 user nova-compute[72239]: </disk>
Jul 31 15:01:31 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 15:01:31 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-19743d30-7e99-4e59-aa29-402352bf8e32 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Successfully detached device vdb from instance 443f846e-09ed-47d3-813d-62fc8cea96c2 from the persistent domain config.
Jul 31 15:01:31 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-19743d30-7e99-4e59-aa29-402352bf8e32 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 443f846e-09ed-47d3-813d-62fc8cea96c2 from the live domain config. {{(pid=72239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-19743d30-7e99-4e59-aa29-402352bf8e32 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 15:01:31 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:01:31 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 15:01:31 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 15:01:31 user nova-compute[72239]:   <serial>248bbf1d-22eb-40e3-ba7c-74ad7f40e581</serial>
Jul 31 15:01:31 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 15:01:31 user nova-compute[72239]: </disk>
Jul 31 15:01:31 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Received event <DeviceRemovedEvent: 1690815691.7644365, 443f846e-09ed-47d3-813d-62fc8cea96c2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72239) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-19743d30-7e99-4e59-aa29-402352bf8e32 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 443f846e-09ed-47d3-813d-62fc8cea96c2 {{(pid=72239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 15:01:31 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-19743d30-7e99-4e59-aa29-402352bf8e32 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Successfully detached device vdb from instance 443f846e-09ed-47d3-813d-62fc8cea96c2 from the live domain config.
Jul 31 15:01:31 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19743d30-7e99-4e59-aa29-402352bf8e32 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-19743d30-7e99-4e59-aa29-402352bf8e32 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qRsOQMJf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:01:31 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-19743d30-7e99-4e59-aa29-402352bf8e32 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:01:31 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-19743d30-7e99-4e59-aa29-402352bf8e32 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-19743d30-7e99-4e59-aa29-402352bf8e32 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-19743d30-7e99-4e59-aa29-402352bf8e32 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG nova.compute.manager [req-18f7fd67-1a53-4fb2-be46-0d9c0de3909a req-e6db06bd-70d1-4890-b9cc-f8a0c6ac04ac service nova] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Received event network-changed-badab919-e57c-44e5-a3af-9cebe02e9ed5 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG nova.compute.manager [req-18f7fd67-1a53-4fb2-be46-0d9c0de3909a req-e6db06bd-70d1-4890-b9cc-f8a0c6ac04ac service nova] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Refreshing instance network info cache due to event network-changed-badab919-e57c-44e5-a3af-9cebe02e9ed5. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-18f7fd67-1a53-4fb2-be46-0d9c0de3909a req-e6db06bd-70d1-4890-b9cc-f8a0c6ac04ac service nova] Acquiring lock "refresh_cache-aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-18f7fd67-1a53-4fb2-be46-0d9c0de3909a req-e6db06bd-70d1-4890-b9cc-f8a0c6ac04ac service nova] Acquired lock "refresh_cache-aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG nova.network.neutron [req-18f7fd67-1a53-4fb2-be46-0d9c0de3909a req-e6db06bd-70d1-4890-b9cc-f8a0c6ac04ac service nova] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Refreshing network info cache for port badab919-e57c-44e5-a3af-9cebe02e9ed5 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3372bc92-4a1b-46f3-8fcf-dd75de885f56]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c45afa-b8c8-4b89-beef-5db777aa2e24]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-19743d30-7e99-4e59-aa29-402352bf8e32 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 15:01:31 user nova-compute[72239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 15:01:31 user nova-compute[72239]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581 (non-flash)
Jul 31 15:01:31 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-19743d30-7e99-4e59-aa29-402352bf8e32 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 15:01:31 user nova-compute[72239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 15:01:31 user nova-compute[72239]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581 (non-flash)
Jul 31 15:01:31 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-19743d30-7e99-4e59-aa29-402352bf8e32 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f410076a290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581'): ({'sdb'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-19743d30-7e99-4e59-aa29-402352bf8e32 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Removing single pathed devices sdb {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[020f9c3a-3fa9-4757-b889-e344d415779b]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aecee7d-da01-4920-9204-52cf0d1906e1]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-19743d30-7e99-4e59-aa29-402352bf8e32 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Flushing IO for device /dev/sdb {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce423dfa-c437-4301-ad2f-b5c187c7c3a7]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-19743d30-7e99-4e59-aa29-402352bf8e32 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5783c3-eb4c-4314-a1a1-87db49b42cd0]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-19743d30-7e99-4e59-aa29-402352bf8e32 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-19743d30-7e99-4e59-aa29-402352bf8e32 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-19743d30-7e99-4e59-aa29-402352bf8e32 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[781d04f3-d6b3-4359-891c-4204503859f1]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-19743d30-7e99-4e59-aa29-402352bf8e32 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:01:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581 -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:32 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:32 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0810d66b-861d-4f51-9afa-c64a78b86083]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:32 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-19743d30-7e99-4e59-aa29-402352bf8e32 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581, portal: 172.16.0.220,3260]
Jul 31 15:01:32 user nova-compute[72239]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581, portal: 172.16.0.220,3260] successful.
Jul 31 15:01:32 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:01:32 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581 -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:32 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:248bbf1d-22eb-40e3-ba7c-74ad7f40e581 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:32 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0f6e96-51d5-486a-b828-9e32ac19a7bd]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:32 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-19743d30-7e99-4e59-aa29-402352bf8e32 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:01:32 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-19743d30-7e99-4e59-aa29-402352bf8e32 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:01:32 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-19743d30-7e99-4e59-aa29-402352bf8e32 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] <== disconnect_volume: return (269ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:01:32 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19743d30-7e99-4e59-aa29-402352bf8e32 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 15:01:32 user nova-compute[72239]: DEBUG nova.network.neutron [req-18f7fd67-1a53-4fb2-be46-0d9c0de3909a req-e6db06bd-70d1-4890-b9cc-f8a0c6ac04ac service nova] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Updated VIF entry in instance network info cache for port badab919-e57c-44e5-a3af-9cebe02e9ed5. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:01:32 user nova-compute[72239]: DEBUG nova.network.neutron [req-18f7fd67-1a53-4fb2-be46-0d9c0de3909a req-e6db06bd-70d1-4890-b9cc-f8a0c6ac04ac service nova] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Updating instance_info_cache with network_info: [{"id": "badab919-e57c-44e5-a3af-9cebe02e9ed5", "address": "fa:16:3e:bf:16:bd", "network": {"id": "50e01a2d-5e91-4aca-a74c-7687f91ed21e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-937098047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e5e2cd6854f0985aa161b1e8a6db7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbadab919-e5", "ovs_interfaceid": "badab919-e57c-44e5-a3af-9cebe02e9ed5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:01:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-18f7fd67-1a53-4fb2-be46-0d9c0de3909a req-e6db06bd-70d1-4890-b9cc-f8a0c6ac04ac service nova] Releasing lock "refresh_cache-aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:01:32 user nova-compute[72239]: DEBUG nova.objects.instance [None req-19743d30-7e99-4e59-aa29-402352bf8e32 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lazy-loading 'flavor' on Instance uuid 443f846e-09ed-47d3-813d-62fc8cea96c2 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:01:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-19743d30-7e99-4e59-aa29-402352bf8e32 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "443f846e-09ed-47d3-813d-62fc8cea96c2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.587s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:01:32 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:34 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-10e85422-d538-4964-95b2-431a74eb6ae1 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "3d70608b-fc54-4178-9aa6-98ca6198a37b" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:01:34 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-10e85422-d538-4964-95b2-431a74eb6ae1 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "3d70608b-fc54-4178-9aa6-98ca6198a37b" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:01:34 user nova-compute[72239]: DEBUG nova.compute.manager [None req-10e85422-d538-4964-95b2-431a74eb6ae1 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Going to confirm migration 2 {{(pid=72239) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Jul 31 15:01:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-10e85422-d538-4964-95b2-431a74eb6ae1 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "refresh_cache-3d70608b-fc54-4178-9aa6-98ca6198a37b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:01:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-10e85422-d538-4964-95b2-431a74eb6ae1 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquired lock "refresh_cache-3d70608b-fc54-4178-9aa6-98ca6198a37b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:01:35 user nova-compute[72239]: DEBUG nova.network.neutron [None req-10e85422-d538-4964-95b2-431a74eb6ae1 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 15:01:35 user nova-compute[72239]: DEBUG nova.objects.instance [None req-10e85422-d538-4964-95b2-431a74eb6ae1 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lazy-loading 'info_cache' on Instance uuid 3d70608b-fc54-4178-9aa6-98ca6198a37b {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:01:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:01:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:01:35 user nova-compute[72239]: DEBUG nova.network.neutron [None req-10e85422-d538-4964-95b2-431a74eb6ae1 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Updating instance_info_cache with network_info: [{"id": "d115f55c-2a02-4b41-88b0-0922039e58ba", "address": "fa:16:3e:15:91:63", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115f55c-2a", "ovs_interfaceid": "d115f55c-2a02-4b41-88b0-0922039e58ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:01:35 user nova-compute[72239]: DEBUG nova.objects.instance [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lazy-loading 'flavor' on Instance uuid aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:01:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-10e85422-d538-4964-95b2-431a74eb6ae1 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Releasing lock "refresh_cache-3d70608b-fc54-4178-9aa6-98ca6198a37b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:01:35 user nova-compute[72239]: DEBUG nova.objects.instance [None req-10e85422-d538-4964-95b2-431a74eb6ae1 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lazy-loading 'migration_context' on Instance uuid 3d70608b-fc54-4178-9aa6-98ca6198a37b {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:01:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-10e85422-d538-4964-95b2-431a74eb6ae1 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:01:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-10e85422-d538-4964-95b2-431a74eb6ae1 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:01:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:01:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:01:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:01:35 user nova-compute[72239]: INFO nova.compute.manager [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Attaching volume 9f325296-c7f8-4952-bf62-5e42726543bb to /dev/vdb
Jul 31 15:01:35 user nova-compute[72239]: DEBUG os_brick.utils [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:01:35 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:35 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:35 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d211b78-b5a3-4a9a-a608-155962b3501b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:35 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:35 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:35 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[307c09a2-716d-496e-9057-b44adc78d581]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:35 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:35 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-10e85422-d538-4964-95b2-431a74eb6ae1 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:01:35 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:35 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[67aa210f-ec7e-45c9-a28e-81b52dd62bcd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:35 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[faeb97f9-bdc9-4fba-af3b-c33c1a9369a4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:35 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:35 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:01:35 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 15:01:35 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-10e85422-d538-4964-95b2-431a74eb6ae1 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:01:35 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:35 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:01:35 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 15:01:35 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28d6482-6c4a-4365-b1f6-31e1a3efac66]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:35 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 15:01:35 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 15:01:35 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 15:01:35 user nova-compute[72239]: DEBUG os_brick.utils [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:01:35 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Updating existing volume attachment record: 8985d334-d6f4-45ef-bb98-e7afd28ce785 {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 15:01:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-10e85422-d538-4964-95b2-431a74eb6ae1 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.386s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:01:36 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-10e85422-d538-4964-95b2-431a74eb6ae1 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Deleted allocation for migration b5e0640f-1435-4245-8d6a-90da81aa3b08
Jul 31 15:01:36 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-10e85422-d538-4964-95b2-431a74eb6ae1 tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "3d70608b-fc54-4178-9aa6-98ca6198a37b" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.387s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:01:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vTqVQoIs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:01:43 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:01:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:01:43 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:01:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:01:43 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 15:01:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf724a69-0a43-43b7-8a66-d6149d90169f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 15:01:43 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d22f40-9d3f-47f4-a966-dbf96217d02b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb] added
Jul 31 15:01:43 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[23693c18-e538-4769-90d7-718f0d25b8c8]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ac5523-6941-47c7-ade6-e6ef1f2abb56]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vTqVQoIs {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vTqVQoIs" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8ece43-45f7-4ff7-a957-4acdf4fd2876]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vTqVQoIs'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a832a8c8-1088-42d5-9167-870a43392044]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df1bd80-7842-4721-bcb6-3b946038e7c3]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 15:01:43 user nova-compute[72239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 15:01:43 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 15:01:43 user nova-compute[72239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 15:01:43 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada934a7-9e7d-479d-a0a7-beaf78256048]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb, portal: 172.16.0.220,3260]
Jul 31 15:01:43 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb, portal: 172.16.0.220,3260] successful.
Jul 31 15:01:43 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[504f64b7-79dd-490c-a79e-e3499a9e5608]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d846e7-2928-451e-a8e9-208c48c2db47]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 15:01:43 user nova-compute[72239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 15:01:43 user nova-compute[72239]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb (non-flash)
Jul 31 15:01:43 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 15:01:43 user nova-compute[72239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 15:01:43 user nova-compute[72239]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb (non-flash)
Jul 31 15:01:43 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1e7686-b0f9-43c9-b39f-84ddef1c437d]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 15:01:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vTqVQoIs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 15:01:44 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:01:44 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23235653530613465', 'path': '/dev/sdb'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:01:44 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23235653530613465', 'path': '/dev/sdb'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 15:01:44 user nova-compute[72239]: DEBUG nova.objects.instance [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lazy-loading 'flavor' on Instance uuid aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:01:44 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 15:01:44 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:01:44 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 15:01:44 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 15:01:44 user nova-compute[72239]:   <serial>9f325296-c7f8-4952-bf62-5e42726543bb</serial>
Jul 31 15:01:44 user nova-compute[72239]: </disk>
Jul 31 15:01:44 user nova-compute[72239]:  {{(pid=72239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 15:01:45 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:01:45 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:01:45 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] No VIF found with MAC fa:16:3e:bf:16:bd, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 15:01:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c3273632-401a-45f3-9502-2767dcf946a1 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.593s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:01:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:01:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:01:49 user nova-compute[72239]: DEBUG nova.objects.instance [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lazy-loading 'flavor' on Instance uuid aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:01:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:01:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:01:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:01:49 user nova-compute[72239]: INFO nova.compute.manager [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Attaching volume 916be438-9e70-4a09-8a5d-b5d1d672f659 to /dev/vdc
Jul 31 15:01:49 user nova-compute[72239]: DEBUG os_brick.utils [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:01:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:49 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d921239-1aa7-4c90-ab93-41a62a46edbe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:49 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f96d2d-cfea-440c-bc90-6787c2e7a197]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:49 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[270f7575-6537-4c9e-aaba-82cee4bf63c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:49 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6046848-ca43-420b-8d79-995ea2b25c86]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:01:49 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 15:01:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:01:50 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 15:01:50 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d86af21-b68c-42d1-a871-88a8b13b0271]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 15:01:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 15:01:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 15:01:50 user nova-compute[72239]: DEBUG os_brick.utils [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:01:50 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Updating existing volume attachment record: 7f5b0c07-1356-47c0-82d2-53cff27e9d57 {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 15:01:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a7ebaf95-f2b0-4dad-9288-6b2d70197aaa tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "c2b3c85b-e939-41d0-8bf0-3a7f650177b2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:01:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a7ebaf95-f2b0-4dad-9288-6b2d70197aaa tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "c2b3c85b-e939-41d0-8bf0-3a7f650177b2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:01:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a7ebaf95-f2b0-4dad-9288-6b2d70197aaa tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "c2b3c85b-e939-41d0-8bf0-3a7f650177b2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:01:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a7ebaf95-f2b0-4dad-9288-6b2d70197aaa tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "c2b3c85b-e939-41d0-8bf0-3a7f650177b2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:01:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a7ebaf95-f2b0-4dad-9288-6b2d70197aaa tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "c2b3c85b-e939-41d0-8bf0-3a7f650177b2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:01:52 user nova-compute[72239]: INFO nova.compute.manager [None req-a7ebaf95-f2b0-4dad-9288-6b2d70197aaa tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Terminating instance
Jul 31 15:01:52 user nova-compute[72239]: DEBUG nova.compute.manager [None req-a7ebaf95-f2b0-4dad-9288-6b2d70197aaa tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 15:01:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:52 user nova-compute[72239]: DEBUG nova.compute.manager [req-5aa2a710-f16d-4d15-9347-580d07e3d96f req-07a07ead-3a0e-489d-bddb-80840ecfbe47 service nova] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Received event network-vif-unplugged-59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:01:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5aa2a710-f16d-4d15-9347-580d07e3d96f req-07a07ead-3a0e-489d-bddb-80840ecfbe47 service nova] Acquiring lock "c2b3c85b-e939-41d0-8bf0-3a7f650177b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:01:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5aa2a710-f16d-4d15-9347-580d07e3d96f req-07a07ead-3a0e-489d-bddb-80840ecfbe47 service nova] Lock "c2b3c85b-e939-41d0-8bf0-3a7f650177b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:01:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5aa2a710-f16d-4d15-9347-580d07e3d96f req-07a07ead-3a0e-489d-bddb-80840ecfbe47 service nova] Lock "c2b3c85b-e939-41d0-8bf0-3a7f650177b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:01:52 user nova-compute[72239]: DEBUG nova.compute.manager [req-5aa2a710-f16d-4d15-9347-580d07e3d96f req-07a07ead-3a0e-489d-bddb-80840ecfbe47 service nova] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] No waiting events found dispatching network-vif-unplugged-59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:01:52 user nova-compute[72239]: DEBUG nova.compute.manager [req-5aa2a710-f16d-4d15-9347-580d07e3d96f req-07a07ead-3a0e-489d-bddb-80840ecfbe47 service nova] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Received event network-vif-unplugged-59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00 for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 15:01:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:52 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Instance destroyed successfully.
Jul 31 15:01:52 user nova-compute[72239]: DEBUG nova.objects.instance [None req-a7ebaf95-f2b0-4dad-9288-6b2d70197aaa tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lazy-loading 'resources' on Instance uuid c2b3c85b-e939-41d0-8bf0-3a7f650177b2 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:01:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:52 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-a7ebaf95-f2b0-4dad-9288-6b2d70197aaa tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:52:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2037494155',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2037494155',id=21,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:52:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d8281237f9c417a9685e55826911e1b',ramdisk_id='',reservation_id='r-o0d96zhs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-148379254',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:54:26Z,user_data=None,user_id='94ab9298205143d489f678b28be5b085',uuid=c2b3c85b-e939-41d0-8bf0-3a7f650177b2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00", "address": "fa:16:3e:d6:c0:2b", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59b0c9f3-1d", "ovs_interfaceid": "59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 15:01:52 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a7ebaf95-f2b0-4dad-9288-6b2d70197aaa tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Converting VIF {"id": "59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00", "address": "fa:16:3e:d6:c0:2b", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap59b0c9f3-1d", "ovs_interfaceid": "59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:01:52 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a7ebaf95-f2b0-4dad-9288-6b2d70197aaa tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:c0:2b,bridge_name='br-int',has_traffic_filtering=True,id=59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00,network=Network(172fb80f-4bbe-4706-91cf-60540fbceb2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59b0c9f3-1d') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:01:52 user nova-compute[72239]: DEBUG os_vif [None req-a7ebaf95-f2b0-4dad-9288-6b2d70197aaa tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:c0:2b,bridge_name='br-int',has_traffic_filtering=True,id=59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00,network=Network(172fb80f-4bbe-4706-91cf-60540fbceb2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59b0c9f3-1d') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 15:01:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap59b0c9f3-1d, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:01:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:01:52 user nova-compute[72239]: INFO os_vif [None req-a7ebaf95-f2b0-4dad-9288-6b2d70197aaa tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:c0:2b,bridge_name='br-int',has_traffic_filtering=True,id=59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00,network=Network(172fb80f-4bbe-4706-91cf-60540fbceb2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap59b0c9f3-1d')
Jul 31 15:01:52 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-a7ebaf95-f2b0-4dad-9288-6b2d70197aaa tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Deleting instance files /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2_del
Jul 31 15:01:52 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-a7ebaf95-f2b0-4dad-9288-6b2d70197aaa tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Deletion of /opt/stack/data/nova/instances/c2b3c85b-e939-41d0-8bf0-3a7f650177b2_del complete
Jul 31 15:01:53 user nova-compute[72239]: INFO nova.compute.manager [None req-a7ebaf95-f2b0-4dad-9288-6b2d70197aaa tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Took 0.70 seconds to destroy the instance on the hypervisor.
Jul 31 15:01:53 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-a7ebaf95-f2b0-4dad-9288-6b2d70197aaa tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 15:01:53 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 15:01:53 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 15:01:53 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:01:53 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Took 0.55 seconds to deallocate network for instance.
Jul 31 15:01:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a7ebaf95-f2b0-4dad-9288-6b2d70197aaa tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:01:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a7ebaf95-f2b0-4dad-9288-6b2d70197aaa tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:01:53 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-a7ebaf95-f2b0-4dad-9288-6b2d70197aaa tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:01:53 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-a7ebaf95-f2b0-4dad-9288-6b2d70197aaa tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:01:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a7ebaf95-f2b0-4dad-9288-6b2d70197aaa tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.316s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:01:54 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-a7ebaf95-f2b0-4dad-9288-6b2d70197aaa tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Deleted allocations for instance c2b3c85b-e939-41d0-8bf0-3a7f650177b2
Jul 31 15:01:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a7ebaf95-f2b0-4dad-9288-6b2d70197aaa tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "c2b3c85b-e939-41d0-8bf0-3a7f650177b2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.794s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:01:54 user nova-compute[72239]: DEBUG nova.compute.manager [req-509c7be4-0ef5-4d21-b559-0eeeb47d83a9 req-0bca5a87-cdad-4e38-8188-af9cdaea10d5 service nova] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Received event network-vif-plugged-59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:01:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-509c7be4-0ef5-4d21-b559-0eeeb47d83a9 req-0bca5a87-cdad-4e38-8188-af9cdaea10d5 service nova] Acquiring lock "c2b3c85b-e939-41d0-8bf0-3a7f650177b2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:01:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-509c7be4-0ef5-4d21-b559-0eeeb47d83a9 req-0bca5a87-cdad-4e38-8188-af9cdaea10d5 service nova] Lock "c2b3c85b-e939-41d0-8bf0-3a7f650177b2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:01:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-509c7be4-0ef5-4d21-b559-0eeeb47d83a9 req-0bca5a87-cdad-4e38-8188-af9cdaea10d5 service nova] Lock "c2b3c85b-e939-41d0-8bf0-3a7f650177b2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:01:54 user nova-compute[72239]: DEBUG nova.compute.manager [req-509c7be4-0ef5-4d21-b559-0eeeb47d83a9 req-0bca5a87-cdad-4e38-8188-af9cdaea10d5 service nova] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] No waiting events found dispatching network-vif-plugged-59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:01:54 user nova-compute[72239]: WARNING nova.compute.manager [req-509c7be4-0ef5-4d21-b559-0eeeb47d83a9 req-0bca5a87-cdad-4e38-8188-af9cdaea10d5 service nova] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Received unexpected event network-vif-plugged-59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00 for instance with vm_state deleted and task_state None.
Jul 31 15:01:54 user nova-compute[72239]: DEBUG nova.compute.manager [req-509c7be4-0ef5-4d21-b559-0eeeb47d83a9 req-0bca5a87-cdad-4e38-8188-af9cdaea10d5 service nova] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Received event network-vif-deleted-59b0c9f3-1d46-4ec7-be03-ecd4c1b38f00 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:01:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 15:01:57 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'usmOihcF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:01:57 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:01:57 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:01:57 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:01:57 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:01:57 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:01:57 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:01:57 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 15:01:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659 -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:57 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec82b5d-7649-4f10-9cbf-426c7c532223]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:57 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 15:01:57 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:01:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659 -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:57 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c83bd9-9e01-409a-aa30-e3f30dae3323]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:57 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659] added
Jul 31 15:01:57 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:01:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:57 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[00febcb0-bc21-461d-aa2b-70581b1a1200]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:57 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:01:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:57 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad88b29a-7051-4b00-b304-45a2f1152da4]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:57 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:01:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v usmOihcF {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v usmOihcF" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:57 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[397c43d9-bfe2-49ff-92b2-6b34f3c9173d]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:57 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'usmOihcF'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:01:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:57 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d38dd18-f818-43f0-bb0d-d4729660ab25]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:57 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:01:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:57 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb973ddd-107e-4b3e-bcf5-b29e1eac17f5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:57 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 15:01:57 user nova-compute[72239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 15:01:57 user nova-compute[72239]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb (non-flash)
Jul 31 15:01:57 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:01:57 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 15:01:57 user nova-compute[72239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 15:01:57 user nova-compute[72239]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb (non-flash)
Jul 31 15:01:57 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:01:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659 -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:01:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:58 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf80fee-0d16-4c58-b615-388a97c99846]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:58 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659, portal: 172.16.0.220,3260]
Jul 31 15:01:58 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659, portal: 172.16.0.220,3260] successful.
Jul 31 15:01:58 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:01:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:58 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f62679b-16a1-4a2f-bc61-46dc1bd86770]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:58 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:01:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:58 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a978c9d0-0508-4911-8745-6c560aec4d24]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:58 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 15:01:58 user nova-compute[72239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 15:01:58 user nova-compute[72239]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb (non-flash)
Jul 31 15:01:58 user nova-compute[72239]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659 (non-flash)
Jul 31 15:01:58 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:01:58 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 15:01:58 user nova-compute[72239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 15:01:58 user nova-compute[72239]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb (non-flash)
Jul 31 15:01:58 user nova-compute[72239]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659 (non-flash)
Jul 31 15:01:58 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:01:58 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:01:58 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 15:01:58 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] HCTL ('35', '-', '-', 0) found on session 42 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 15:01:58 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 15:01:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:01:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:01:58 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aeda5aa-6182-4364-ae4d-e52aeac03e19]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:01:58 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Searching for a device in session 42 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 15:01:58 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'usmOihcF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 15:01:59 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:01:59 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '26539633432353037', 'path': '/dev/sdd'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:01:59 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539633432353037', 'path': '/dev/sdd'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 15:01:59 user nova-compute[72239]: DEBUG nova.objects.instance [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lazy-loading 'flavor' on Instance uuid aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:01:59 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 15:01:59 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:01:59 user nova-compute[72239]:   <source dev="/dev/sdd"/>
Jul 31 15:01:59 user nova-compute[72239]:   <target dev="vdc" bus="virtio"/>
Jul 31 15:01:59 user nova-compute[72239]:   <serial>916be438-9e70-4a09-8a5d-b5d1d672f659</serial>
Jul 31 15:01:59 user nova-compute[72239]: </disk>
Jul 31 15:01:59 user nova-compute[72239]:  {{(pid=72239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 15:01:59 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:01:59 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:01:59 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:01:59 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] No VIF found with MAC fa:16:3e:bf:16:bd, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 15:01:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-531d7e5f-c4fe-42a2-9321-b2e546fa78ad tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.919s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-450ea95f-34f8-4c81-850c-0a6df2e6503b tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-450ea95f-34f8-4c81-850c-0a6df2e6503b tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:02:01 user nova-compute[72239]: INFO nova.compute.manager [None req-450ea95f-34f8-4c81-850c-0a6df2e6503b tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Detaching volume 9f325296-c7f8-4952-bf62-5e42726543bb
Jul 31 15:02:01 user nova-compute[72239]: INFO nova.virt.block_device [None req-450ea95f-34f8-4c81-850c-0a6df2e6503b tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Attempting to driver detach volume 9f325296-c7f8-4952-bf62-5e42726543bb from mountpoint /dev/vdb
Jul 31 15:02:01 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-450ea95f-34f8-4c81-850c-0a6df2e6503b tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Attempting to detach device vdb from instance aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73 from the persistent domain config. {{(pid=72239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-450ea95f-34f8-4c81-850c-0a6df2e6503b tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 15:02:01 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:02:01 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 15:02:01 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 15:02:01 user nova-compute[72239]:   <serial>9f325296-c7f8-4952-bf62-5e42726543bb</serial>
Jul 31 15:02:01 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 15:02:01 user nova-compute[72239]: </disk>
Jul 31 15:02:01 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 15:02:01 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-450ea95f-34f8-4c81-850c-0a6df2e6503b tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Successfully detached device vdb from instance aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73 from the persistent domain config.
Jul 31 15:02:01 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-450ea95f-34f8-4c81-850c-0a6df2e6503b tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73 from the live domain config. {{(pid=72239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-450ea95f-34f8-4c81-850c-0a6df2e6503b tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 15:02:01 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:02:01 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 15:02:01 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 15:02:01 user nova-compute[72239]:   <serial>9f325296-c7f8-4952-bf62-5e42726543bb</serial>
Jul 31 15:02:01 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 15:02:01 user nova-compute[72239]: </disk>
Jul 31 15:02:01 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Received event <DeviceRemovedEvent: 1690815721.5310442, aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72239) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-450ea95f-34f8-4c81-850c-0a6df2e6503b tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73 {{(pid=72239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 15:02:01 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-450ea95f-34f8-4c81-850c-0a6df2e6503b tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Successfully detached device vdb from instance aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73 from the live domain config.
Jul 31 15:02:01 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-450ea95f-34f8-4c81-850c-0a6df2e6503b tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-450ea95f-34f8-4c81-850c-0a6df2e6503b tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vTqVQoIs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:02:01 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-450ea95f-34f8-4c81-850c-0a6df2e6503b tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:02:01 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-450ea95f-34f8-4c81-850c-0a6df2e6503b tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-450ea95f-34f8-4c81-850c-0a6df2e6503b tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-450ea95f-34f8-4c81-850c-0a6df2e6503b tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3884c43-45b1-44bd-a777-5002bf7ab3ad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[66755c8d-eaa4-4fe3-8a17-db5126701e82]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-450ea95f-34f8-4c81-850c-0a6df2e6503b tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 15:02:01 user nova-compute[72239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 15:02:01 user nova-compute[72239]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb (non-flash)
Jul 31 15:02:01 user nova-compute[72239]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659 (non-flash)
Jul 31 15:02:01 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-450ea95f-34f8-4c81-850c-0a6df2e6503b tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 15:02:01 user nova-compute[72239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 15:02:01 user nova-compute[72239]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb (non-flash)
Jul 31 15:02:01 user nova-compute[72239]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659 (non-flash)
Jul 31 15:02:01 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-450ea95f-34f8-4c81-850c-0a6df2e6503b tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41241c8040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb'): ({'sdb'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-450ea95f-34f8-4c81-850c-0a6df2e6503b tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Removing single pathed devices sdb {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e53d015-cb5a-463c-baba-dd1952663259]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93caf9f-11bd-4fe5-84b9-700650ecc052]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-450ea95f-34f8-4c81-850c-0a6df2e6503b tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Flushing IO for device /dev/sdb {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b53451c-5f87-4972-848c-d147f167e182]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-450ea95f-34f8-4c81-850c-0a6df2e6503b tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7867e76d-8060-46d0-9a6c-2fa79782b200]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-450ea95f-34f8-4c81-850c-0a6df2e6503b tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-450ea95f-34f8-4c81-850c-0a6df2e6503b tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-450ea95f-34f8-4c81-850c-0a6df2e6503b tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf22e695-de98-4c25-bddf-a45b3172832f]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-450ea95f-34f8-4c81-850c-0a6df2e6503b tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[208295f9-2544-4653-9ebf-1df03eee8c67]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-450ea95f-34f8-4c81-850c-0a6df2e6503b tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb, portal: 172.16.0.220,3260]
Jul 31 15:02:01 user nova-compute[72239]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb, portal: 172.16.0.220,3260] successful.
Jul 31 15:02:01 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f325296-c7f8-4952-bf62-5e42726543bb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49ce007-a4bb-4434-84be-9afe69f93ce6]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-450ea95f-34f8-4c81-850c-0a6df2e6503b tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-450ea95f-34f8-4c81-850c-0a6df2e6503b tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-450ea95f-34f8-4c81-850c-0a6df2e6503b tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] <== disconnect_volume: return (278ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:02:01 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-450ea95f-34f8-4c81-850c-0a6df2e6503b tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 15:02:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:02:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:04 user nova-compute[72239]: DEBUG nova.objects.instance [None req-450ea95f-34f8-4c81-850c-0a6df2e6503b tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lazy-loading 'flavor' on Instance uuid aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:02:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-450ea95f-34f8-4c81-850c-0a6df2e6503b tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.553s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:02:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-56e1fe09-5d1c-4205-8fe2-6b896589eebe tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:02:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-56e1fe09-5d1c-4205-8fe2-6b896589eebe tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:02:05 user nova-compute[72239]: INFO nova.compute.manager [None req-56e1fe09-5d1c-4205-8fe2-6b896589eebe tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Detaching volume 916be438-9e70-4a09-8a5d-b5d1d672f659
Jul 31 15:02:05 user nova-compute[72239]: INFO nova.virt.block_device [None req-56e1fe09-5d1c-4205-8fe2-6b896589eebe tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Attempting to driver detach volume 916be438-9e70-4a09-8a5d-b5d1d672f659 from mountpoint /dev/vdc
Jul 31 15:02:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-56e1fe09-5d1c-4205-8fe2-6b896589eebe tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Attempting to detach device vdc from instance aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73 from the persistent domain config. {{(pid=72239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 15:02:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-56e1fe09-5d1c-4205-8fe2-6b896589eebe tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 15:02:05 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:02:05 user nova-compute[72239]:   <source dev="/dev/sdd"/>
Jul 31 15:02:05 user nova-compute[72239]:   <target dev="vdc" bus="virtio"/>
Jul 31 15:02:05 user nova-compute[72239]:   <serial>916be438-9e70-4a09-8a5d-b5d1d672f659</serial>
Jul 31 15:02:05 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 31 15:02:05 user nova-compute[72239]: </disk>
Jul 31 15:02:05 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 15:02:05 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-56e1fe09-5d1c-4205-8fe2-6b896589eebe tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Successfully detached device vdc from instance aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73 from the persistent domain config.
Jul 31 15:02:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-56e1fe09-5d1c-4205-8fe2-6b896589eebe tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73 from the live domain config. {{(pid=72239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 15:02:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-56e1fe09-5d1c-4205-8fe2-6b896589eebe tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 15:02:05 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:02:05 user nova-compute[72239]:   <source dev="/dev/sdd"/>
Jul 31 15:02:05 user nova-compute[72239]:   <target dev="vdc" bus="virtio"/>
Jul 31 15:02:05 user nova-compute[72239]:   <serial>916be438-9e70-4a09-8a5d-b5d1d672f659</serial>
Jul 31 15:02:05 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 31 15:02:05 user nova-compute[72239]: </disk>
Jul 31 15:02:05 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Received event <DeviceRemovedEvent: 1690815726.0727072, aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72239) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-56e1fe09-5d1c-4205-8fe2-6b896589eebe tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73 {{(pid=72239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 15:02:06 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-56e1fe09-5d1c-4205-8fe2-6b896589eebe tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Successfully detached device vdc from instance aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73 from the live domain config.
Jul 31 15:02:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56e1fe09-5d1c-4205-8fe2-6b896589eebe tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e1fe09-5d1c-4205-8fe2-6b896589eebe tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'usmOihcF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:02:06 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-56e1fe09-5d1c-4205-8fe2-6b896589eebe tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:02:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-56e1fe09-5d1c-4205-8fe2-6b896589eebe tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-56e1fe09-5d1c-4205-8fe2-6b896589eebe tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e1fe09-5d1c-4205-8fe2-6b896589eebe tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e102b0e-11d9-4d6b-a2c8-2dd5346c07c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a5cea0-bb2a-48cc-92f9-0e7269dd56ad]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e1fe09-5d1c-4205-8fe2-6b896589eebe tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 15:02:06 user nova-compute[72239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 15:02:06 user nova-compute[72239]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659 (non-flash)
Jul 31 15:02:06 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e1fe09-5d1c-4205-8fe2-6b896589eebe tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 15:02:06 user nova-compute[72239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 15:02:06 user nova-compute[72239]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659 (non-flash)
Jul 31 15:02:06 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e1fe09-5d1c-4205-8fe2-6b896589eebe tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41202469e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659'): ({'sdd'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-56e1fe09-5d1c-4205-8fe2-6b896589eebe tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Removing single pathed devices sdd {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[374efbb4-c17a-421b-9c61-4cb5d2c6975a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[283d7f5e-5321-4dfa-a488-22d5ede82e46]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-56e1fe09-5d1c-4205-8fe2-6b896589eebe tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Flushing IO for device /dev/sdd {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a5892e-83e2-49c3-81f3-464d39bbaf15]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-56e1fe09-5d1c-4205-8fe2-6b896589eebe tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[984fd0d3-e406-40c0-b219-aea1a5048a6a]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-56e1fe09-5d1c-4205-8fe2-6b896589eebe tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-56e1fe09-5d1c-4205-8fe2-6b896589eebe tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] SCSI volumes sdd have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e1fe09-5d1c-4205-8fe2-6b896589eebe tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acbd454-bea8-419d-bf59-6c8b7fd8c43e]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e1fe09-5d1c-4205-8fe2-6b896589eebe tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659 -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7c476b-d03a-40ae-9d44-744353eefc74]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e1fe09-5d1c-4205-8fe2-6b896589eebe tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659, portal: 172.16.0.220,3260]
Jul 31 15:02:06 user nova-compute[72239]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659, portal: 172.16.0.220,3260] successful.
Jul 31 15:02:06 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659 -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:916be438-9e70-4a09-8a5d-b5d1d672f659 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b8d694-399e-4c76-a01c-0e83275f0cf2]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e1fe09-5d1c-4205-8fe2-6b896589eebe tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-56e1fe09-5d1c-4205-8fe2-6b896589eebe tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-56e1fe09-5d1c-4205-8fe2-6b896589eebe tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] <== disconnect_volume: return (301ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:02:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56e1fe09-5d1c-4205-8fe2-6b896589eebe tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 15:02:07 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690815712.942203, c2b3c85b-e939-41d0-8bf0-3a7f650177b2 => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:02:07 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] VM Stopped (Lifecycle Event)
Jul 31 15:02:07 user nova-compute[72239]: DEBUG nova.compute.manager [None req-01226bb2-9397-4082-9e79-eda192591a40 None None] [instance: c2b3c85b-e939-41d0-8bf0-3a7f650177b2] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:02:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:08 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:02:08 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:02:09 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:02:09 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 15:02:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-c10918e9-9731-48ea-860e-8a02cb6a0ad9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:02:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-c10918e9-9731-48ea-860e-8a02cb6a0ad9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:02:09 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 15:02:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:10 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Updating instance_info_cache with network_info: [{"id": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "address": "fa:16:3e:56:1c:d6", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8307e7-0d", "ovs_interfaceid": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:02:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-c10918e9-9731-48ea-860e-8a02cb6a0ad9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:02:10 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 15:02:10 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:02:10 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:02:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:10 user nova-compute[72239]: DEBUG nova.objects.instance [None req-56e1fe09-5d1c-4205-8fe2-6b896589eebe tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lazy-loading 'flavor' on Instance uuid aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:02:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-56e1fe09-5d1c-4205-8fe2-6b896589eebe tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.807s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:02:11 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:02:11 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:02:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-15a54be1-8ec5-4f93-a5e6-a7248279cbf2 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:02:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-15a54be1-8ec5-4f93-a5e6-a7248279cbf2 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:02:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-15a54be1-8ec5-4f93-a5e6-a7248279cbf2 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:02:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-15a54be1-8ec5-4f93-a5e6-a7248279cbf2 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:02:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-15a54be1-8ec5-4f93-a5e6-a7248279cbf2 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:02:11 user nova-compute[72239]: INFO nova.compute.manager [None req-15a54be1-8ec5-4f93-a5e6-a7248279cbf2 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Terminating instance
Jul 31 15:02:11 user nova-compute[72239]: DEBUG nova.compute.manager [None req-15a54be1-8ec5-4f93-a5e6-a7248279cbf2 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 15:02:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:12 user nova-compute[72239]: DEBUG nova.compute.manager [req-03526964-ef26-4d12-b288-c5618dd986f7 req-57595bba-02bb-459a-bb32-eba9f48ea19b service nova] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Received event network-vif-unplugged-badab919-e57c-44e5-a3af-9cebe02e9ed5 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:02:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-03526964-ef26-4d12-b288-c5618dd986f7 req-57595bba-02bb-459a-bb32-eba9f48ea19b service nova] Acquiring lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:02:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-03526964-ef26-4d12-b288-c5618dd986f7 req-57595bba-02bb-459a-bb32-eba9f48ea19b service nova] Lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:02:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-03526964-ef26-4d12-b288-c5618dd986f7 req-57595bba-02bb-459a-bb32-eba9f48ea19b service nova] Lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:02:12 user nova-compute[72239]: DEBUG nova.compute.manager [req-03526964-ef26-4d12-b288-c5618dd986f7 req-57595bba-02bb-459a-bb32-eba9f48ea19b service nova] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] No waiting events found dispatching network-vif-unplugged-badab919-e57c-44e5-a3af-9cebe02e9ed5 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:02:12 user nova-compute[72239]: DEBUG nova.compute.manager [req-03526964-ef26-4d12-b288-c5618dd986f7 req-57595bba-02bb-459a-bb32-eba9f48ea19b service nova] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Received event network-vif-unplugged-badab919-e57c-44e5-a3af-9cebe02e9ed5 for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 15:02:12 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Instance destroyed successfully.
Jul 31 15:02:12 user nova-compute[72239]: DEBUG nova.objects.instance [None req-15a54be1-8ec5-4f93-a5e6-a7248279cbf2 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lazy-loading 'resources' on Instance uuid aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:02:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-15a54be1-8ec5-4f93-a5e6-a7248279cbf2 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:59:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1296584085',display_name='tempest-AttachVolumeTestJSON-server-1296584085',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1296584085',id=34,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCq78cPBqNdpWKW3Y/Pi5jvcUIugJsocenwA35z/GGKYQ5PWVnEird2iYvLSl7/6N4nzkNy1x4Va+eVCB3qmR4+2PdPbBxKl6UjerWzceywpduAoF422YFNTzQTGt1dWvQ==',key_name='tempest-keypair-2002484080',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:59:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a18e5e2cd6854f0985aa161b1e8a6db7',ramdisk_id='',reservation_id='r-ps4jj0f1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-853601938',owner_user_name='tempest-AttachVolumeTestJSON-853601938-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:59:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2f8df817a91d41c8a421e2ba562c5015',uuid=aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "badab919-e57c-44e5-a3af-9cebe02e9ed5", "address": "fa:16:3e:bf:16:bd", "network": {"id": "50e01a2d-5e91-4aca-a74c-7687f91ed21e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-937098047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e5e2cd6854f0985aa161b1e8a6db7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbadab919-e5", "ovs_interfaceid": "badab919-e57c-44e5-a3af-9cebe02e9ed5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 15:02:12 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-15a54be1-8ec5-4f93-a5e6-a7248279cbf2 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Converting VIF {"id": "badab919-e57c-44e5-a3af-9cebe02e9ed5", "address": "fa:16:3e:bf:16:bd", "network": {"id": "50e01a2d-5e91-4aca-a74c-7687f91ed21e", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-937098047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a18e5e2cd6854f0985aa161b1e8a6db7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbadab919-e5", "ovs_interfaceid": "badab919-e57c-44e5-a3af-9cebe02e9ed5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:02:12 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-15a54be1-8ec5-4f93-a5e6-a7248279cbf2 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bf:16:bd,bridge_name='br-int',has_traffic_filtering=True,id=badab919-e57c-44e5-a3af-9cebe02e9ed5,network=Network(50e01a2d-5e91-4aca-a74c-7687f91ed21e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbadab919-e5') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:02:12 user nova-compute[72239]: DEBUG os_vif [None req-15a54be1-8ec5-4f93-a5e6-a7248279cbf2 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:16:bd,bridge_name='br-int',has_traffic_filtering=True,id=badab919-e57c-44e5-a3af-9cebe02e9ed5,network=Network(50e01a2d-5e91-4aca-a74c-7687f91ed21e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbadab919-e5') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 15:02:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbadab919-e5, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:02:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:02:12 user nova-compute[72239]: INFO os_vif [None req-15a54be1-8ec5-4f93-a5e6-a7248279cbf2 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bf:16:bd,bridge_name='br-int',has_traffic_filtering=True,id=badab919-e57c-44e5-a3af-9cebe02e9ed5,network=Network(50e01a2d-5e91-4aca-a74c-7687f91ed21e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbadab919-e5')
Jul 31 15:02:12 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-15a54be1-8ec5-4f93-a5e6-a7248279cbf2 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Deleting instance files /opt/stack/data/nova/instances/aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73_del
Jul 31 15:02:12 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-15a54be1-8ec5-4f93-a5e6-a7248279cbf2 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Deletion of /opt/stack/data/nova/instances/aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73_del complete
Jul 31 15:02:12 user nova-compute[72239]: INFO nova.compute.manager [None req-15a54be1-8ec5-4f93-a5e6-a7248279cbf2 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Took 0.89 seconds to destroy the instance on the hypervisor.
Jul 31 15:02:12 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-15a54be1-8ec5-4f93-a5e6-a7248279cbf2 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 15:02:12 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 15:02:12 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 15:02:13 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:02:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:14 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:02:14 user nova-compute[72239]: DEBUG nova.compute.manager [req-2f56c5c3-f0eb-4102-a65e-28285241b13c req-3c143730-d9e2-48ed-b760-475aa960fa54 service nova] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Received event network-vif-deleted-badab919-e57c-44e5-a3af-9cebe02e9ed5 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:02:14 user nova-compute[72239]: INFO nova.compute.manager [req-2f56c5c3-f0eb-4102-a65e-28285241b13c req-3c143730-d9e2-48ed-b760-475aa960fa54 service nova] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Neutron deleted interface badab919-e57c-44e5-a3af-9cebe02e9ed5; detaching it from the instance and deleting it from the info cache
Jul 31 15:02:14 user nova-compute[72239]: DEBUG nova.network.neutron [req-2f56c5c3-f0eb-4102-a65e-28285241b13c req-3c143730-d9e2-48ed-b760-475aa960fa54 service nova] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:02:14 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Took 1.64 seconds to deallocate network for instance.
Jul 31 15:02:14 user nova-compute[72239]: DEBUG nova.compute.manager [req-2f56c5c3-f0eb-4102-a65e-28285241b13c req-3c143730-d9e2-48ed-b760-475aa960fa54 service nova] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Detach interface failed, port_id=badab919-e57c-44e5-a3af-9cebe02e9ed5, reason: Instance aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73 could not be found. {{(pid=72239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 15:02:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-15a54be1-8ec5-4f93-a5e6-a7248279cbf2 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:02:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-15a54be1-8ec5-4f93-a5e6-a7248279cbf2 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:02:14 user nova-compute[72239]: DEBUG nova.compute.manager [req-9f36a354-94d0-4c1f-8a76-5bbc011cfefc req-e4c201c5-9b54-4185-aa9b-9a7b227a5e9a service nova] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Received event network-vif-plugged-badab919-e57c-44e5-a3af-9cebe02e9ed5 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:02:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-9f36a354-94d0-4c1f-8a76-5bbc011cfefc req-e4c201c5-9b54-4185-aa9b-9a7b227a5e9a service nova] Acquiring lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:02:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-9f36a354-94d0-4c1f-8a76-5bbc011cfefc req-e4c201c5-9b54-4185-aa9b-9a7b227a5e9a service nova] Lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:02:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-9f36a354-94d0-4c1f-8a76-5bbc011cfefc req-e4c201c5-9b54-4185-aa9b-9a7b227a5e9a service nova] Lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:02:14 user nova-compute[72239]: DEBUG nova.compute.manager [req-9f36a354-94d0-4c1f-8a76-5bbc011cfefc req-e4c201c5-9b54-4185-aa9b-9a7b227a5e9a service nova] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] No waiting events found dispatching network-vif-plugged-badab919-e57c-44e5-a3af-9cebe02e9ed5 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:02:14 user nova-compute[72239]: WARNING nova.compute.manager [req-9f36a354-94d0-4c1f-8a76-5bbc011cfefc req-e4c201c5-9b54-4185-aa9b-9a7b227a5e9a service nova] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Received unexpected event network-vif-plugged-badab919-e57c-44e5-a3af-9cebe02e9ed5 for instance with vm_state active and task_state deleting.
Jul 31 15:02:14 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-15a54be1-8ec5-4f93-a5e6-a7248279cbf2 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:02:14 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-15a54be1-8ec5-4f93-a5e6-a7248279cbf2 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:02:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-15a54be1-8ec5-4f93-a5e6-a7248279cbf2 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.327s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:02:14 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-15a54be1-8ec5-4f93-a5e6-a7248279cbf2 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Deleted allocations for instance aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73
Jul 31 15:02:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-15a54be1-8ec5-4f93-a5e6-a7248279cbf2 tempest-AttachVolumeTestJSON-853601938 tempest-AttachVolumeTestJSON-853601938-project-member] Lock "aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.053s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:02:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Acquiring lock "f98cea94-e905-47c5-bf88-5f5694934966" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:02:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Lock "f98cea94-e905-47c5-bf88-5f5694934966" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:02:15 user nova-compute[72239]: DEBUG nova.compute.manager [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 15:02:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:02:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:02:15 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 15:02:15 user nova-compute[72239]: INFO nova.compute.claims [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Claim successful on node user
Jul 31 15:02:15 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:02:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:02:15 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:02:15 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:02:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.329s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:02:15 user nova-compute[72239]: DEBUG nova.compute.manager [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 15:02:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.136s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:02:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:02:15 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 15:02:15 user nova-compute[72239]: DEBUG nova.compute.manager [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 15:02:15 user nova-compute[72239]: DEBUG nova.network.neutron [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: f98cea94-e905-47c5-bf88-5f5694934966] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 15:02:15 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 15:02:15 user nova-compute[72239]: DEBUG nova.compute.manager [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 15:02:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443f846e-09ed-47d3-813d-62fc8cea96c2/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:15 user nova-compute[72239]: DEBUG nova.policy [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21222ab2b99941978eb3c3e511547e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f4d01080114839b14b23997a4dc1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 15:02:15 user nova-compute[72239]: DEBUG nova.compute.manager [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 15:02:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 15:02:15 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Creating image(s)
Jul 31 15:02:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Acquiring lock "/opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:02:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Lock "/opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:02:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Lock "/opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:02:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443f846e-09ed-47d3-813d-62fc8cea96c2/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443f846e-09ed-47d3-813d-62fc8cea96c2/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.140s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Acquiring lock "ca449065000c92aac3b7b9fa685f9a7710929444" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:02:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:02:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/443f846e-09ed-47d3-813d-62fc8cea96c2/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdh (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 15:02:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.142s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk 1073741824" returned: 0 in 0.055s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:02:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.139s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:16 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 15:02:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 15:02:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:16 user nova-compute[72239]: DEBUG nova.network.neutron [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Successfully created port: d9134cdf-ef4b-442f-8a86-313a3a2d5fdf {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 15:02:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:16 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Cannot resize image /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 15:02:16 user nova-compute[72239]: DEBUG nova.objects.instance [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Lazy-loading 'migration_context' on Instance uuid f98cea94-e905-47c5-bf88-5f5694934966 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:02:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 15:02:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Ensure instance console log exists: /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 15:02:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:02:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:02:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:02:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:17 user nova-compute[72239]: DEBUG nova.network.neutron [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Successfully updated port: d9134cdf-ef4b-442f-8a86-313a3a2d5fdf {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 15:02:17 user nova-compute[72239]: DEBUG nova.compute.manager [req-73a0b2a9-3b92-4d45-995f-93d8d2644357 req-255a3e79-3ee2-4656-875b-1f4a557f165c service nova] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Received event network-changed-d9134cdf-ef4b-442f-8a86-313a3a2d5fdf {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:02:17 user nova-compute[72239]: DEBUG nova.compute.manager [req-73a0b2a9-3b92-4d45-995f-93d8d2644357 req-255a3e79-3ee2-4656-875b-1f4a557f165c service nova] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Refreshing instance network info cache due to event network-changed-d9134cdf-ef4b-442f-8a86-313a3a2d5fdf. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:02:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-73a0b2a9-3b92-4d45-995f-93d8d2644357 req-255a3e79-3ee2-4656-875b-1f4a557f165c service nova] Acquiring lock "refresh_cache-f98cea94-e905-47c5-bf88-5f5694934966" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:02:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-73a0b2a9-3b92-4d45-995f-93d8d2644357 req-255a3e79-3ee2-4656-875b-1f4a557f165c service nova] Acquired lock "refresh_cache-f98cea94-e905-47c5-bf88-5f5694934966" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:02:17 user nova-compute[72239]: DEBUG nova.network.neutron [req-73a0b2a9-3b92-4d45-995f-93d8d2644357 req-255a3e79-3ee2-4656-875b-1f4a557f165c service nova] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Refreshing network info cache for port d9134cdf-ef4b-442f-8a86-313a3a2d5fdf {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:02:17 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:02:17 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:02:17 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=8008MB free_disk=25.21188735961914GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 15:02:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:02:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:02:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Acquiring lock "refresh_cache-f98cea94-e905-47c5-bf88-5f5694934966" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:02:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:17 user nova-compute[72239]: DEBUG nova.network.neutron [req-73a0b2a9-3b92-4d45-995f-93d8d2644357 req-255a3e79-3ee2-4656-875b-1f4a557f165c service nova] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 15:02:17 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 20abf743-de5b-4122-aad0-e2124c7804b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:02:17 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 2f11022e-a007-4d4c-adc1-b54ea59b9e6a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:02:17 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance c10918e9-9731-48ea-860e-8a02cb6a0ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:02:17 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 443f846e-09ed-47d3-813d-62fc8cea96c2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:02:17 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 3d70608b-fc54-4178-9aa6-98ca6198a37b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:02:17 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 0a89aa93-374f-4487-893b-58c15d42c84c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:02:17 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance f98cea94-e905-47c5-bf88-5f5694934966 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:02:17 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 15:02:17 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 15:02:17 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:02:17 user nova-compute[72239]: DEBUG nova.network.neutron [req-73a0b2a9-3b92-4d45-995f-93d8d2644357 req-255a3e79-3ee2-4656-875b-1f4a557f165c service nova] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:02:17 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:02:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-73a0b2a9-3b92-4d45-995f-93d8d2644357 req-255a3e79-3ee2-4656-875b-1f4a557f165c service nova] Releasing lock "refresh_cache-f98cea94-e905-47c5-bf88-5f5694934966" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:02:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Acquired lock "refresh_cache-f98cea94-e905-47c5-bf88-5f5694934966" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:02:17 user nova-compute[72239]: DEBUG nova.network.neutron [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 15:02:17 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 15:02:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.357s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:02:17 user nova-compute[72239]: DEBUG nova.network.neutron [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 15:02:18 user nova-compute[72239]: DEBUG nova.network.neutron [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Updating instance_info_cache with network_info: [{"id": "d9134cdf-ef4b-442f-8a86-313a3a2d5fdf", "address": "fa:16:3e:ce:31:50", "network": {"id": "afcad268-9e48-452e-ae62-cbeaf3f538dd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-791822524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f4d01080114839b14b23997a4dc1f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9134cdf-ef", "ovs_interfaceid": "d9134cdf-ef4b-442f-8a86-313a3a2d5fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:02:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Releasing lock "refresh_cache-f98cea94-e905-47c5-bf88-5f5694934966" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:02:18 user nova-compute[72239]: DEBUG nova.compute.manager [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Instance network_info: |[{"id": "d9134cdf-ef4b-442f-8a86-313a3a2d5fdf", "address": "fa:16:3e:ce:31:50", "network": {"id": "afcad268-9e48-452e-ae62-cbeaf3f538dd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-791822524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f4d01080114839b14b23997a4dc1f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9134cdf-ef", "ovs_interfaceid": "d9134cdf-ef4b-442f-8a86-313a3a2d5fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 15:02:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Start _get_guest_xml network_info=[{"id": "d9134cdf-ef4b-442f-8a86-313a3a2d5fdf", "address": "fa:16:3e:ce:31:50", "network": {"id": "afcad268-9e48-452e-ae62-cbeaf3f538dd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-791822524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f4d01080114839b14b23997a4dc1f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9134cdf-ef", "ovs_interfaceid": "d9134cdf-ef4b-442f-8a86-313a3a2d5fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 15:02:18 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:02:18 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:02:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 15:02:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 15:02:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 15:02:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 15:02:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 15:02:18 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 15:02:18 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 15:02:18 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 15:02:18 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 15:02:18 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 15:02:18 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 15:02:18 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 15:02:18 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 15:02:18 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 15:02:18 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 15:02:18 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 15:02:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-624613072',display_name='tempest-ServersNegativeTestJSON-server-624613072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-624613072',id=36,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36f4d01080114839b14b23997a4dc1f3',ramdisk_id='',reservation_id='r-4k5yo3y3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-628169841',owner_user_name='tempest-ServersNegativeTestJSON-628169841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T15:02:16Z,user_data=None,user_id='21222ab2b99941978eb3c3e511547e65',uuid=f98cea94-e905-47c5-bf88-5f5694934966,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9134cdf-ef4b-442f-8a86-313a3a2d5fdf", "address": "fa:16:3e:ce:31:50", "network": {"id": "afcad268-9e48-452e-ae62-cbeaf3f538dd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-791822524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f4d01080114839b14b23997a4dc1f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9134cdf-ef", "ovs_interfaceid": "d9134cdf-ef4b-442f-8a86-313a3a2d5fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 15:02:18 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Converting VIF {"id": "d9134cdf-ef4b-442f-8a86-313a3a2d5fdf", "address": "fa:16:3e:ce:31:50", "network": {"id": "afcad268-9e48-452e-ae62-cbeaf3f538dd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-791822524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f4d01080114839b14b23997a4dc1f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9134cdf-ef", "ovs_interfaceid": "d9134cdf-ef4b-442f-8a86-313a3a2d5fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:02:18 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:31:50,bridge_name='br-int',has_traffic_filtering=True,id=d9134cdf-ef4b-442f-8a86-313a3a2d5fdf,network=Network(afcad268-9e48-452e-ae62-cbeaf3f538dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9134cdf-ef') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:02:18 user nova-compute[72239]: DEBUG nova.objects.instance [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Lazy-loading 'pci_devices' on Instance uuid f98cea94-e905-47c5-bf88-5f5694934966 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:02:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: f98cea94-e905-47c5-bf88-5f5694934966] End _get_guest_xml xml=<domain type="kvm">
Jul 31 15:02:18 user nova-compute[72239]:   <uuid>f98cea94-e905-47c5-bf88-5f5694934966</uuid>
Jul 31 15:02:18 user nova-compute[72239]:   <name>instance-00000024</name>
Jul 31 15:02:18 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 15:02:18 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 15:02:18 user nova-compute[72239]:   <metadata>
Jul 31 15:02:18 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 15:02:18 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 15:02:18 user nova-compute[72239]:       <nova:name>tempest-ServersNegativeTestJSON-server-624613072</nova:name>
Jul 31 15:02:18 user nova-compute[72239]:       <nova:creationTime>2023-07-31 15:02:18</nova:creationTime>
Jul 31 15:02:18 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 15:02:18 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 15:02:18 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 15:02:18 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 15:02:18 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 15:02:18 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 15:02:18 user nova-compute[72239]:       </nova:flavor>
Jul 31 15:02:18 user nova-compute[72239]:       <nova:owner>
Jul 31 15:02:18 user nova-compute[72239]:         <nova:user uuid="21222ab2b99941978eb3c3e511547e65">tempest-ServersNegativeTestJSON-628169841-project-member</nova:user>
Jul 31 15:02:18 user nova-compute[72239]:         <nova:project uuid="36f4d01080114839b14b23997a4dc1f3">tempest-ServersNegativeTestJSON-628169841</nova:project>
Jul 31 15:02:18 user nova-compute[72239]:       </nova:owner>
Jul 31 15:02:18 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 15:02:18 user nova-compute[72239]:       <nova:ports>
Jul 31 15:02:18 user nova-compute[72239]:         <nova:port uuid="d9134cdf-ef4b-442f-8a86-313a3a2d5fdf">
Jul 31 15:02:18 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 31 15:02:18 user nova-compute[72239]:         </nova:port>
Jul 31 15:02:18 user nova-compute[72239]:       </nova:ports>
Jul 31 15:02:18 user nova-compute[72239]:     </nova:instance>
Jul 31 15:02:18 user nova-compute[72239]:   </metadata>
Jul 31 15:02:18 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 15:02:18 user nova-compute[72239]:     <system>
Jul 31 15:02:18 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 15:02:18 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 15:02:18 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 15:02:18 user nova-compute[72239]:       <entry name="serial">f98cea94-e905-47c5-bf88-5f5694934966</entry>
Jul 31 15:02:18 user nova-compute[72239]:       <entry name="uuid">f98cea94-e905-47c5-bf88-5f5694934966</entry>
Jul 31 15:02:18 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 15:02:18 user nova-compute[72239]:     </system>
Jul 31 15:02:18 user nova-compute[72239]:   </sysinfo>
Jul 31 15:02:18 user nova-compute[72239]:   <os>
Jul 31 15:02:18 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 15:02:18 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 15:02:18 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 15:02:18 user nova-compute[72239]:   </os>
Jul 31 15:02:18 user nova-compute[72239]:   <features>
Jul 31 15:02:18 user nova-compute[72239]:     <acpi/>
Jul 31 15:02:18 user nova-compute[72239]:     <apic/>
Jul 31 15:02:18 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 15:02:18 user nova-compute[72239]:   </features>
Jul 31 15:02:18 user nova-compute[72239]:   <clock offset="utc">
Jul 31 15:02:18 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 15:02:18 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 15:02:18 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 15:02:18 user nova-compute[72239]:   </clock>
Jul 31 15:02:18 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 15:02:18 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 15:02:18 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 15:02:18 user nova-compute[72239]:   </cpu>
Jul 31 15:02:18 user nova-compute[72239]:   <devices>
Jul 31 15:02:18 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 15:02:18 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 15:02:18 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk"/>
Jul 31 15:02:18 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 15:02:18 user nova-compute[72239]:     </disk>
Jul 31 15:02:18 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 15:02:18 user nova-compute[72239]:       <mac address="fa:16:3e:ce:31:50"/>
Jul 31 15:02:18 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:02:18 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 15:02:18 user nova-compute[72239]:       <target dev="tapd9134cdf-ef"/>
Jul 31 15:02:18 user nova-compute[72239]:     </interface>
Jul 31 15:02:18 user nova-compute[72239]:     <serial type="pty">
Jul 31 15:02:18 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/console.log" append="off"/>
Jul 31 15:02:18 user nova-compute[72239]:     </serial>
Jul 31 15:02:18 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 15:02:18 user nova-compute[72239]:     <video>
Jul 31 15:02:18 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:02:18 user nova-compute[72239]:     </video>
Jul 31 15:02:18 user nova-compute[72239]:     <rng model="virtio">
Jul 31 15:02:18 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 15:02:18 user nova-compute[72239]:     </rng>
Jul 31 15:02:18 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 15:02:18 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 15:02:18 user nova-compute[72239]:       <stats period="10"/>
Jul 31 15:02:18 user nova-compute[72239]:     </memballoon>
Jul 31 15:02:18 user nova-compute[72239]:   </devices>
Jul 31 15:02:18 user nova-compute[72239]: </domain>
Jul 31 15:02:18 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 15:02:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-624613072',display_name='tempest-ServersNegativeTestJSON-server-624613072',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-624613072',id=36,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36f4d01080114839b14b23997a4dc1f3',ramdisk_id='',reservation_id='r-4k5yo3y3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-628169841',owner_user_name='tempest-ServersNegativeTestJSON-628169841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T15:02:16Z,user_data=None,user_id='21222ab2b99941978eb3c3e511547e65',uuid=f98cea94-e905-47c5-bf88-5f5694934966,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9134cdf-ef4b-442f-8a86-313a3a2d5fdf", "address": "fa:16:3e:ce:31:50", "network": {"id": "afcad268-9e48-452e-ae62-cbeaf3f538dd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-791822524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f4d01080114839b14b23997a4dc1f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9134cdf-ef", "ovs_interfaceid": "d9134cdf-ef4b-442f-8a86-313a3a2d5fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 15:02:18 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Converting VIF {"id": "d9134cdf-ef4b-442f-8a86-313a3a2d5fdf", "address": "fa:16:3e:ce:31:50", "network": {"id": "afcad268-9e48-452e-ae62-cbeaf3f538dd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-791822524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f4d01080114839b14b23997a4dc1f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9134cdf-ef", "ovs_interfaceid": "d9134cdf-ef4b-442f-8a86-313a3a2d5fdf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:02:18 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:31:50,bridge_name='br-int',has_traffic_filtering=True,id=d9134cdf-ef4b-442f-8a86-313a3a2d5fdf,network=Network(afcad268-9e48-452e-ae62-cbeaf3f538dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9134cdf-ef') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:02:18 user nova-compute[72239]: DEBUG os_vif [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:31:50,bridge_name='br-int',has_traffic_filtering=True,id=d9134cdf-ef4b-442f-8a86-313a3a2d5fdf,network=Network(afcad268-9e48-452e-ae62-cbeaf3f538dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9134cdf-ef') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 15:02:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:02:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 15:02:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9134cdf-ef, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:02:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd9134cdf-ef, col_values=(('external_ids', {'iface-id': 'd9134cdf-ef4b-442f-8a86-313a3a2d5fdf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:31:50', 'vm-uuid': 'f98cea94-e905-47c5-bf88-5f5694934966'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:02:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:02:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:18 user nova-compute[72239]: INFO os_vif [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:31:50,bridge_name='br-int',has_traffic_filtering=True,id=d9134cdf-ef4b-442f-8a86-313a3a2d5fdf,network=Network(afcad268-9e48-452e-ae62-cbeaf3f538dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9134cdf-ef')
Jul 31 15:02:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:02:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] No VIF found with MAC fa:16:3e:ce:31:50, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 15:02:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-b307a0be-e8b1-4a45-9965-9c457c7cfea5 req-97ae0fad-4ab7-49e7-8996-e5ca813d17eb service nova] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Received event network-vif-plugged-d9134cdf-ef4b-442f-8a86-313a3a2d5fdf {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:02:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b307a0be-e8b1-4a45-9965-9c457c7cfea5 req-97ae0fad-4ab7-49e7-8996-e5ca813d17eb service nova] Acquiring lock "f98cea94-e905-47c5-bf88-5f5694934966-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:02:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b307a0be-e8b1-4a45-9965-9c457c7cfea5 req-97ae0fad-4ab7-49e7-8996-e5ca813d17eb service nova] Lock "f98cea94-e905-47c5-bf88-5f5694934966-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:02:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b307a0be-e8b1-4a45-9965-9c457c7cfea5 req-97ae0fad-4ab7-49e7-8996-e5ca813d17eb service nova] Lock "f98cea94-e905-47c5-bf88-5f5694934966-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:02:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-b307a0be-e8b1-4a45-9965-9c457c7cfea5 req-97ae0fad-4ab7-49e7-8996-e5ca813d17eb service nova] [instance: f98cea94-e905-47c5-bf88-5f5694934966] No waiting events found dispatching network-vif-plugged-d9134cdf-ef4b-442f-8a86-313a3a2d5fdf {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:02:19 user nova-compute[72239]: WARNING nova.compute.manager [req-b307a0be-e8b1-4a45-9965-9c457c7cfea5 req-97ae0fad-4ab7-49e7-8996-e5ca813d17eb service nova] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Received unexpected event network-vif-plugged-d9134cdf-ef4b-442f-8a86-313a3a2d5fdf for instance with vm_state building and task_state spawning.
Jul 31 15:02:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:20 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:02:20 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 15:02:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-cd869d27-e2b7-4568-b974-ead5d38befbd tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "443f846e-09ed-47d3-813d-62fc8cea96c2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:02:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-cd869d27-e2b7-4568-b974-ead5d38befbd tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "443f846e-09ed-47d3-813d-62fc8cea96c2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:02:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-cd869d27-e2b7-4568-b974-ead5d38befbd tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "443f846e-09ed-47d3-813d-62fc8cea96c2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:02:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-cd869d27-e2b7-4568-b974-ead5d38befbd tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "443f846e-09ed-47d3-813d-62fc8cea96c2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:02:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-cd869d27-e2b7-4568-b974-ead5d38befbd tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "443f846e-09ed-47d3-813d-62fc8cea96c2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:02:21 user nova-compute[72239]: INFO nova.compute.manager [None req-cd869d27-e2b7-4568-b974-ead5d38befbd tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Terminating instance
Jul 31 15:02:21 user nova-compute[72239]: DEBUG nova.compute.manager [None req-cd869d27-e2b7-4568-b974-ead5d38befbd tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 15:02:21 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:21 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815741.7571435, f98cea94-e905-47c5-bf88-5f5694934966 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:02:21 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f98cea94-e905-47c5-bf88-5f5694934966] VM Resumed (Lifecycle Event)
Jul 31 15:02:21 user nova-compute[72239]: DEBUG nova.compute.manager [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 15:02:21 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 15:02:21 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:21 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Instance spawned successfully.
Jul 31 15:02:21 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 15:02:21 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:21 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:02:21 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:02:21 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:21 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:02:21 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:02:21 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:02:21 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:02:21 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:02:21 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:02:21 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f98cea94-e905-47c5-bf88-5f5694934966] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 15:02:21 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815741.7593522, f98cea94-e905-47c5-bf88-5f5694934966 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:02:21 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f98cea94-e905-47c5-bf88-5f5694934966] VM Started (Lifecycle Event)
Jul 31 15:02:21 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:02:21 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:02:21 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f98cea94-e905-47c5-bf88-5f5694934966] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 15:02:21 user nova-compute[72239]: DEBUG nova.compute.manager [req-91c2d55a-fa0b-4b4c-9177-340f947d773c req-9da1d702-e0e7-4dc4-a3ed-382bc3d49382 service nova] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Received event network-vif-unplugged-3d5bc442-d5a6-4dcb-aec4-8674a732bb8f {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:02:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-91c2d55a-fa0b-4b4c-9177-340f947d773c req-9da1d702-e0e7-4dc4-a3ed-382bc3d49382 service nova] Acquiring lock "443f846e-09ed-47d3-813d-62fc8cea96c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:02:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-91c2d55a-fa0b-4b4c-9177-340f947d773c req-9da1d702-e0e7-4dc4-a3ed-382bc3d49382 service nova] Lock "443f846e-09ed-47d3-813d-62fc8cea96c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:02:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-91c2d55a-fa0b-4b4c-9177-340f947d773c req-9da1d702-e0e7-4dc4-a3ed-382bc3d49382 service nova] Lock "443f846e-09ed-47d3-813d-62fc8cea96c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:02:21 user nova-compute[72239]: DEBUG nova.compute.manager [req-91c2d55a-fa0b-4b4c-9177-340f947d773c req-9da1d702-e0e7-4dc4-a3ed-382bc3d49382 service nova] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] No waiting events found dispatching network-vif-unplugged-3d5bc442-d5a6-4dcb-aec4-8674a732bb8f {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:02:21 user nova-compute[72239]: DEBUG nova.compute.manager [req-91c2d55a-fa0b-4b4c-9177-340f947d773c req-9da1d702-e0e7-4dc4-a3ed-382bc3d49382 service nova] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Received event network-vif-unplugged-3d5bc442-d5a6-4dcb-aec4-8674a732bb8f for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 15:02:21 user nova-compute[72239]: INFO nova.compute.manager [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Took 6.16 seconds to spawn the instance on the hypervisor.
Jul 31 15:02:21 user nova-compute[72239]: DEBUG nova.compute.manager [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:02:21 user nova-compute[72239]: DEBUG nova.compute.manager [req-8b76660a-414c-4244-9a3f-6f53fe7ada71 req-81db4e62-fc21-4842-b13b-480040f1573e service nova] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Received event network-vif-plugged-d9134cdf-ef4b-442f-8a86-313a3a2d5fdf {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:02:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-8b76660a-414c-4244-9a3f-6f53fe7ada71 req-81db4e62-fc21-4842-b13b-480040f1573e service nova] Acquiring lock "f98cea94-e905-47c5-bf88-5f5694934966-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:02:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-8b76660a-414c-4244-9a3f-6f53fe7ada71 req-81db4e62-fc21-4842-b13b-480040f1573e service nova] Lock "f98cea94-e905-47c5-bf88-5f5694934966-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:02:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-8b76660a-414c-4244-9a3f-6f53fe7ada71 req-81db4e62-fc21-4842-b13b-480040f1573e service nova] Lock "f98cea94-e905-47c5-bf88-5f5694934966-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:02:21 user nova-compute[72239]: DEBUG nova.compute.manager [req-8b76660a-414c-4244-9a3f-6f53fe7ada71 req-81db4e62-fc21-4842-b13b-480040f1573e service nova] [instance: f98cea94-e905-47c5-bf88-5f5694934966] No waiting events found dispatching network-vif-plugged-d9134cdf-ef4b-442f-8a86-313a3a2d5fdf {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:02:21 user nova-compute[72239]: WARNING nova.compute.manager [req-8b76660a-414c-4244-9a3f-6f53fe7ada71 req-81db4e62-fc21-4842-b13b-480040f1573e service nova] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Received unexpected event network-vif-plugged-d9134cdf-ef4b-442f-8a86-313a3a2d5fdf for instance with vm_state building and task_state spawning.
Jul 31 15:02:22 user nova-compute[72239]: INFO nova.compute.manager [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Took 6.90 seconds to build instance.
Jul 31 15:02:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0fa1f964-2543-4e40-b2af-e226dc4e081e tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Lock "f98cea94-e905-47c5-bf88-5f5694934966" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.990s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:02:22 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Instance destroyed successfully.
Jul 31 15:02:22 user nova-compute[72239]: DEBUG nova.objects.instance [None req-cd869d27-e2b7-4568-b974-ead5d38befbd tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lazy-loading 'resources' on Instance uuid 443f846e-09ed-47d3-813d-62fc8cea96c2 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:02:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-cd869d27-e2b7-4568-b974-ead5d38befbd tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:59:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-580943295',display_name='tempest-AttachVolumeNegativeTest-server-580943295',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-580943295',id=33,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC4uxgFQP5PkYEpeXD4PwG1Dtwyrt48Kq4VA7cJUq7b/lVOW2FJ5PVlYSi5ahnx2CNFL6soIekTWcJfuQG5P1co37WarF9A9b/vb4/ijX9Br6UtatBVJmQytVWelCiWDAg==',key_name='tempest-keypair-539756932',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:59:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48e4fe9e81724b9cb6b9d73748f9bdee',ramdisk_id='',reservation_id='r-4onqv11y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-620954585',owner_user_name='tempest-AttachVolumeNegativeTest-620954585-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:59:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99f609389e884d5490ba160d9fff28e3',uuid=443f846e-09ed-47d3-813d-62fc8cea96c2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3d5bc442-d5a6-4dcb-aec4-8674a732bb8f", "address": "fa:16:3e:65:8e:56", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5bc442-d5", "ovs_interfaceid": "3d5bc442-d5a6-4dcb-aec4-8674a732bb8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 15:02:22 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-cd869d27-e2b7-4568-b974-ead5d38befbd tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Converting VIF {"id": "3d5bc442-d5a6-4dcb-aec4-8674a732bb8f", "address": "fa:16:3e:65:8e:56", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.88", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3d5bc442-d5", "ovs_interfaceid": "3d5bc442-d5a6-4dcb-aec4-8674a732bb8f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:02:22 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-cd869d27-e2b7-4568-b974-ead5d38befbd tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:65:8e:56,bridge_name='br-int',has_traffic_filtering=True,id=3d5bc442-d5a6-4dcb-aec4-8674a732bb8f,network=Network(f83cfb34-b1ca-4a7c-9a36-3654372585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5bc442-d5') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:02:22 user nova-compute[72239]: DEBUG os_vif [None req-cd869d27-e2b7-4568-b974-ead5d38befbd tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:8e:56,bridge_name='br-int',has_traffic_filtering=True,id=3d5bc442-d5a6-4dcb-aec4-8674a732bb8f,network=Network(f83cfb34-b1ca-4a7c-9a36-3654372585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5bc442-d5') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 15:02:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3d5bc442-d5, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:02:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:22 user nova-compute[72239]: INFO os_vif [None req-cd869d27-e2b7-4568-b974-ead5d38befbd tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:65:8e:56,bridge_name='br-int',has_traffic_filtering=True,id=3d5bc442-d5a6-4dcb-aec4-8674a732bb8f,network=Network(f83cfb34-b1ca-4a7c-9a36-3654372585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3d5bc442-d5')
Jul 31 15:02:22 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-cd869d27-e2b7-4568-b974-ead5d38befbd tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Deleting instance files /opt/stack/data/nova/instances/443f846e-09ed-47d3-813d-62fc8cea96c2_del
Jul 31 15:02:22 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-cd869d27-e2b7-4568-b974-ead5d38befbd tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Deletion of /opt/stack/data/nova/instances/443f846e-09ed-47d3-813d-62fc8cea96c2_del complete
Jul 31 15:02:22 user nova-compute[72239]: INFO nova.compute.manager [None req-cd869d27-e2b7-4568-b974-ead5d38befbd tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 31 15:02:22 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-cd869d27-e2b7-4568-b974-ead5d38befbd tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 15:02:22 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 15:02:22 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 15:02:23 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:02:23 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Took 1.12 seconds to deallocate network for instance.
Jul 31 15:02:23 user nova-compute[72239]: DEBUG nova.compute.manager [req-f9b24c8d-51c0-4f5d-83ec-dfbfe47a51ab req-75f66b4a-38f1-4959-89cb-7921bda0995e service nova] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Received event network-vif-deleted-3d5bc442-d5a6-4dcb-aec4-8674a732bb8f {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:02:23 user nova-compute[72239]: INFO nova.compute.manager [req-f9b24c8d-51c0-4f5d-83ec-dfbfe47a51ab req-75f66b4a-38f1-4959-89cb-7921bda0995e service nova] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Neutron deleted interface 3d5bc442-d5a6-4dcb-aec4-8674a732bb8f; detaching it from the instance and deleting it from the info cache
Jul 31 15:02:23 user nova-compute[72239]: DEBUG nova.network.neutron [req-f9b24c8d-51c0-4f5d-83ec-dfbfe47a51ab req-75f66b4a-38f1-4959-89cb-7921bda0995e service nova] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:02:23 user nova-compute[72239]: DEBUG nova.compute.manager [req-f9b24c8d-51c0-4f5d-83ec-dfbfe47a51ab req-75f66b4a-38f1-4959-89cb-7921bda0995e service nova] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Detach interface failed, port_id=3d5bc442-d5a6-4dcb-aec4-8674a732bb8f, reason: Instance 443f846e-09ed-47d3-813d-62fc8cea96c2 could not be found. {{(pid=72239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 15:02:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-cd869d27-e2b7-4568-b974-ead5d38befbd tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:02:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-cd869d27-e2b7-4568-b974-ead5d38befbd tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:02:23 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-cd869d27-e2b7-4568-b974-ead5d38befbd tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:02:23 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-cd869d27-e2b7-4568-b974-ead5d38befbd tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:02:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-cd869d27-e2b7-4568-b974-ead5d38befbd tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.241s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:02:24 user nova-compute[72239]: DEBUG nova.compute.manager [req-cc0aa179-5f2e-48aa-a6fc-f068347fce1c req-20430535-8bc3-4d60-8a4c-6ba84de5724f service nova] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Received event network-vif-plugged-3d5bc442-d5a6-4dcb-aec4-8674a732bb8f {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:02:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-cc0aa179-5f2e-48aa-a6fc-f068347fce1c req-20430535-8bc3-4d60-8a4c-6ba84de5724f service nova] Acquiring lock "443f846e-09ed-47d3-813d-62fc8cea96c2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:02:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-cc0aa179-5f2e-48aa-a6fc-f068347fce1c req-20430535-8bc3-4d60-8a4c-6ba84de5724f service nova] Lock "443f846e-09ed-47d3-813d-62fc8cea96c2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:02:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-cc0aa179-5f2e-48aa-a6fc-f068347fce1c req-20430535-8bc3-4d60-8a4c-6ba84de5724f service nova] Lock "443f846e-09ed-47d3-813d-62fc8cea96c2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:02:24 user nova-compute[72239]: DEBUG nova.compute.manager [req-cc0aa179-5f2e-48aa-a6fc-f068347fce1c req-20430535-8bc3-4d60-8a4c-6ba84de5724f service nova] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] No waiting events found dispatching network-vif-plugged-3d5bc442-d5a6-4dcb-aec4-8674a732bb8f {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:02:24 user nova-compute[72239]: WARNING nova.compute.manager [req-cc0aa179-5f2e-48aa-a6fc-f068347fce1c req-20430535-8bc3-4d60-8a4c-6ba84de5724f service nova] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Received unexpected event network-vif-plugged-3d5bc442-d5a6-4dcb-aec4-8674a732bb8f for instance with vm_state deleted and task_state None.
Jul 31 15:02:24 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-cd869d27-e2b7-4568-b974-ead5d38befbd tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Deleted allocations for instance 443f846e-09ed-47d3-813d-62fc8cea96c2
Jul 31 15:02:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-cd869d27-e2b7-4568-b974-ead5d38befbd tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "443f846e-09ed-47d3-813d-62fc8cea96c2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.459s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:02:24 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:27 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690815732.410513, aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73 => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:02:27 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] VM Stopped (Lifecycle Event)
Jul 31 15:02:27 user nova-compute[72239]: DEBUG nova.compute.manager [None req-540abde7-1a7e-46ec-a803-cf6e951e6945 None None] [instance: aeb969dc-0f0c-49f4-9d7b-7d005f4f9d73] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:02:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:32 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:37 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690815742.45907, 443f846e-09ed-47d3-813d-62fc8cea96c2 => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:02:37 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] VM Stopped (Lifecycle Event)
Jul 31 15:02:37 user nova-compute[72239]: DEBUG nova.compute.manager [None req-50c469b6-d697-4f79-902b-aec916ec31e3 None None] [instance: 443f846e-09ed-47d3-813d-62fc8cea96c2] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:02:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:02:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:02:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:02:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:02:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:02:42 user nova-compute[72239]: INFO nova.compute.manager [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Terminating instance
Jul 31 15:02:42 user nova-compute[72239]: DEBUG nova.compute.manager [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG nova.compute.manager [req-9283312d-135f-4883-ac4e-3ab0b59004a6 req-1617bf38-19a3-42dd-a8a7-3b522c9df6ae service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Received event network-vif-unplugged-91cadad3-732b-4fed-af92-b54692837973 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-9283312d-135f-4883-ac4e-3ab0b59004a6 req-1617bf38-19a3-42dd-a8a7-3b522c9df6ae service nova] Acquiring lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-9283312d-135f-4883-ac4e-3ab0b59004a6 req-1617bf38-19a3-42dd-a8a7-3b522c9df6ae service nova] Lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-9283312d-135f-4883-ac4e-3ab0b59004a6 req-1617bf38-19a3-42dd-a8a7-3b522c9df6ae service nova] Lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG nova.compute.manager [req-9283312d-135f-4883-ac4e-3ab0b59004a6 req-1617bf38-19a3-42dd-a8a7-3b522c9df6ae service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] No waiting events found dispatching network-vif-unplugged-91cadad3-732b-4fed-af92-b54692837973 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG nova.compute.manager [req-9283312d-135f-4883-ac4e-3ab0b59004a6 req-1617bf38-19a3-42dd-a8a7-3b522c9df6ae service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Received event network-vif-unplugged-91cadad3-732b-4fed-af92-b54692837973 for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:43 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Instance destroyed successfully.
Jul 31 15:02:43 user nova-compute[72239]: DEBUG nova.objects.instance [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lazy-loading 'resources' on Instance uuid 2f11022e-a007-4d4c-adc1-b54ea59b9e6a {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:46:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1216288639',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1216288639',id=14,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:48:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d8281237f9c417a9685e55826911e1b',ramdisk_id='',reservation_id='r-0tq8f5us',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-148379254',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:50:43Z,user_data=None,user_id='94ab9298205143d489f678b28be5b085',uuid=2f11022e-a007-4d4c-adc1-b54ea59b9e6a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91cadad3-732b-4fed-af92-b54692837973", "address": "fa:16:3e:44:72:66", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91cadad3-73", "ovs_interfaceid": "91cadad3-732b-4fed-af92-b54692837973", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Converting VIF {"id": "91cadad3-732b-4fed-af92-b54692837973", "address": "fa:16:3e:44:72:66", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91cadad3-73", "ovs_interfaceid": "91cadad3-732b-4fed-af92-b54692837973", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:72:66,bridge_name='br-int',has_traffic_filtering=True,id=91cadad3-732b-4fed-af92-b54692837973,network=Network(172fb80f-4bbe-4706-91cf-60540fbceb2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91cadad3-73') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG os_vif [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:72:66,bridge_name='br-int',has_traffic_filtering=True,id=91cadad3-732b-4fed-af92-b54692837973,network=Network(172fb80f-4bbe-4706-91cf-60540fbceb2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91cadad3-73') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91cadad3-73, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:02:43 user nova-compute[72239]: INFO os_vif [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:72:66,bridge_name='br-int',has_traffic_filtering=True,id=91cadad3-732b-4fed-af92-b54692837973,network=Network(172fb80f-4bbe-4706-91cf-60540fbceb2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91cadad3-73')
Jul 31 15:02:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WBpGanPy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:02:43 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:02:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6d6297b-e277-4efb-9eb4-124b938772f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[194cd0a3-810e-41e2-9d81-8686ca0a1b44]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 15:02:43 user nova-compute[72239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 15:02:43 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da (non-flash)
Jul 31 15:02:43 user nova-compute[72239]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 15:02:43 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4100617a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da'): ({'sdh'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Removing single pathed devices sdh {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef1a726c-a7f8-4dfc-b030-7c3d07113c98]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f05c625f-eadb-4b0b-8a6c-54c6787a06ac]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Flushing IO for device /dev/sdh {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[046c0ca4-d556-4f35-a0ee-83e8cfa19036]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.034s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a21ad2-6e01-4b24-a147-ba8bc3b1c3d2]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] SCSI volumes sdh have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d35658-3ba9-43a2-bff2-fa8abaaf1614]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:02:43 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:44 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:44 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2eba091-5f82-4589-bacd-6eec846c8bac]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:02:44 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da, portal: 172.16.0.220,3260]
Jul 31 15:02:44 user nova-compute[72239]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da, portal: 172.16.0.220,3260] successful.
Jul 31 15:02:44 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:02:44 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:44 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6b6e6fc1-6c81-4d1f-92e8-ae4f930973da -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:44 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0898ca-7671-45e8-8ffb-c24885e0041f]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:02:44 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:02:44 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:02:44 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] <== disconnect_volume: return (286ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:02:44 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 15:02:44 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Deleting instance files /opt/stack/data/nova/instances/2f11022e-a007-4d4c-adc1-b54ea59b9e6a_del
Jul 31 15:02:44 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Deletion of /opt/stack/data/nova/instances/2f11022e-a007-4d4c-adc1-b54ea59b9e6a_del complete
Jul 31 15:02:44 user nova-compute[72239]: INFO nova.compute.manager [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Took 1.15 seconds to destroy the instance on the hypervisor.
Jul 31 15:02:44 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 15:02:44 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 15:02:44 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 15:02:44 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:02:44 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Took 0.63 seconds to deallocate network for instance.
Jul 31 15:02:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:45 user nova-compute[72239]: DEBUG nova.compute.manager [req-112932e6-ff1a-4419-aab6-97cb37f8d843 req-b89fb64a-0292-4a16-beb3-41ab0e476ced service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Received event network-vif-plugged-91cadad3-732b-4fed-af92-b54692837973 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:02:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-112932e6-ff1a-4419-aab6-97cb37f8d843 req-b89fb64a-0292-4a16-beb3-41ab0e476ced service nova] Acquiring lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:02:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-112932e6-ff1a-4419-aab6-97cb37f8d843 req-b89fb64a-0292-4a16-beb3-41ab0e476ced service nova] Lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:02:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-112932e6-ff1a-4419-aab6-97cb37f8d843 req-b89fb64a-0292-4a16-beb3-41ab0e476ced service nova] Lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:02:45 user nova-compute[72239]: DEBUG nova.compute.manager [req-112932e6-ff1a-4419-aab6-97cb37f8d843 req-b89fb64a-0292-4a16-beb3-41ab0e476ced service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] No waiting events found dispatching network-vif-plugged-91cadad3-732b-4fed-af92-b54692837973 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:02:45 user nova-compute[72239]: WARNING nova.compute.manager [req-112932e6-ff1a-4419-aab6-97cb37f8d843 req-b89fb64a-0292-4a16-beb3-41ab0e476ced service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Received unexpected event network-vif-plugged-91cadad3-732b-4fed-af92-b54692837973 for instance with vm_state active and task_state deleting.
Jul 31 15:02:45 user nova-compute[72239]: DEBUG nova.compute.manager [req-112932e6-ff1a-4419-aab6-97cb37f8d843 req-b89fb64a-0292-4a16-beb3-41ab0e476ced service nova] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Received event network-vif-deleted-91cadad3-732b-4fed-af92-b54692837973 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:02:45 user nova-compute[72239]: INFO nova.compute.manager [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Took 0.80 seconds to detach 1 volumes for instance.
Jul 31 15:02:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:02:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:02:45 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:02:45 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:02:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.261s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:02:45 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Deleted allocations for instance 2f11022e-a007-4d4c-adc1-b54ea59b9e6a
Jul 31 15:02:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7ac3038c-f53b-4108-bdad-94eb433ef8b1 tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "2f11022e-a007-4d4c-adc1-b54ea59b9e6a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.080s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:02:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Acquiring lock "824b19e8-b4af-4fd4-a1ef-f214e25caef2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:02:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Lock "824b19e8-b4af-4fd4-a1ef-f214e25caef2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:02:47 user nova-compute[72239]: DEBUG nova.compute.manager [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 15:02:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:02:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:02:48 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 15:02:48 user nova-compute[72239]: INFO nova.compute.claims [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Claim successful on node user
Jul 31 15:02:48 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:02:48 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:02:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.290s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:02:48 user nova-compute[72239]: DEBUG nova.compute.manager [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 15:02:48 user nova-compute[72239]: DEBUG nova.compute.manager [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 15:02:48 user nova-compute[72239]: DEBUG nova.network.neutron [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 15:02:48 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 15:02:48 user nova-compute[72239]: DEBUG nova.compute.manager [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 15:02:48 user nova-compute[72239]: DEBUG nova.policy [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '575c2513960842219b5b2e6dd4bbe0c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fcfa13175edf4a009a781d344397d17b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 15:02:48 user nova-compute[72239]: DEBUG nova.compute.manager [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 15:02:48 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 15:02:48 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Creating image(s)
Jul 31 15:02:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Acquiring lock "/opt/stack/data/nova/instances/824b19e8-b4af-4fd4-a1ef-f214e25caef2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:02:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Lock "/opt/stack/data/nova/instances/824b19e8-b4af-4fd4-a1ef-f214e25caef2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:02:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Lock "/opt/stack/data/nova/instances/824b19e8-b4af-4fd4-a1ef-f214e25caef2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:02:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.151s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Acquiring lock "ca449065000c92aac3b7b9fa685f9a7710929444" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:02:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:02:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.134s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/824b19e8-b4af-4fd4-a1ef-f214e25caef2/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/824b19e8-b4af-4fd4-a1ef-f214e25caef2/disk 1073741824" returned: 0 in 0.057s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:02:48 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.138s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:49 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Checking if we can resize image /opt/stack/data/nova/instances/824b19e8-b4af-4fd4-a1ef-f214e25caef2/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 15:02:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/824b19e8-b4af-4fd4-a1ef-f214e25caef2/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:49 user nova-compute[72239]: DEBUG nova.network.neutron [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Successfully created port: 6fdab9d3-d8f2-4406-ab69-d876d6137de6 {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 15:02:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/824b19e8-b4af-4fd4-a1ef-f214e25caef2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:49 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Cannot resize image /opt/stack/data/nova/instances/824b19e8-b4af-4fd4-a1ef-f214e25caef2/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 15:02:49 user nova-compute[72239]: DEBUG nova.objects.instance [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Lazy-loading 'migration_context' on Instance uuid 824b19e8-b4af-4fd4-a1ef-f214e25caef2 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:02:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 15:02:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Ensure instance console log exists: /opt/stack/data/nova/instances/824b19e8-b4af-4fd4-a1ef-f214e25caef2/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 15:02:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:02:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:02:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:02:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG nova.network.neutron [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Successfully updated port: 6fdab9d3-d8f2-4406-ab69-d876d6137de6 {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Acquiring lock "refresh_cache-824b19e8-b4af-4fd4-a1ef-f214e25caef2" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Acquired lock "refresh_cache-824b19e8-b4af-4fd4-a1ef-f214e25caef2" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG nova.network.neutron [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG nova.compute.manager [req-4fc49b57-8bff-4f09-a69e-a02ecdd2f33c req-03d8ef3b-1980-4590-9c53-5a93b4029310 service nova] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Received event network-changed-6fdab9d3-d8f2-4406-ab69-d876d6137de6 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG nova.compute.manager [req-4fc49b57-8bff-4f09-a69e-a02ecdd2f33c req-03d8ef3b-1980-4590-9c53-5a93b4029310 service nova] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Refreshing instance network info cache due to event network-changed-6fdab9d3-d8f2-4406-ab69-d876d6137de6. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-4fc49b57-8bff-4f09-a69e-a02ecdd2f33c req-03d8ef3b-1980-4590-9c53-5a93b4029310 service nova] Acquiring lock "refresh_cache-824b19e8-b4af-4fd4-a1ef-f214e25caef2" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG nova.network.neutron [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG nova.network.neutron [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Updating instance_info_cache with network_info: [{"id": "6fdab9d3-d8f2-4406-ab69-d876d6137de6", "address": "fa:16:3e:31:fb:ca", "network": {"id": "d728d291-b79b-4b43-a125-8e6d1667788b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2121566835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcfa13175edf4a009a781d344397d17b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fdab9d3-d8", "ovs_interfaceid": "6fdab9d3-d8f2-4406-ab69-d876d6137de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Releasing lock "refresh_cache-824b19e8-b4af-4fd4-a1ef-f214e25caef2" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG nova.compute.manager [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Instance network_info: |[{"id": "6fdab9d3-d8f2-4406-ab69-d876d6137de6", "address": "fa:16:3e:31:fb:ca", "network": {"id": "d728d291-b79b-4b43-a125-8e6d1667788b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2121566835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcfa13175edf4a009a781d344397d17b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fdab9d3-d8", "ovs_interfaceid": "6fdab9d3-d8f2-4406-ab69-d876d6137de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-4fc49b57-8bff-4f09-a69e-a02ecdd2f33c req-03d8ef3b-1980-4590-9c53-5a93b4029310 service nova] Acquired lock "refresh_cache-824b19e8-b4af-4fd4-a1ef-f214e25caef2" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG nova.network.neutron [req-4fc49b57-8bff-4f09-a69e-a02ecdd2f33c req-03d8ef3b-1980-4590-9c53-5a93b4029310 service nova] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Refreshing network info cache for port 6fdab9d3-d8f2-4406-ab69-d876d6137de6 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Start _get_guest_xml network_info=[{"id": "6fdab9d3-d8f2-4406-ab69-d876d6137de6", "address": "fa:16:3e:31:fb:ca", "network": {"id": "d728d291-b79b-4b43-a125-8e6d1667788b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2121566835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcfa13175edf4a009a781d344397d17b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fdab9d3-d8", "ovs_interfaceid": "6fdab9d3-d8f2-4406-ab69-d876d6137de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 15:02:50 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:02:50 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:02:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:02:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-959569854',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-959569854',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-9595698',id=37,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxwTiPCyvHmXbSWjtOjYze0FJpgz8a/UYUS10zj6t3r35HECrTZDEhNfpUS2+XwVZlwrtDoa/Ggigxjy1KzsZTv47NWAJYiq8kOKM+v1JQxQYVmpaYrIlM0creEbZXjYg==',key_name='tempest-keypair-1808541430',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcfa13175edf4a009a781d344397d17b',ramdisk_id='',reservation_id='r-xt26sodw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1912909993',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T15:02:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='575c2513960842219b5b2e6dd4bbe0c1',uuid=824b19e8-b4af-4fd4-a1ef-f214e25caef2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fdab9d3-d8f2-4406-ab69-d876d6137de6", "address": "fa:16:3e:31:fb:ca", "network": {"id": "d728d291-b79b-4b43-a125-8e6d1667788b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2121566835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcfa13175edf4a009a781d344397d17b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fdab9d3-d8", "ovs_interfaceid": "6fdab9d3-d8f2-4406-ab69-d876d6137de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Converting VIF {"id": "6fdab9d3-d8f2-4406-ab69-d876d6137de6", "address": "fa:16:3e:31:fb:ca", "network": {"id": "d728d291-b79b-4b43-a125-8e6d1667788b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2121566835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcfa13175edf4a009a781d344397d17b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fdab9d3-d8", "ovs_interfaceid": "6fdab9d3-d8f2-4406-ab69-d876d6137de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:fb:ca,bridge_name='br-int',has_traffic_filtering=True,id=6fdab9d3-d8f2-4406-ab69-d876d6137de6,network=Network(d728d291-b79b-4b43-a125-8e6d1667788b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fdab9d3-d8') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG nova.objects.instance [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Lazy-loading 'pci_devices' on Instance uuid 824b19e8-b4af-4fd4-a1ef-f214e25caef2 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] End _get_guest_xml xml=<domain type="kvm">
Jul 31 15:02:50 user nova-compute[72239]:   <uuid>824b19e8-b4af-4fd4-a1ef-f214e25caef2</uuid>
Jul 31 15:02:50 user nova-compute[72239]:   <name>instance-00000025</name>
Jul 31 15:02:50 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 15:02:50 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 15:02:50 user nova-compute[72239]:   <metadata>
Jul 31 15:02:50 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 15:02:50 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 15:02:50 user nova-compute[72239]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-959569854</nova:name>
Jul 31 15:02:50 user nova-compute[72239]:       <nova:creationTime>2023-07-31 15:02:50</nova:creationTime>
Jul 31 15:02:50 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 15:02:50 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 15:02:50 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 15:02:50 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 15:02:50 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 15:02:50 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 15:02:50 user nova-compute[72239]:       </nova:flavor>
Jul 31 15:02:50 user nova-compute[72239]:       <nova:owner>
Jul 31 15:02:50 user nova-compute[72239]:         <nova:user uuid="575c2513960842219b5b2e6dd4bbe0c1">tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member</nova:user>
Jul 31 15:02:50 user nova-compute[72239]:         <nova:project uuid="fcfa13175edf4a009a781d344397d17b">tempest-TestServerVolumeAttachScenarioOldVersion-1912909993</nova:project>
Jul 31 15:02:50 user nova-compute[72239]:       </nova:owner>
Jul 31 15:02:50 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 15:02:50 user nova-compute[72239]:       <nova:ports>
Jul 31 15:02:50 user nova-compute[72239]:         <nova:port uuid="6fdab9d3-d8f2-4406-ab69-d876d6137de6">
Jul 31 15:02:50 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 31 15:02:50 user nova-compute[72239]:         </nova:port>
Jul 31 15:02:50 user nova-compute[72239]:       </nova:ports>
Jul 31 15:02:50 user nova-compute[72239]:     </nova:instance>
Jul 31 15:02:50 user nova-compute[72239]:   </metadata>
Jul 31 15:02:50 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 15:02:50 user nova-compute[72239]:     <system>
Jul 31 15:02:50 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 15:02:50 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 15:02:50 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 15:02:50 user nova-compute[72239]:       <entry name="serial">824b19e8-b4af-4fd4-a1ef-f214e25caef2</entry>
Jul 31 15:02:50 user nova-compute[72239]:       <entry name="uuid">824b19e8-b4af-4fd4-a1ef-f214e25caef2</entry>
Jul 31 15:02:50 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 15:02:50 user nova-compute[72239]:     </system>
Jul 31 15:02:50 user nova-compute[72239]:   </sysinfo>
Jul 31 15:02:50 user nova-compute[72239]:   <os>
Jul 31 15:02:50 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 15:02:50 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 15:02:50 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 15:02:50 user nova-compute[72239]:   </os>
Jul 31 15:02:50 user nova-compute[72239]:   <features>
Jul 31 15:02:50 user nova-compute[72239]:     <acpi/>
Jul 31 15:02:50 user nova-compute[72239]:     <apic/>
Jul 31 15:02:50 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 15:02:50 user nova-compute[72239]:   </features>
Jul 31 15:02:50 user nova-compute[72239]:   <clock offset="utc">
Jul 31 15:02:50 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 15:02:50 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 15:02:50 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 15:02:50 user nova-compute[72239]:   </clock>
Jul 31 15:02:50 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 15:02:50 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 15:02:50 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 15:02:50 user nova-compute[72239]:   </cpu>
Jul 31 15:02:50 user nova-compute[72239]:   <devices>
Jul 31 15:02:50 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 15:02:50 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 15:02:50 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/824b19e8-b4af-4fd4-a1ef-f214e25caef2/disk"/>
Jul 31 15:02:50 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 15:02:50 user nova-compute[72239]:     </disk>
Jul 31 15:02:50 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 15:02:50 user nova-compute[72239]:       <mac address="fa:16:3e:31:fb:ca"/>
Jul 31 15:02:50 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:02:50 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 15:02:50 user nova-compute[72239]:       <target dev="tap6fdab9d3-d8"/>
Jul 31 15:02:50 user nova-compute[72239]:     </interface>
Jul 31 15:02:50 user nova-compute[72239]:     <serial type="pty">
Jul 31 15:02:50 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/824b19e8-b4af-4fd4-a1ef-f214e25caef2/console.log" append="off"/>
Jul 31 15:02:50 user nova-compute[72239]:     </serial>
Jul 31 15:02:50 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 15:02:50 user nova-compute[72239]:     <video>
Jul 31 15:02:50 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:02:50 user nova-compute[72239]:     </video>
Jul 31 15:02:50 user nova-compute[72239]:     <rng model="virtio">
Jul 31 15:02:50 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 15:02:50 user nova-compute[72239]:     </rng>
Jul 31 15:02:50 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 15:02:50 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 15:02:50 user nova-compute[72239]:       <stats period="10"/>
Jul 31 15:02:50 user nova-compute[72239]:     </memballoon>
Jul 31 15:02:50 user nova-compute[72239]:   </devices>
Jul 31 15:02:50 user nova-compute[72239]: </domain>
Jul 31 15:02:50 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:02:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-959569854',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-959569854',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-9595698',id=37,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxwTiPCyvHmXbSWjtOjYze0FJpgz8a/UYUS10zj6t3r35HECrTZDEhNfpUS2+XwVZlwrtDoa/Ggigxjy1KzsZTv47NWAJYiq8kOKM+v1JQxQYVmpaYrIlM0creEbZXjYg==',key_name='tempest-keypair-1808541430',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fcfa13175edf4a009a781d344397d17b',ramdisk_id='',reservation_id='r-xt26sodw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1912909993',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T15:02:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='575c2513960842219b5b2e6dd4bbe0c1',uuid=824b19e8-b4af-4fd4-a1ef-f214e25caef2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6fdab9d3-d8f2-4406-ab69-d876d6137de6", "address": "fa:16:3e:31:fb:ca", "network": {"id": "d728d291-b79b-4b43-a125-8e6d1667788b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2121566835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcfa13175edf4a009a781d344397d17b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fdab9d3-d8", "ovs_interfaceid": "6fdab9d3-d8f2-4406-ab69-d876d6137de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Converting VIF {"id": "6fdab9d3-d8f2-4406-ab69-d876d6137de6", "address": "fa:16:3e:31:fb:ca", "network": {"id": "d728d291-b79b-4b43-a125-8e6d1667788b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2121566835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcfa13175edf4a009a781d344397d17b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fdab9d3-d8", "ovs_interfaceid": "6fdab9d3-d8f2-4406-ab69-d876d6137de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:fb:ca,bridge_name='br-int',has_traffic_filtering=True,id=6fdab9d3-d8f2-4406-ab69-d876d6137de6,network=Network(d728d291-b79b-4b43-a125-8e6d1667788b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fdab9d3-d8') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG os_vif [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:fb:ca,bridge_name='br-int',has_traffic_filtering=True,id=6fdab9d3-d8f2-4406-ab69-d876d6137de6,network=Network(d728d291-b79b-4b43-a125-8e6d1667788b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fdab9d3-d8') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6fdab9d3-d8, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6fdab9d3-d8, col_values=(('external_ids', {'iface-id': '6fdab9d3-d8f2-4406-ab69-d876d6137de6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:fb:ca', 'vm-uuid': '824b19e8-b4af-4fd4-a1ef-f214e25caef2'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:50 user nova-compute[72239]: INFO os_vif [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:fb:ca,bridge_name='br-int',has_traffic_filtering=True,id=6fdab9d3-d8f2-4406-ab69-d876d6137de6,network=Network(d728d291-b79b-4b43-a125-8e6d1667788b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fdab9d3-d8')
Jul 31 15:02:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] No VIF found with MAC fa:16:3e:31:fb:ca, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG nova.network.neutron [req-4fc49b57-8bff-4f09-a69e-a02ecdd2f33c req-03d8ef3b-1980-4590-9c53-5a93b4029310 service nova] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Updated VIF entry in instance network info cache for port 6fdab9d3-d8f2-4406-ab69-d876d6137de6. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG nova.network.neutron [req-4fc49b57-8bff-4f09-a69e-a02ecdd2f33c req-03d8ef3b-1980-4590-9c53-5a93b4029310 service nova] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Updating instance_info_cache with network_info: [{"id": "6fdab9d3-d8f2-4406-ab69-d876d6137de6", "address": "fa:16:3e:31:fb:ca", "network": {"id": "d728d291-b79b-4b43-a125-8e6d1667788b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2121566835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcfa13175edf4a009a781d344397d17b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fdab9d3-d8", "ovs_interfaceid": "6fdab9d3-d8f2-4406-ab69-d876d6137de6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:02:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-4fc49b57-8bff-4f09-a69e-a02ecdd2f33c req-03d8ef3b-1980-4590-9c53-5a93b4029310 service nova] Releasing lock "refresh_cache-824b19e8-b4af-4fd4-a1ef-f214e25caef2" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:02:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:52 user nova-compute[72239]: DEBUG nova.compute.manager [req-4154ba50-cbbb-4414-b6c8-9b313498df98 req-d7b9c634-3e5d-44ae-b1c1-aab21cc27c82 service nova] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Received event network-vif-plugged-6fdab9d3-d8f2-4406-ab69-d876d6137de6 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:02:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-4154ba50-cbbb-4414-b6c8-9b313498df98 req-d7b9c634-3e5d-44ae-b1c1-aab21cc27c82 service nova] Acquiring lock "824b19e8-b4af-4fd4-a1ef-f214e25caef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:02:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-4154ba50-cbbb-4414-b6c8-9b313498df98 req-d7b9c634-3e5d-44ae-b1c1-aab21cc27c82 service nova] Lock "824b19e8-b4af-4fd4-a1ef-f214e25caef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:02:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-4154ba50-cbbb-4414-b6c8-9b313498df98 req-d7b9c634-3e5d-44ae-b1c1-aab21cc27c82 service nova] Lock "824b19e8-b4af-4fd4-a1ef-f214e25caef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:02:52 user nova-compute[72239]: DEBUG nova.compute.manager [req-4154ba50-cbbb-4414-b6c8-9b313498df98 req-d7b9c634-3e5d-44ae-b1c1-aab21cc27c82 service nova] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] No waiting events found dispatching network-vif-plugged-6fdab9d3-d8f2-4406-ab69-d876d6137de6 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:02:52 user nova-compute[72239]: WARNING nova.compute.manager [req-4154ba50-cbbb-4414-b6c8-9b313498df98 req-d7b9c634-3e5d-44ae-b1c1-aab21cc27c82 service nova] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Received unexpected event network-vif-plugged-6fdab9d3-d8f2-4406-ab69-d876d6137de6 for instance with vm_state building and task_state spawning.
Jul 31 15:02:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:53 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815773.9045033, 824b19e8-b4af-4fd4-a1ef-f214e25caef2 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:02:53 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] VM Resumed (Lifecycle Event)
Jul 31 15:02:53 user nova-compute[72239]: DEBUG nova.compute.manager [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 15:02:53 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 15:02:53 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Instance spawned successfully.
Jul 31 15:02:53 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 15:02:53 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:02:53 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:02:53 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:02:53 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:02:53 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:02:53 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:02:53 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:02:53 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:02:53 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 15:02:53 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815773.9058187, 824b19e8-b4af-4fd4-a1ef-f214e25caef2 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:02:53 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] VM Started (Lifecycle Event)
Jul 31 15:02:53 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:02:53 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:02:54 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 15:02:54 user nova-compute[72239]: INFO nova.compute.manager [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Took 5.41 seconds to spawn the instance on the hypervisor.
Jul 31 15:02:54 user nova-compute[72239]: DEBUG nova.compute.manager [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:02:54 user nova-compute[72239]: DEBUG nova.compute.manager [req-a26974b2-6c31-43a0-8f4f-65a1a58c9d81 req-c9622048-c98b-44cd-89b0-2ca2ec364758 service nova] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Received event network-vif-plugged-6fdab9d3-d8f2-4406-ab69-d876d6137de6 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:02:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a26974b2-6c31-43a0-8f4f-65a1a58c9d81 req-c9622048-c98b-44cd-89b0-2ca2ec364758 service nova] Acquiring lock "824b19e8-b4af-4fd4-a1ef-f214e25caef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:02:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a26974b2-6c31-43a0-8f4f-65a1a58c9d81 req-c9622048-c98b-44cd-89b0-2ca2ec364758 service nova] Lock "824b19e8-b4af-4fd4-a1ef-f214e25caef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:02:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a26974b2-6c31-43a0-8f4f-65a1a58c9d81 req-c9622048-c98b-44cd-89b0-2ca2ec364758 service nova] Lock "824b19e8-b4af-4fd4-a1ef-f214e25caef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:02:54 user nova-compute[72239]: DEBUG nova.compute.manager [req-a26974b2-6c31-43a0-8f4f-65a1a58c9d81 req-c9622048-c98b-44cd-89b0-2ca2ec364758 service nova] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] No waiting events found dispatching network-vif-plugged-6fdab9d3-d8f2-4406-ab69-d876d6137de6 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:02:54 user nova-compute[72239]: WARNING nova.compute.manager [req-a26974b2-6c31-43a0-8f4f-65a1a58c9d81 req-c9622048-c98b-44cd-89b0-2ca2ec364758 service nova] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Received unexpected event network-vif-plugged-6fdab9d3-d8f2-4406-ab69-d876d6137de6 for instance with vm_state building and task_state spawning.
Jul 31 15:02:54 user nova-compute[72239]: INFO nova.compute.manager [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Took 6.04 seconds to build instance.
Jul 31 15:02:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2f02fbfd-62a5-4481-89dc-0acbd61a0528 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Lock "824b19e8-b4af-4fd4-a1ef-f214e25caef2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.156s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:02:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Acquiring lock "0a89aa93-374f-4487-893b-58c15d42c84c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:02:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "0a89aa93-374f-4487-893b-58c15d42c84c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:02:55 user nova-compute[72239]: DEBUG nova.objects.instance [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lazy-loading 'flavor' on Instance uuid 0a89aa93-374f-4487-893b-58c15d42c84c {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:02:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "0a89aa93-374f-4487-893b-58c15d42c84c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:02:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Acquiring lock "0a89aa93-374f-4487-893b-58c15d42c84c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:02:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "0a89aa93-374f-4487-893b-58c15d42c84c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:02:55 user nova-compute[72239]: INFO nova.compute.manager [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Attaching volume e9aa4b80-b6b3-4722-8ac8-03d905074747 to /dev/vdb
Jul 31 15:02:55 user nova-compute[72239]: DEBUG os_brick.utils [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:02:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:55 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd62c10c-03a7-4294-94fb-194a18bdc9c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:02:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:55 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a881e44b-e141-4115-b468-a417524d5b82]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:02:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:02:55 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2263943e-4e67-4c32-a22d-c93c2e191c39]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:02:55 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2792d40-63f5-4608-a355-47dd83b125e1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:02:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:02:55 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 15:02:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:02:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:02:55 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 15:02:55 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a6ad78c-e5d9-4b7e-a297-c768ff82e34c]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:02:55 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 15:02:55 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 15:02:55 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 15:02:55 user nova-compute[72239]: DEBUG os_brick.utils [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:02:55 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Updating existing volume attachment record: 3a397cb9-5822-4291-92e5-9fd63025b0b7 {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 15:02:56 user nova-compute[72239]: DEBUG nova.compute.manager [req-9e2f06e4-3a53-48ca-9ad3-755883108179 req-21cc9d00-6028-44dc-867f-3dc606aac398 service nova] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Received event network-changed-73d584f4-4986-4f0c-8483-18ef254a21f4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:02:56 user nova-compute[72239]: DEBUG nova.compute.manager [req-9e2f06e4-3a53-48ca-9ad3-755883108179 req-21cc9d00-6028-44dc-867f-3dc606aac398 service nova] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Refreshing instance network info cache due to event network-changed-73d584f4-4986-4f0c-8483-18ef254a21f4. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:02:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-9e2f06e4-3a53-48ca-9ad3-755883108179 req-21cc9d00-6028-44dc-867f-3dc606aac398 service nova] Acquiring lock "refresh_cache-0a89aa93-374f-4487-893b-58c15d42c84c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:02:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-9e2f06e4-3a53-48ca-9ad3-755883108179 req-21cc9d00-6028-44dc-867f-3dc606aac398 service nova] Acquired lock "refresh_cache-0a89aa93-374f-4487-893b-58c15d42c84c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:02:56 user nova-compute[72239]: DEBUG nova.network.neutron [req-9e2f06e4-3a53-48ca-9ad3-755883108179 req-21cc9d00-6028-44dc-867f-3dc606aac398 service nova] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Refreshing network info cache for port 73d584f4-4986-4f0c-8483-18ef254a21f4 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:02:56 user nova-compute[72239]: DEBUG nova.network.neutron [req-9e2f06e4-3a53-48ca-9ad3-755883108179 req-21cc9d00-6028-44dc-867f-3dc606aac398 service nova] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Updated VIF entry in instance network info cache for port 73d584f4-4986-4f0c-8483-18ef254a21f4. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:02:56 user nova-compute[72239]: DEBUG nova.network.neutron [req-9e2f06e4-3a53-48ca-9ad3-755883108179 req-21cc9d00-6028-44dc-867f-3dc606aac398 service nova] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Updating instance_info_cache with network_info: [{"id": "73d584f4-4986-4f0c-8483-18ef254a21f4", "address": "fa:16:3e:22:aa:8c", "network": {"id": "39af8721-7023-4cb5-9e06-293f319d5d93", "bridge": "br-int", "label": "tempest-TestStampPattern-549999556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228abbe80ac416fbcc6013767ca9384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73d584f4-49", "ovs_interfaceid": "73d584f4-4986-4f0c-8483-18ef254a21f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:02:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-9e2f06e4-3a53-48ca-9ad3-755883108179 req-21cc9d00-6028-44dc-867f-3dc606aac398 service nova] Releasing lock "refresh_cache-0a89aa93-374f-4487-893b-58c15d42c84c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:02:58 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690815763.703787, 2f11022e-a007-4d4c-adc1-b54ea59b9e6a => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:02:58 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] VM Stopped (Lifecycle Event)
Jul 31 15:02:58 user nova-compute[72239]: DEBUG nova.compute.manager [None req-6c6af781-6c84-420f-a207-ba234d78d5e2 None None] [instance: 2f11022e-a007-4d4c-adc1-b54ea59b9e6a] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:02:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "b8652db6-b595-497f-a55d-8c0520bc18aa" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:02:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "b8652db6-b595-497f-a55d-8c0520bc18aa" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:02:59 user nova-compute[72239]: INFO nova.compute.manager [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Unshelving
Jul 31 15:02:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:02:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:02:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:02:59 user nova-compute[72239]: DEBUG nova.objects.instance [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lazy-loading 'pci_requests' on Instance uuid b8652db6-b595-497f-a55d-8c0520bc18aa {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:02:59 user nova-compute[72239]: DEBUG nova.objects.instance [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lazy-loading 'numa_topology' on Instance uuid b8652db6-b595-497f-a55d-8c0520bc18aa {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:02:59 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 15:02:59 user nova-compute[72239]: INFO nova.compute.claims [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Claim successful on node user
Jul 31 15:03:00 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:03:00 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:03:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.457s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:03:00 user nova-compute[72239]: INFO nova.network.neutron [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Updating port 7c709373-3d22-47b8-84d4-2a66ab39628a with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 31 15:03:00 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "refresh_cache-b8652db6-b595-497f-a55d-8c0520bc18aa" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:03:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquired lock "refresh_cache-b8652db6-b595-497f-a55d-8c0520bc18aa" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:03:01 user nova-compute[72239]: DEBUG nova.network.neutron [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 15:03:01 user nova-compute[72239]: DEBUG nova.compute.manager [req-5ff30424-a98f-452b-8386-53651ce6e06b req-974743c8-a221-4281-bdea-75e2df705cf6 service nova] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Received event network-changed-7c709373-3d22-47b8-84d4-2a66ab39628a {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:03:01 user nova-compute[72239]: DEBUG nova.compute.manager [req-5ff30424-a98f-452b-8386-53651ce6e06b req-974743c8-a221-4281-bdea-75e2df705cf6 service nova] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Refreshing instance network info cache due to event network-changed-7c709373-3d22-47b8-84d4-2a66ab39628a. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:03:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5ff30424-a98f-452b-8386-53651ce6e06b req-974743c8-a221-4281-bdea-75e2df705cf6 service nova] Acquiring lock "refresh_cache-b8652db6-b595-497f-a55d-8c0520bc18aa" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:03:01 user nova-compute[72239]: DEBUG nova.network.neutron [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Updating instance_info_cache with network_info: [{"id": "7c709373-3d22-47b8-84d4-2a66ab39628a", "address": "fa:16:3e:9c:a0:63", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c709373-3d", "ovs_interfaceid": "7c709373-3d22-47b8-84d4-2a66ab39628a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:03:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Releasing lock "refresh_cache-b8652db6-b595-497f-a55d-8c0520bc18aa" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:03:01 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 15:03:01 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Creating image(s)
Jul 31 15:03:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "/opt/stack/data/nova/instances/b8652db6-b595-497f-a55d-8c0520bc18aa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:03:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "/opt/stack/data/nova/instances/b8652db6-b595-497f-a55d-8c0520bc18aa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:03:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "/opt/stack/data/nova/instances/b8652db6-b595-497f-a55d-8c0520bc18aa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:03:01 user nova-compute[72239]: DEBUG nova.objects.instance [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lazy-loading 'trusted_certs' on Instance uuid b8652db6-b595-497f-a55d-8c0520bc18aa {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:03:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5ff30424-a98f-452b-8386-53651ce6e06b req-974743c8-a221-4281-bdea-75e2df705cf6 service nova] Acquired lock "refresh_cache-b8652db6-b595-497f-a55d-8c0520bc18aa" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:03:01 user nova-compute[72239]: DEBUG nova.network.neutron [req-5ff30424-a98f-452b-8386-53651ce6e06b req-974743c8-a221-4281-bdea-75e2df705cf6 service nova] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Refreshing network info cache for port 7c709373-3d22-47b8-84d4-2a66ab39628a {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:03:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "9f8219f7ef5421815b464a92913a25001d5aafea" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:03:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "9f8219f7ef5421815b464a92913a25001d5aafea" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:03:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f8219f7ef5421815b464a92913a25001d5aafea.part --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f8219f7ef5421815b464a92913a25001d5aafea.part --force-share --output=json" returned: 0 in 0.157s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG nova.virt.images [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] b5e2ca71-1407-474a-89c7-c113c1c4a1a7 was qcow2, converting to raw {{(pid=72239) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG nova.privsep.utils [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72239) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9f8219f7ef5421815b464a92913a25001d5aafea.part /opt/stack/data/nova/instances/_base/9f8219f7ef5421815b464a92913a25001d5aafea.converted {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9f8219f7ef5421815b464a92913a25001d5aafea.part /opt/stack/data/nova/instances/_base/9f8219f7ef5421815b464a92913a25001d5aafea.converted" returned: 0 in 0.434s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f8219f7ef5421815b464a92913a25001d5aafea.converted --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG nova.network.neutron [req-5ff30424-a98f-452b-8386-53651ce6e06b req-974743c8-a221-4281-bdea-75e2df705cf6 service nova] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Updated VIF entry in instance network info cache for port 7c709373-3d22-47b8-84d4-2a66ab39628a. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG nova.network.neutron [req-5ff30424-a98f-452b-8386-53651ce6e06b req-974743c8-a221-4281-bdea-75e2df705cf6 service nova] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Updating instance_info_cache with network_info: [{"id": "7c709373-3d22-47b8-84d4-2a66ab39628a", "address": "fa:16:3e:9c:a0:63", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c709373-3d", "ovs_interfaceid": "7c709373-3d22-47b8-84d4-2a66ab39628a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CyRbhqlQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:03:03 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:03:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:03:03 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:03:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:03:03 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5ff30424-a98f-452b-8386-53651ce6e06b req-974743c8-a221-4281-bdea-75e2df705cf6 service nova] Releasing lock "refresh_cache-b8652db6-b595-497f-a55d-8c0520bc18aa" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747 -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7144d565-2f27-457e-8132-96adfd085546]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 15:03:03 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747 -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd95374-12d9-4b54-8af4-7852e905fc33]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747] added
Jul 31 15:03:03 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[76810ef8-3985-4be7-ba29-7320819fa425]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5784c66-2962-451c-8e5a-0a9d5374ce0f]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CyRbhqlQ {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f8219f7ef5421815b464a92913a25001d5aafea.converted --force-share --output=json" returned: 0 in 0.155s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "9f8219f7ef5421815b464a92913a25001d5aafea" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.958s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f8219f7ef5421815b464a92913a25001d5aafea --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CyRbhqlQ" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a5431d-ef48-4bea-b29c-0ce0d229c970]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CyRbhqlQ'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7ce8b18-78c4-48d9-b349-5dd3e5fcfa73]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[76eb6484-4539-414b-a930-17eb56b4f741]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 15:03:03 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 15:03:03 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747 -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f8219f7ef5421815b464a92913a25001d5aafea --force-share --output=json" returned: 0 in 0.156s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "9f8219f7ef5421815b464a92913a25001d5aafea" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "9f8219f7ef5421815b464a92913a25001d5aafea" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f8219f7ef5421815b464a92913a25001d5aafea --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde290e8-59bd-4158-a01f-603875225bbe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747, portal: 172.16.0.220,3260]
Jul 31 15:03:03 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747, portal: 172.16.0.220,3260] successful.
Jul 31 15:03:03 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3c5dc9-84e0-450c-bf5e-99ebdd173537]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e298379e-3e55-41f0-8f14-7ffa881dc826]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 15:03:03 user nova-compute[72239]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747 (non-flash)
Jul 31 15:03:03 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 15:03:03 user nova-compute[72239]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747 (non-flash)
Jul 31 15:03:03 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.364s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9daacffa-e9ea-4a2e-b8cd-6a6478932725]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CyRbhqlQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f8219f7ef5421815b464a92913a25001d5aafea --force-share --output=json" returned: 0 in 0.165s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f8219f7ef5421815b464a92913a25001d5aafea,backing_fmt=raw /opt/stack/data/nova/instances/b8652db6-b595-497f-a55d-8c0520bc18aa/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9f8219f7ef5421815b464a92913a25001d5aafea,backing_fmt=raw /opt/stack/data/nova/instances/b8652db6-b595-497f-a55d-8c0520bc18aa/disk 1073741824" returned: 0 in 0.060s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "9f8219f7ef5421815b464a92913a25001d5aafea" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:03:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f8219f7ef5421815b464a92913a25001d5aafea --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9f8219f7ef5421815b464a92913a25001d5aafea --force-share --output=json" returned: 0 in 0.162s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:04 user nova-compute[72239]: DEBUG nova.objects.instance [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lazy-loading 'migration_context' on Instance uuid b8652db6-b595-497f-a55d-8c0520bc18aa {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:03:04 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Rebasing disk image.
Jul 31 15:03:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.153s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 -F raw /opt/stack/data/nova/instances/b8652db6-b595-497f-a55d-8c0520bc18aa/disk {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.405s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:03:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] <== connect_volume: return (1407ms) {'type': 'block', 'scsi_wwn': '23339326366336364', 'path': '/dev/sdb'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:03:04 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23339326366336364', 'path': '/dev/sdb'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 15:03:04 user nova-compute[72239]: DEBUG nova.objects.instance [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lazy-loading 'flavor' on Instance uuid 0a89aa93-374f-4487-893b-58c15d42c84c {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:03:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 15:03:05 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:03:05 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 15:03:05 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 15:03:05 user nova-compute[72239]:   <serial>e9aa4b80-b6b3-4722-8ac8-03d905074747</serial>
Jul 31 15:03:05 user nova-compute[72239]: </disk>
Jul 31 15:03:05 user nova-compute[72239]:  {{(pid=72239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 15:03:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:03:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:03:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] No VIF found with MAC fa:16:3e:22:aa:8c, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 15:03:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-31044c0d-6f97-4888-95af-362691676413 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "0a89aa93-374f-4487-893b-58c15d42c84c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.117s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:03:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 -F raw /opt/stack/data/nova/instances/b8652db6-b595-497f-a55d-8c0520bc18aa/disk" returned: 0 in 2.487s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 15:03:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Ensure instance console log exists: /opt/stack/data/nova/instances/b8652db6-b595-497f-a55d-8c0520bc18aa/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 15:03:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:03:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:03:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:03:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Start _get_guest_xml network_info=[{"id": "7c709373-3d22-47b8-84d4-2a66ab39628a", "address": "fa:16:3e:9c:a0:63", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c709373-3d", "ovs_interfaceid": "7c709373-3d22-47b8-84d4-2a66ab39628a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='aad539a9df0f6f740de20b65ff49d802',container_format='bare',created_at=2023-07-31T15:01:07Z,direct_url=<?>,disk_format='qcow2',id=b5e2ca71-1407-474a-89c7-c113c1c4a1a7,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1746021859-shelved',owner='5a6715a7ff38401d844b620cb8d8769e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-31T15:01:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 15:03:06 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:03:06 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:03:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 15:03:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 15:03:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 15:03:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 15:03:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 15:03:06 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='aad539a9df0f6f740de20b65ff49d802',container_format='bare',created_at=2023-07-31T15:01:07Z,direct_url=<?>,disk_format='qcow2',id=b5e2ca71-1407-474a-89c7-c113c1c4a1a7,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1746021859-shelved',owner='5a6715a7ff38401d844b620cb8d8769e',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-31T15:01:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 15:03:06 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 15:03:06 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 15:03:06 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 15:03:06 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 15:03:06 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 15:03:06 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 15:03:06 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 15:03:06 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 15:03:06 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 15:03:06 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 15:03:06 user nova-compute[72239]: DEBUG nova.objects.instance [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lazy-loading 'vcpu_model' on Instance uuid b8652db6-b595-497f-a55d-8c0520bc18aa {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:03:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T14:59:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1746021859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1746021859',id=32,image_ref='b5e2ca71-1407-474a-89c7-c113c1c4a1a7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1252123597',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:59:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5a6715a7ff38401d844b620cb8d8769e',ramdisk_id='',reservation_id='r-twj02w4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-599528407',owner_user_name='tempest-AttachVolumeShelveTestJSON-599528407-project-member',shelved_at='2023-07-31T15:01:11.282619',shelved_host='user',shelved_image_id='b5e2ca71-1407-474a-89c7-c113c1c4a1a7'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T15:03:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70c6001a7ac5434fbc5ac7d003edd4eb',uuid=b8652db6-b595-497f-a55d-8c0520bc18aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7c709373-3d22-47b8-84d4-2a66ab39628a", "address": "fa:16:3e:9c:a0:63", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c709373-3d", "ovs_interfaceid": "7c709373-3d22-47b8-84d4-2a66ab39628a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 15:03:06 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Converting VIF {"id": "7c709373-3d22-47b8-84d4-2a66ab39628a", "address": "fa:16:3e:9c:a0:63", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c709373-3d", "ovs_interfaceid": "7c709373-3d22-47b8-84d4-2a66ab39628a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:03:06 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:a0:63,bridge_name='br-int',has_traffic_filtering=True,id=7c709373-3d22-47b8-84d4-2a66ab39628a,network=Network(37a946a3-d20a-4694-8647-73e84d2b0cb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c709373-3d') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:03:06 user nova-compute[72239]: DEBUG nova.objects.instance [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lazy-loading 'pci_devices' on Instance uuid b8652db6-b595-497f-a55d-8c0520bc18aa {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:03:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] End _get_guest_xml xml=<domain type="kvm">
Jul 31 15:03:07 user nova-compute[72239]:   <uuid>b8652db6-b595-497f-a55d-8c0520bc18aa</uuid>
Jul 31 15:03:07 user nova-compute[72239]:   <name>instance-00000020</name>
Jul 31 15:03:07 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 15:03:07 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 15:03:07 user nova-compute[72239]:   <metadata>
Jul 31 15:03:07 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 15:03:07 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 15:03:07 user nova-compute[72239]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1746021859</nova:name>
Jul 31 15:03:07 user nova-compute[72239]:       <nova:creationTime>2023-07-31 15:03:06</nova:creationTime>
Jul 31 15:03:07 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 15:03:07 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 15:03:07 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 15:03:07 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 15:03:07 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 15:03:07 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 15:03:07 user nova-compute[72239]:       </nova:flavor>
Jul 31 15:03:07 user nova-compute[72239]:       <nova:owner>
Jul 31 15:03:07 user nova-compute[72239]:         <nova:user uuid="70c6001a7ac5434fbc5ac7d003edd4eb">tempest-AttachVolumeShelveTestJSON-599528407-project-member</nova:user>
Jul 31 15:03:07 user nova-compute[72239]:         <nova:project uuid="5a6715a7ff38401d844b620cb8d8769e">tempest-AttachVolumeShelveTestJSON-599528407</nova:project>
Jul 31 15:03:07 user nova-compute[72239]:       </nova:owner>
Jul 31 15:03:07 user nova-compute[72239]:       <nova:root type="image" uuid="b5e2ca71-1407-474a-89c7-c113c1c4a1a7"/>
Jul 31 15:03:07 user nova-compute[72239]:       <nova:ports>
Jul 31 15:03:07 user nova-compute[72239]:         <nova:port uuid="7c709373-3d22-47b8-84d4-2a66ab39628a">
Jul 31 15:03:07 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 31 15:03:07 user nova-compute[72239]:         </nova:port>
Jul 31 15:03:07 user nova-compute[72239]:       </nova:ports>
Jul 31 15:03:07 user nova-compute[72239]:     </nova:instance>
Jul 31 15:03:07 user nova-compute[72239]:   </metadata>
Jul 31 15:03:07 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 15:03:07 user nova-compute[72239]:     <system>
Jul 31 15:03:07 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 15:03:07 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 15:03:07 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 15:03:07 user nova-compute[72239]:       <entry name="serial">b8652db6-b595-497f-a55d-8c0520bc18aa</entry>
Jul 31 15:03:07 user nova-compute[72239]:       <entry name="uuid">b8652db6-b595-497f-a55d-8c0520bc18aa</entry>
Jul 31 15:03:07 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 15:03:07 user nova-compute[72239]:     </system>
Jul 31 15:03:07 user nova-compute[72239]:   </sysinfo>
Jul 31 15:03:07 user nova-compute[72239]:   <os>
Jul 31 15:03:07 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 15:03:07 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 15:03:07 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 15:03:07 user nova-compute[72239]:   </os>
Jul 31 15:03:07 user nova-compute[72239]:   <features>
Jul 31 15:03:07 user nova-compute[72239]:     <acpi/>
Jul 31 15:03:07 user nova-compute[72239]:     <apic/>
Jul 31 15:03:07 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 15:03:07 user nova-compute[72239]:   </features>
Jul 31 15:03:07 user nova-compute[72239]:   <clock offset="utc">
Jul 31 15:03:07 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 15:03:07 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 15:03:07 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 15:03:07 user nova-compute[72239]:   </clock>
Jul 31 15:03:07 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 15:03:07 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 15:03:07 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 15:03:07 user nova-compute[72239]:   </cpu>
Jul 31 15:03:07 user nova-compute[72239]:   <devices>
Jul 31 15:03:07 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 15:03:07 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 15:03:07 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/b8652db6-b595-497f-a55d-8c0520bc18aa/disk"/>
Jul 31 15:03:07 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 15:03:07 user nova-compute[72239]:     </disk>
Jul 31 15:03:07 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 15:03:07 user nova-compute[72239]:       <mac address="fa:16:3e:9c:a0:63"/>
Jul 31 15:03:07 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:03:07 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 15:03:07 user nova-compute[72239]:       <target dev="tap7c709373-3d"/>
Jul 31 15:03:07 user nova-compute[72239]:     </interface>
Jul 31 15:03:07 user nova-compute[72239]:     <serial type="pty">
Jul 31 15:03:07 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/b8652db6-b595-497f-a55d-8c0520bc18aa/console.log" append="off"/>
Jul 31 15:03:07 user nova-compute[72239]:     </serial>
Jul 31 15:03:07 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 15:03:07 user nova-compute[72239]:     <video>
Jul 31 15:03:07 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:03:07 user nova-compute[72239]:     </video>
Jul 31 15:03:07 user nova-compute[72239]:     <rng model="virtio">
Jul 31 15:03:07 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 15:03:07 user nova-compute[72239]:     </rng>
Jul 31 15:03:07 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 15:03:07 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 15:03:07 user nova-compute[72239]:       <stats period="10"/>
Jul 31 15:03:07 user nova-compute[72239]:     </memballoon>
Jul 31 15:03:07 user nova-compute[72239]:   </devices>
Jul 31 15:03:07 user nova-compute[72239]: </domain>
Jul 31 15:03:07 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 15:03:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T14:59:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1746021859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1746021859',id=32,image_ref='b5e2ca71-1407-474a-89c7-c113c1c4a1a7',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1252123597',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:59:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='5a6715a7ff38401d844b620cb8d8769e',ramdisk_id='',reservation_id='r-twj02w4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-599528407',owner_user_name='tempest-AttachVolumeShelveTestJSON-599528407-project-member',shelved_at='2023-07-31T15:01:11.282619',shelved_host='user',shelved_image_id='b5e2ca71-1407-474a-89c7-c113c1c4a1a7'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T15:03:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70c6001a7ac5434fbc5ac7d003edd4eb',uuid=b8652db6-b595-497f-a55d-8c0520bc18aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7c709373-3d22-47b8-84d4-2a66ab39628a", "address": "fa:16:3e:9c:a0:63", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c709373-3d", "ovs_interfaceid": "7c709373-3d22-47b8-84d4-2a66ab39628a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 15:03:07 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Converting VIF {"id": "7c709373-3d22-47b8-84d4-2a66ab39628a", "address": "fa:16:3e:9c:a0:63", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c709373-3d", "ovs_interfaceid": "7c709373-3d22-47b8-84d4-2a66ab39628a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:03:07 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:a0:63,bridge_name='br-int',has_traffic_filtering=True,id=7c709373-3d22-47b8-84d4-2a66ab39628a,network=Network(37a946a3-d20a-4694-8647-73e84d2b0cb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c709373-3d') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:03:07 user nova-compute[72239]: DEBUG os_vif [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:a0:63,bridge_name='br-int',has_traffic_filtering=True,id=7c709373-3d22-47b8-84d4-2a66ab39628a,network=Network(37a946a3-d20a-4694-8647-73e84d2b0cb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c709373-3d') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 15:03:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:03:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 15:03:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c709373-3d, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:03:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7c709373-3d, col_values=(('external_ids', {'iface-id': '7c709373-3d22-47b8-84d4-2a66ab39628a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:a0:63', 'vm-uuid': 'b8652db6-b595-497f-a55d-8c0520bc18aa'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:03:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:03:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:07 user nova-compute[72239]: INFO os_vif [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:a0:63,bridge_name='br-int',has_traffic_filtering=True,id=7c709373-3d22-47b8-84d4-2a66ab39628a,network=Network(37a946a3-d20a-4694-8647-73e84d2b0cb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c709373-3d')
Jul 31 15:03:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:03:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] No VIF found with MAC fa:16:3e:9c:a0:63, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-90b1ea9b-8e05-4d17-8a8e-a0af98d2d38d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Acquiring lock "0a89aa93-374f-4487-893b-58c15d42c84c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-90b1ea9b-8e05-4d17-8a8e-a0af98d2d38d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "0a89aa93-374f-4487-893b-58c15d42c84c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:03:08 user nova-compute[72239]: INFO nova.compute.manager [None req-90b1ea9b-8e05-4d17-8a8e-a0af98d2d38d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Detaching volume e9aa4b80-b6b3-4722-8ac8-03d905074747
Jul 31 15:03:08 user nova-compute[72239]: INFO nova.virt.block_device [None req-90b1ea9b-8e05-4d17-8a8e-a0af98d2d38d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Attempting to driver detach volume e9aa4b80-b6b3-4722-8ac8-03d905074747 from mountpoint /dev/vdb
Jul 31 15:03:08 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-90b1ea9b-8e05-4d17-8a8e-a0af98d2d38d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Attempting to detach device vdb from instance 0a89aa93-374f-4487-893b-58c15d42c84c from the persistent domain config. {{(pid=72239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-90b1ea9b-8e05-4d17-8a8e-a0af98d2d38d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 15:03:08 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:03:08 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 15:03:08 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 15:03:08 user nova-compute[72239]:   <serial>e9aa4b80-b6b3-4722-8ac8-03d905074747</serial>
Jul 31 15:03:08 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 15:03:08 user nova-compute[72239]: </disk>
Jul 31 15:03:08 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 15:03:08 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-90b1ea9b-8e05-4d17-8a8e-a0af98d2d38d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Successfully detached device vdb from instance 0a89aa93-374f-4487-893b-58c15d42c84c from the persistent domain config.
Jul 31 15:03:08 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-90b1ea9b-8e05-4d17-8a8e-a0af98d2d38d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0a89aa93-374f-4487-893b-58c15d42c84c from the live domain config. {{(pid=72239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-90b1ea9b-8e05-4d17-8a8e-a0af98d2d38d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 15:03:08 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:03:08 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 15:03:08 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 15:03:08 user nova-compute[72239]:   <serial>e9aa4b80-b6b3-4722-8ac8-03d905074747</serial>
Jul 31 15:03:08 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 15:03:08 user nova-compute[72239]: </disk>
Jul 31 15:03:08 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Received event <DeviceRemovedEvent: 1690815788.6725228, 0a89aa93-374f-4487-893b-58c15d42c84c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72239) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-90b1ea9b-8e05-4d17-8a8e-a0af98d2d38d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0a89aa93-374f-4487-893b-58c15d42c84c {{(pid=72239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 15:03:08 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-90b1ea9b-8e05-4d17-8a8e-a0af98d2d38d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Successfully detached device vdb from instance 0a89aa93-374f-4487-893b-58c15d42c84c from the live domain config.
Jul 31 15:03:08 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90b1ea9b-8e05-4d17-8a8e-a0af98d2d38d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b1ea9b-8e05-4d17-8a8e-a0af98d2d38d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CyRbhqlQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:03:08 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-90b1ea9b-8e05-4d17-8a8e-a0af98d2d38d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:03:08 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-90b1ea9b-8e05-4d17-8a8e-a0af98d2d38d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-90b1ea9b-8e05-4d17-8a8e-a0af98d2d38d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b1ea9b-8e05-4d17-8a8e-a0af98d2d38d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG nova.compute.manager [req-bec2e1cc-e45a-446f-aaae-a8421f191e31 req-59239a00-2341-462e-82bd-326f95dc8a3b service nova] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Received event network-vif-plugged-7c709373-3d22-47b8-84d4-2a66ab39628a {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-bec2e1cc-e45a-446f-aaae-a8421f191e31 req-59239a00-2341-462e-82bd-326f95dc8a3b service nova] Acquiring lock "b8652db6-b595-497f-a55d-8c0520bc18aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-bec2e1cc-e45a-446f-aaae-a8421f191e31 req-59239a00-2341-462e-82bd-326f95dc8a3b service nova] Lock "b8652db6-b595-497f-a55d-8c0520bc18aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-bec2e1cc-e45a-446f-aaae-a8421f191e31 req-59239a00-2341-462e-82bd-326f95dc8a3b service nova] Lock "b8652db6-b595-497f-a55d-8c0520bc18aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG nova.compute.manager [req-bec2e1cc-e45a-446f-aaae-a8421f191e31 req-59239a00-2341-462e-82bd-326f95dc8a3b service nova] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] No waiting events found dispatching network-vif-plugged-7c709373-3d22-47b8-84d4-2a66ab39628a {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:03:08 user nova-compute[72239]: WARNING nova.compute.manager [req-bec2e1cc-e45a-446f-aaae-a8421f191e31 req-59239a00-2341-462e-82bd-326f95dc8a3b service nova] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Received unexpected event network-vif-plugged-7c709373-3d22-47b8-84d4-2a66ab39628a for instance with vm_state shelved_offloaded and task_state spawning.
Jul 31 15:03:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[67ba2a1f-d3aa-444f-bcfb-d5b5d2c0be0a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d300df45-77d4-41ba-a0fa-de6ef47b7c01]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b1ea9b-8e05-4d17-8a8e-a0af98d2d38d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 15:03:08 user nova-compute[72239]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747 (non-flash)
Jul 31 15:03:08 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b1ea9b-8e05-4d17-8a8e-a0af98d2d38d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 15:03:08 user nova-compute[72239]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747 (non-flash)
Jul 31 15:03:08 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b1ea9b-8e05-4d17-8a8e-a0af98d2d38d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41204a6200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747'): ({'sdb'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-90b1ea9b-8e05-4d17-8a8e-a0af98d2d38d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Removing single pathed devices sdb {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea8fa3f-a496-40bf-80c7-2a7da9d12454]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[822faa7d-4cac-4bb1-a11f-6721555e7f99]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-90b1ea9b-8e05-4d17-8a8e-a0af98d2d38d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Flushing IO for device /dev/sdb {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8f6f97-5e68-4db8-8d7c-5eeecb08ad14]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-90b1ea9b-8e05-4d17-8a8e-a0af98d2d38d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f931b3-cd09-4c1a-8ec1-56b131c6f31a]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-90b1ea9b-8e05-4d17-8a8e-a0af98d2d38d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-90b1ea9b-8e05-4d17-8a8e-a0af98d2d38d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b1ea9b-8e05-4d17-8a8e-a0af98d2d38d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e972da1-2bed-4c62-863b-930f6877582a]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b1ea9b-8e05-4d17-8a8e-a0af98d2d38d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747 -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c8f0a2-7393-4625-8c3e-f1ea18b28c00]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b1ea9b-8e05-4d17-8a8e-a0af98d2d38d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747, portal: 172.16.0.220,3260]
Jul 31 15:03:08 user nova-compute[72239]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747, portal: 172.16.0.220,3260] successful.
Jul 31 15:03:08 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747 -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e9aa4b80-b6b3-4722-8ac8-03d905074747 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[60594728-43df-4eb4-8181-b30182a9e5bd]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b1ea9b-8e05-4d17-8a8e-a0af98d2d38d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-90b1ea9b-8e05-4d17-8a8e-a0af98d2d38d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-90b1ea9b-8e05-4d17-8a8e-a0af98d2d38d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] <== disconnect_volume: return (300ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:03:08 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90b1ea9b-8e05-4d17-8a8e-a0af98d2d38d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 15:03:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:09 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:03:09 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 15:03:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-3d70608b-fc54-4178-9aa6-98ca6198a37b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:03:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-3d70608b-fc54-4178-9aa6-98ca6198a37b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:03:09 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 15:03:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:09 user nova-compute[72239]: DEBUG nova.objects.instance [None req-90b1ea9b-8e05-4d17-8a8e-a0af98d2d38d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lazy-loading 'flavor' on Instance uuid 0a89aa93-374f-4487-893b-58c15d42c84c {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:03:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-90b1ea9b-8e05-4d17-8a8e-a0af98d2d38d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "0a89aa93-374f-4487-893b-58c15d42c84c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.857s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:03:10 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Updating instance_info_cache with network_info: [{"id": "d115f55c-2a02-4b41-88b0-0922039e58ba", "address": "fa:16:3e:15:91:63", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115f55c-2a", "ovs_interfaceid": "d115f55c-2a02-4b41-88b0-0922039e58ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:03:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-3d70608b-fc54-4178-9aa6-98ca6198a37b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:03:10 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 15:03:10 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:03:10 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:03:10 user nova-compute[72239]: DEBUG nova.compute.manager [req-69cb1fe0-b093-429b-bc03-343447811515 req-a26b8fbf-30cc-44d6-a86e-2e536766a698 service nova] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Received event network-vif-plugged-7c709373-3d22-47b8-84d4-2a66ab39628a {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:03:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-69cb1fe0-b093-429b-bc03-343447811515 req-a26b8fbf-30cc-44d6-a86e-2e536766a698 service nova] Acquiring lock "b8652db6-b595-497f-a55d-8c0520bc18aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:03:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-69cb1fe0-b093-429b-bc03-343447811515 req-a26b8fbf-30cc-44d6-a86e-2e536766a698 service nova] Lock "b8652db6-b595-497f-a55d-8c0520bc18aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:03:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-69cb1fe0-b093-429b-bc03-343447811515 req-a26b8fbf-30cc-44d6-a86e-2e536766a698 service nova] Lock "b8652db6-b595-497f-a55d-8c0520bc18aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:03:10 user nova-compute[72239]: DEBUG nova.compute.manager [req-69cb1fe0-b093-429b-bc03-343447811515 req-a26b8fbf-30cc-44d6-a86e-2e536766a698 service nova] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] No waiting events found dispatching network-vif-plugged-7c709373-3d22-47b8-84d4-2a66ab39628a {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:03:10 user nova-compute[72239]: WARNING nova.compute.manager [req-69cb1fe0-b093-429b-bc03-343447811515 req-a26b8fbf-30cc-44d6-a86e-2e536766a698 service nova] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Received unexpected event network-vif-plugged-7c709373-3d22-47b8-84d4-2a66ab39628a for instance with vm_state shelved_offloaded and task_state spawning.
Jul 31 15:03:11 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815791.0279605, b8652db6-b595-497f-a55d-8c0520bc18aa => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:03:11 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] VM Resumed (Lifecycle Event)
Jul 31 15:03:11 user nova-compute[72239]: DEBUG nova.compute.manager [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 15:03:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 15:03:11 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Instance spawned successfully.
Jul 31 15:03:11 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:03:11 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:03:11 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 15:03:11 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815791.032442, b8652db6-b595-497f-a55d-8c0520bc18aa => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:03:11 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] VM Started (Lifecycle Event)
Jul 31 15:03:11 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:03:11 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:03:11 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 15:03:11 user nova-compute[72239]: DEBUG nova.compute.manager [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:03:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-817a7ce6-ec4a-4f60-adfa-3ce4f53b649b tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "b8652db6-b595-497f-a55d-8c0520bc18aa" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.682s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:03:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:13 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:03:13 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:03:13 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:03:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "04eeae20-361e-4ac1-84be-e25cec586f76" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:03:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "04eeae20-361e-4ac1-84be-e25cec586f76" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:03:15 user nova-compute[72239]: DEBUG nova.compute.manager [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 15:03:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:03:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:03:15 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 15:03:15 user nova-compute[72239]: INFO nova.compute.claims [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Claim successful on node user
Jul 31 15:03:16 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:03:16 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:03:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.371s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:03:16 user nova-compute[72239]: DEBUG nova.compute.manager [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 15:03:16 user nova-compute[72239]: DEBUG nova.compute.manager [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 15:03:16 user nova-compute[72239]: DEBUG nova.network.neutron [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 15:03:16 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 15:03:16 user nova-compute[72239]: DEBUG nova.compute.manager [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 15:03:16 user nova-compute[72239]: DEBUG nova.policy [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '99f609389e884d5490ba160d9fff28e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48e4fe9e81724b9cb6b9d73748f9bdee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 15:03:16 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:03:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:03:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:03:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:03:16 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 15:03:16 user nova-compute[72239]: DEBUG nova.compute.manager [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 15:03:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 15:03:16 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Creating image(s)
Jul 31 15:03:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "/opt/stack/data/nova/instances/04eeae20-361e-4ac1-84be-e25cec586f76/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:03:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "/opt/stack/data/nova/instances/04eeae20-361e-4ac1-84be-e25cec586f76/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:03:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "/opt/stack/data/nova/instances/04eeae20-361e-4ac1-84be-e25cec586f76/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:03:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.159s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "ca449065000c92aac3b7b9fa685f9a7710929444" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:03:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:03:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.168s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/04eeae20-361e-4ac1-84be-e25cec586f76/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/04eeae20-361e-4ac1-84be-e25cec586f76/disk 1073741824" returned: 0 in 0.077s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.288s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:03:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8652db6-b595-497f-a55d-8c0520bc18aa/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.187s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:17 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Checking if we can resize image /opt/stack/data/nova/instances/04eeae20-361e-4ac1-84be-e25cec586f76/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 15:03:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04eeae20-361e-4ac1-84be-e25cec586f76/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8652db6-b595-497f-a55d-8c0520bc18aa/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8652db6-b595-497f-a55d-8c0520bc18aa/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:17 user nova-compute[72239]: DEBUG nova.network.neutron [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Successfully created port: f41e1aaf-748e-4124-853d-b77e0c79ce72 {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 15:03:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04eeae20-361e-4ac1-84be-e25cec586f76/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:17 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Cannot resize image /opt/stack/data/nova/instances/04eeae20-361e-4ac1-84be-e25cec586f76/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 15:03:17 user nova-compute[72239]: DEBUG nova.objects.instance [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lazy-loading 'migration_context' on Instance uuid 04eeae20-361e-4ac1-84be-e25cec586f76 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:03:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 15:03:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Ensure instance console log exists: /opt/stack/data/nova/instances/04eeae20-361e-4ac1-84be-e25cec586f76/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 15:03:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:03:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:03:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:03:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8652db6-b595-497f-a55d-8c0520bc18aa/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 15:03:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/824b19e8-b4af-4fd4-a1ef-f214e25caef2/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/824b19e8-b4af-4fd4-a1ef-f214e25caef2/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/824b19e8-b4af-4fd4-a1ef-f214e25caef2/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/824b19e8-b4af-4fd4-a1ef-f214e25caef2/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:18 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:18 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:18 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:18 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:18 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:18 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:03:18 user nova-compute[72239]: DEBUG nova.network.neutron [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Successfully updated port: f41e1aaf-748e-4124-853d-b77e0c79ce72 {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 15:03:18 user nova-compute[72239]: DEBUG nova.compute.manager [req-13dea2a6-bab9-472a-9f15-42c0c1cdc310 req-a75ee93c-0dac-4869-8e1b-673f771237e4 service nova] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Received event network-changed-f41e1aaf-748e-4124-853d-b77e0c79ce72 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:03:18 user nova-compute[72239]: DEBUG nova.compute.manager [req-13dea2a6-bab9-472a-9f15-42c0c1cdc310 req-a75ee93c-0dac-4869-8e1b-673f771237e4 service nova] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Refreshing instance network info cache due to event network-changed-f41e1aaf-748e-4124-853d-b77e0c79ce72. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:03:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-13dea2a6-bab9-472a-9f15-42c0c1cdc310 req-a75ee93c-0dac-4869-8e1b-673f771237e4 service nova] Acquiring lock "refresh_cache-04eeae20-361e-4ac1-84be-e25cec586f76" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:03:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-13dea2a6-bab9-472a-9f15-42c0c1cdc310 req-a75ee93c-0dac-4869-8e1b-673f771237e4 service nova] Acquired lock "refresh_cache-04eeae20-361e-4ac1-84be-e25cec586f76" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:03:18 user nova-compute[72239]: DEBUG nova.network.neutron [req-13dea2a6-bab9-472a-9f15-42c0c1cdc310 req-a75ee93c-0dac-4869-8e1b-673f771237e4 service nova] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Refreshing network info cache for port f41e1aaf-748e-4124-853d-b77e0c79ce72 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:03:18 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:03:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "refresh_cache-04eeae20-361e-4ac1-84be-e25cec586f76" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:03:19 user nova-compute[72239]: DEBUG nova.network.neutron [req-13dea2a6-bab9-472a-9f15-42c0c1cdc310 req-a75ee93c-0dac-4869-8e1b-673f771237e4 service nova] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 15:03:19 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:03:19 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:03:19 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=7844MB free_disk=25.154197692871094GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 15:03:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:03:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:03:19 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 20abf743-de5b-4122-aad0-e2124c7804b7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:03:19 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance c10918e9-9731-48ea-860e-8a02cb6a0ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:03:19 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 3d70608b-fc54-4178-9aa6-98ca6198a37b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:03:19 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 0a89aa93-374f-4487-893b-58c15d42c84c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:03:19 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance f98cea94-e905-47c5-bf88-5f5694934966 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:03:19 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 824b19e8-b4af-4fd4-a1ef-f214e25caef2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:03:19 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance b8652db6-b595-497f-a55d-8c0520bc18aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:03:19 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 04eeae20-361e-4ac1-84be-e25cec586f76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:03:19 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 15:03:19 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 15:03:19 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:03:19 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:03:19 user nova-compute[72239]: DEBUG nova.network.neutron [req-13dea2a6-bab9-472a-9f15-42c0c1cdc310 req-a75ee93c-0dac-4869-8e1b-673f771237e4 service nova] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:03:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-13dea2a6-bab9-472a-9f15-42c0c1cdc310 req-a75ee93c-0dac-4869-8e1b-673f771237e4 service nova] Releasing lock "refresh_cache-04eeae20-361e-4ac1-84be-e25cec586f76" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:03:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquired lock "refresh_cache-04eeae20-361e-4ac1-84be-e25cec586f76" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:03:19 user nova-compute[72239]: DEBUG nova.network.neutron [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 15:03:19 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 15:03:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.415s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:03:19 user nova-compute[72239]: DEBUG nova.network.neutron [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 15:03:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:19 user nova-compute[72239]: DEBUG nova.network.neutron [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Updating instance_info_cache with network_info: [{"id": "f41e1aaf-748e-4124-853d-b77e0c79ce72", "address": "fa:16:3e:9b:c2:3f", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf41e1aaf-74", "ovs_interfaceid": "f41e1aaf-748e-4124-853d-b77e0c79ce72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:03:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Releasing lock "refresh_cache-04eeae20-361e-4ac1-84be-e25cec586f76" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:03:20 user nova-compute[72239]: DEBUG nova.compute.manager [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Instance network_info: |[{"id": "f41e1aaf-748e-4124-853d-b77e0c79ce72", "address": "fa:16:3e:9b:c2:3f", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf41e1aaf-74", "ovs_interfaceid": "f41e1aaf-748e-4124-853d-b77e0c79ce72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 15:03:20 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Start _get_guest_xml network_info=[{"id": "f41e1aaf-748e-4124-853d-b77e0c79ce72", "address": "fa:16:3e:9b:c2:3f", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf41e1aaf-74", "ovs_interfaceid": "f41e1aaf-748e-4124-853d-b77e0c79ce72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 15:03:20 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:03:20 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:03:20 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 15:03:20 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 15:03:20 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 15:03:20 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 15:03:20 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 15:03:20 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 15:03:20 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 15:03:20 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 15:03:20 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 15:03:20 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 15:03:20 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 15:03:20 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 15:03:20 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 15:03:20 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 15:03:20 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 15:03:20 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 15:03:20 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:03:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1088042679',display_name='tempest-AttachVolumeNegativeTest-server-1088042679',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1088042679',id=38,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH85RefiIXv4cRkaNqXj0ai4KZWx1j8kN2Jz+6i3TKFWbXcU6EETmV4Ctuf8HD628TGk4SER7z4QSo+CQn4LKb/YHCxwWQbrdah8nHZ1CPiI+WhVxtF+ajhIA09aKFZ+xA==',key_name='tempest-keypair-1325963297',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48e4fe9e81724b9cb6b9d73748f9bdee',ramdisk_id='',reservation_id='r-vz39e0gw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-620954585',owner_user_name='tempest-AttachVolumeNegativeTest-620954585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T15:03:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99f609389e884d5490ba160d9fff28e3',uuid=04eeae20-361e-4ac1-84be-e25cec586f76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f41e1aaf-748e-4124-853d-b77e0c79ce72", "address": "fa:16:3e:9b:c2:3f", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf41e1aaf-74", "ovs_interfaceid": "f41e1aaf-748e-4124-853d-b77e0c79ce72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 15:03:20 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Converting VIF {"id": "f41e1aaf-748e-4124-853d-b77e0c79ce72", "address": "fa:16:3e:9b:c2:3f", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf41e1aaf-74", "ovs_interfaceid": "f41e1aaf-748e-4124-853d-b77e0c79ce72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:03:20 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:c2:3f,bridge_name='br-int',has_traffic_filtering=True,id=f41e1aaf-748e-4124-853d-b77e0c79ce72,network=Network(f83cfb34-b1ca-4a7c-9a36-3654372585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf41e1aaf-74') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:03:20 user nova-compute[72239]: DEBUG nova.objects.instance [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lazy-loading 'pci_devices' on Instance uuid 04eeae20-361e-4ac1-84be-e25cec586f76 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:03:20 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] End _get_guest_xml xml=<domain type="kvm">
Jul 31 15:03:20 user nova-compute[72239]:   <uuid>04eeae20-361e-4ac1-84be-e25cec586f76</uuid>
Jul 31 15:03:20 user nova-compute[72239]:   <name>instance-00000026</name>
Jul 31 15:03:20 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 15:03:20 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 15:03:20 user nova-compute[72239]:   <metadata>
Jul 31 15:03:20 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 15:03:20 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 15:03:20 user nova-compute[72239]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1088042679</nova:name>
Jul 31 15:03:20 user nova-compute[72239]:       <nova:creationTime>2023-07-31 15:03:20</nova:creationTime>
Jul 31 15:03:20 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 15:03:20 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 15:03:20 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 15:03:20 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 15:03:20 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 15:03:20 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 15:03:20 user nova-compute[72239]:       </nova:flavor>
Jul 31 15:03:20 user nova-compute[72239]:       <nova:owner>
Jul 31 15:03:20 user nova-compute[72239]:         <nova:user uuid="99f609389e884d5490ba160d9fff28e3">tempest-AttachVolumeNegativeTest-620954585-project-member</nova:user>
Jul 31 15:03:20 user nova-compute[72239]:         <nova:project uuid="48e4fe9e81724b9cb6b9d73748f9bdee">tempest-AttachVolumeNegativeTest-620954585</nova:project>
Jul 31 15:03:20 user nova-compute[72239]:       </nova:owner>
Jul 31 15:03:20 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 15:03:20 user nova-compute[72239]:       <nova:ports>
Jul 31 15:03:20 user nova-compute[72239]:         <nova:port uuid="f41e1aaf-748e-4124-853d-b77e0c79ce72">
Jul 31 15:03:20 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 31 15:03:20 user nova-compute[72239]:         </nova:port>
Jul 31 15:03:20 user nova-compute[72239]:       </nova:ports>
Jul 31 15:03:20 user nova-compute[72239]:     </nova:instance>
Jul 31 15:03:20 user nova-compute[72239]:   </metadata>
Jul 31 15:03:20 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 15:03:20 user nova-compute[72239]:     <system>
Jul 31 15:03:20 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 15:03:20 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 15:03:20 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 15:03:20 user nova-compute[72239]:       <entry name="serial">04eeae20-361e-4ac1-84be-e25cec586f76</entry>
Jul 31 15:03:20 user nova-compute[72239]:       <entry name="uuid">04eeae20-361e-4ac1-84be-e25cec586f76</entry>
Jul 31 15:03:20 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 15:03:20 user nova-compute[72239]:     </system>
Jul 31 15:03:20 user nova-compute[72239]:   </sysinfo>
Jul 31 15:03:20 user nova-compute[72239]:   <os>
Jul 31 15:03:20 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 15:03:20 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 15:03:20 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 15:03:20 user nova-compute[72239]:   </os>
Jul 31 15:03:20 user nova-compute[72239]:   <features>
Jul 31 15:03:20 user nova-compute[72239]:     <acpi/>
Jul 31 15:03:20 user nova-compute[72239]:     <apic/>
Jul 31 15:03:20 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 15:03:20 user nova-compute[72239]:   </features>
Jul 31 15:03:20 user nova-compute[72239]:   <clock offset="utc">
Jul 31 15:03:20 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 15:03:20 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 15:03:20 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 15:03:20 user nova-compute[72239]:   </clock>
Jul 31 15:03:20 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 15:03:20 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 15:03:20 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 15:03:20 user nova-compute[72239]:   </cpu>
Jul 31 15:03:20 user nova-compute[72239]:   <devices>
Jul 31 15:03:20 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 15:03:20 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 15:03:20 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/04eeae20-361e-4ac1-84be-e25cec586f76/disk"/>
Jul 31 15:03:20 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 15:03:20 user nova-compute[72239]:     </disk>
Jul 31 15:03:20 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 15:03:20 user nova-compute[72239]:       <mac address="fa:16:3e:9b:c2:3f"/>
Jul 31 15:03:20 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:03:20 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 15:03:20 user nova-compute[72239]:       <target dev="tapf41e1aaf-74"/>
Jul 31 15:03:20 user nova-compute[72239]:     </interface>
Jul 31 15:03:20 user nova-compute[72239]:     <serial type="pty">
Jul 31 15:03:20 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/04eeae20-361e-4ac1-84be-e25cec586f76/console.log" append="off"/>
Jul 31 15:03:20 user nova-compute[72239]:     </serial>
Jul 31 15:03:20 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 15:03:20 user nova-compute[72239]:     <video>
Jul 31 15:03:20 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:03:20 user nova-compute[72239]:     </video>
Jul 31 15:03:20 user nova-compute[72239]:     <rng model="virtio">
Jul 31 15:03:20 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 15:03:20 user nova-compute[72239]:     </rng>
Jul 31 15:03:20 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 15:03:20 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 15:03:20 user nova-compute[72239]:       <stats period="10"/>
Jul 31 15:03:20 user nova-compute[72239]:     </memballoon>
Jul 31 15:03:20 user nova-compute[72239]:   </devices>
Jul 31 15:03:20 user nova-compute[72239]: </domain>
Jul 31 15:03:20 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 15:03:20 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:03:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1088042679',display_name='tempest-AttachVolumeNegativeTest-server-1088042679',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1088042679',id=38,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH85RefiIXv4cRkaNqXj0ai4KZWx1j8kN2Jz+6i3TKFWbXcU6EETmV4Ctuf8HD628TGk4SER7z4QSo+CQn4LKb/YHCxwWQbrdah8nHZ1CPiI+WhVxtF+ajhIA09aKFZ+xA==',key_name='tempest-keypair-1325963297',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='48e4fe9e81724b9cb6b9d73748f9bdee',ramdisk_id='',reservation_id='r-vz39e0gw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-620954585',owner_user_name='tempest-AttachVolumeNegativeTest-620954585-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T15:03:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99f609389e884d5490ba160d9fff28e3',uuid=04eeae20-361e-4ac1-84be-e25cec586f76,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f41e1aaf-748e-4124-853d-b77e0c79ce72", "address": "fa:16:3e:9b:c2:3f", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf41e1aaf-74", "ovs_interfaceid": "f41e1aaf-748e-4124-853d-b77e0c79ce72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 15:03:20 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Converting VIF {"id": "f41e1aaf-748e-4124-853d-b77e0c79ce72", "address": "fa:16:3e:9b:c2:3f", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf41e1aaf-74", "ovs_interfaceid": "f41e1aaf-748e-4124-853d-b77e0c79ce72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:03:20 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:c2:3f,bridge_name='br-int',has_traffic_filtering=True,id=f41e1aaf-748e-4124-853d-b77e0c79ce72,network=Network(f83cfb34-b1ca-4a7c-9a36-3654372585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf41e1aaf-74') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:03:20 user nova-compute[72239]: DEBUG os_vif [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:c2:3f,bridge_name='br-int',has_traffic_filtering=True,id=f41e1aaf-748e-4124-853d-b77e0c79ce72,network=Network(f83cfb34-b1ca-4a7c-9a36-3654372585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf41e1aaf-74') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 15:03:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:03:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 15:03:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf41e1aaf-74, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:03:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf41e1aaf-74, col_values=(('external_ids', {'iface-id': 'f41e1aaf-748e-4124-853d-b77e0c79ce72', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:c2:3f', 'vm-uuid': '04eeae20-361e-4ac1-84be-e25cec586f76'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:03:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:03:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:20 user nova-compute[72239]: INFO os_vif [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:c2:3f,bridge_name='br-int',has_traffic_filtering=True,id=f41e1aaf-748e-4124-853d-b77e0c79ce72,network=Network(f83cfb34-b1ca-4a7c-9a36-3654372585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf41e1aaf-74')
Jul 31 15:03:20 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:03:20 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] No VIF found with MAC fa:16:3e:9b:c2:3f, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 15:03:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:21 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:21 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:21 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:21 user nova-compute[72239]: DEBUG nova.compute.manager [req-88b46dca-05e3-4077-84c9-8068b469849a req-591717f3-d410-4e75-ba22-27ea6f3bdd8c service nova] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Received event network-vif-plugged-f41e1aaf-748e-4124-853d-b77e0c79ce72 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:03:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-88b46dca-05e3-4077-84c9-8068b469849a req-591717f3-d410-4e75-ba22-27ea6f3bdd8c service nova] Acquiring lock "04eeae20-361e-4ac1-84be-e25cec586f76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:03:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-88b46dca-05e3-4077-84c9-8068b469849a req-591717f3-d410-4e75-ba22-27ea6f3bdd8c service nova] Lock "04eeae20-361e-4ac1-84be-e25cec586f76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:03:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-88b46dca-05e3-4077-84c9-8068b469849a req-591717f3-d410-4e75-ba22-27ea6f3bdd8c service nova] Lock "04eeae20-361e-4ac1-84be-e25cec586f76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:03:21 user nova-compute[72239]: DEBUG nova.compute.manager [req-88b46dca-05e3-4077-84c9-8068b469849a req-591717f3-d410-4e75-ba22-27ea6f3bdd8c service nova] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] No waiting events found dispatching network-vif-plugged-f41e1aaf-748e-4124-853d-b77e0c79ce72 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:03:21 user nova-compute[72239]: WARNING nova.compute.manager [req-88b46dca-05e3-4077-84c9-8068b469849a req-591717f3-d410-4e75-ba22-27ea6f3bdd8c service nova] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Received unexpected event network-vif-plugged-f41e1aaf-748e-4124-853d-b77e0c79ce72 for instance with vm_state building and task_state spawning.
Jul 31 15:03:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:22 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:03:22 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 15:03:23 user nova-compute[72239]: DEBUG nova.compute.manager [req-b1f987e3-c19e-4dfa-ad88-e84f2714f42c req-bf419845-f34a-45c2-a352-ad398e1b12c3 service nova] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Received event network-vif-plugged-f41e1aaf-748e-4124-853d-b77e0c79ce72 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:03:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b1f987e3-c19e-4dfa-ad88-e84f2714f42c req-bf419845-f34a-45c2-a352-ad398e1b12c3 service nova] Acquiring lock "04eeae20-361e-4ac1-84be-e25cec586f76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:03:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b1f987e3-c19e-4dfa-ad88-e84f2714f42c req-bf419845-f34a-45c2-a352-ad398e1b12c3 service nova] Lock "04eeae20-361e-4ac1-84be-e25cec586f76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:03:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b1f987e3-c19e-4dfa-ad88-e84f2714f42c req-bf419845-f34a-45c2-a352-ad398e1b12c3 service nova] Lock "04eeae20-361e-4ac1-84be-e25cec586f76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:03:23 user nova-compute[72239]: DEBUG nova.compute.manager [req-b1f987e3-c19e-4dfa-ad88-e84f2714f42c req-bf419845-f34a-45c2-a352-ad398e1b12c3 service nova] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] No waiting events found dispatching network-vif-plugged-f41e1aaf-748e-4124-853d-b77e0c79ce72 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:03:23 user nova-compute[72239]: WARNING nova.compute.manager [req-b1f987e3-c19e-4dfa-ad88-e84f2714f42c req-bf419845-f34a-45c2-a352-ad398e1b12c3 service nova] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Received unexpected event network-vif-plugged-f41e1aaf-748e-4124-853d-b77e0c79ce72 for instance with vm_state building and task_state spawning.
Jul 31 15:03:24 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815804.0170083, 04eeae20-361e-4ac1-84be-e25cec586f76 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:03:24 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] VM Resumed (Lifecycle Event)
Jul 31 15:03:24 user nova-compute[72239]: DEBUG nova.compute.manager [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 15:03:24 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 15:03:24 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Instance spawned successfully.
Jul 31 15:03:24 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 15:03:24 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:03:24 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:03:24 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:03:24 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:03:24 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:03:24 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:03:24 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:03:24 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:03:24 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 15:03:24 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815804.0209482, 04eeae20-361e-4ac1-84be-e25cec586f76 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:03:24 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] VM Started (Lifecycle Event)
Jul 31 15:03:24 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:03:24 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:03:24 user nova-compute[72239]: INFO nova.compute.manager [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Took 7.71 seconds to spawn the instance on the hypervisor.
Jul 31 15:03:24 user nova-compute[72239]: DEBUG nova.compute.manager [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:03:24 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 15:03:24 user nova-compute[72239]: INFO nova.compute.manager [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Took 8.42 seconds to build instance.
Jul 31 15:03:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e7a0a194-c0d7-48eb-9ae6-ae16e3f02a70 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "04eeae20-361e-4ac1-84be-e25cec586f76" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.539s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:03:24 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:25 user nova-compute[72239]: INFO nova.compute.manager [None req-9dfb6e58-2b04-42f6-9c69-53df8209992d tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Get console output
Jul 31 15:03:25 user nova-compute[72239]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Jul 31 15:03:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:30 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5f4e4f43-ab69-4e25-9397-e4bff5cd0f9f tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "20abf743-de5b-4122-aad0-e2124c7804b7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:03:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5f4e4f43-ab69-4e25-9397-e4bff5cd0f9f tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "20abf743-de5b-4122-aad0-e2124c7804b7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:03:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5f4e4f43-ab69-4e25-9397-e4bff5cd0f9f tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "20abf743-de5b-4122-aad0-e2124c7804b7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:03:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5f4e4f43-ab69-4e25-9397-e4bff5cd0f9f tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "20abf743-de5b-4122-aad0-e2124c7804b7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:03:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5f4e4f43-ab69-4e25-9397-e4bff5cd0f9f tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "20abf743-de5b-4122-aad0-e2124c7804b7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:03:33 user nova-compute[72239]: INFO nova.compute.manager [None req-5f4e4f43-ab69-4e25-9397-e4bff5cd0f9f tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Terminating instance
Jul 31 15:03:33 user nova-compute[72239]: DEBUG nova.compute.manager [None req-5f4e4f43-ab69-4e25-9397-e4bff5cd0f9f tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 15:03:33 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:34 user nova-compute[72239]: DEBUG nova.compute.manager [req-27013f7e-7231-463d-8c5f-18cba0bf80f3 req-d0e21e30-dc60-4995-b0fb-2065b6722067 service nova] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Received event network-vif-unplugged-025cadd3-7b0b-4a32-a973-d48a5ce7cfb4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:03:34 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-27013f7e-7231-463d-8c5f-18cba0bf80f3 req-d0e21e30-dc60-4995-b0fb-2065b6722067 service nova] Acquiring lock "20abf743-de5b-4122-aad0-e2124c7804b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:03:34 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-27013f7e-7231-463d-8c5f-18cba0bf80f3 req-d0e21e30-dc60-4995-b0fb-2065b6722067 service nova] Lock "20abf743-de5b-4122-aad0-e2124c7804b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:03:34 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-27013f7e-7231-463d-8c5f-18cba0bf80f3 req-d0e21e30-dc60-4995-b0fb-2065b6722067 service nova] Lock "20abf743-de5b-4122-aad0-e2124c7804b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:03:34 user nova-compute[72239]: DEBUG nova.compute.manager [req-27013f7e-7231-463d-8c5f-18cba0bf80f3 req-d0e21e30-dc60-4995-b0fb-2065b6722067 service nova] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] No waiting events found dispatching network-vif-unplugged-025cadd3-7b0b-4a32-a973-d48a5ce7cfb4 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:03:34 user nova-compute[72239]: DEBUG nova.compute.manager [req-27013f7e-7231-463d-8c5f-18cba0bf80f3 req-d0e21e30-dc60-4995-b0fb-2065b6722067 service nova] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Received event network-vif-unplugged-025cadd3-7b0b-4a32-a973-d48a5ce7cfb4 for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 15:03:34 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Instance destroyed successfully.
Jul 31 15:03:34 user nova-compute[72239]: DEBUG nova.objects.instance [None req-5f4e4f43-ab69-4e25-9397-e4bff5cd0f9f tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lazy-loading 'resources' on Instance uuid 20abf743-de5b-4122-aad0-e2124c7804b7 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:03:34 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-5f4e4f43-ab69-4e25-9397-e4bff5cd0f9f tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:43:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-162604998',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-162604998',id=1,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:44:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d8281237f9c417a9685e55826911e1b',ramdisk_id='',reservation_id='r-3m15iawb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-148379254',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:45:53Z,user_data=None,user_id='94ab9298205143d489f678b28be5b085',uuid=20abf743-de5b-4122-aad0-e2124c7804b7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "025cadd3-7b0b-4a32-a973-d48a5ce7cfb4", "address": "fa:16:3e:5e:74:46", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap025cadd3-7b", "ovs_interfaceid": "025cadd3-7b0b-4a32-a973-d48a5ce7cfb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 15:03:34 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-5f4e4f43-ab69-4e25-9397-e4bff5cd0f9f tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Converting VIF {"id": "025cadd3-7b0b-4a32-a973-d48a5ce7cfb4", "address": "fa:16:3e:5e:74:46", "network": {"id": "172fb80f-4bbe-4706-91cf-60540fbceb2b", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-910559959-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d8281237f9c417a9685e55826911e1b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap025cadd3-7b", "ovs_interfaceid": "025cadd3-7b0b-4a32-a973-d48a5ce7cfb4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:03:34 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-5f4e4f43-ab69-4e25-9397-e4bff5cd0f9f tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:74:46,bridge_name='br-int',has_traffic_filtering=True,id=025cadd3-7b0b-4a32-a973-d48a5ce7cfb4,network=Network(172fb80f-4bbe-4706-91cf-60540fbceb2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap025cadd3-7b') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:03:34 user nova-compute[72239]: DEBUG os_vif [None req-5f4e4f43-ab69-4e25-9397-e4bff5cd0f9f tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:74:46,bridge_name='br-int',has_traffic_filtering=True,id=025cadd3-7b0b-4a32-a973-d48a5ce7cfb4,network=Network(172fb80f-4bbe-4706-91cf-60540fbceb2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap025cadd3-7b') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 15:03:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap025cadd3-7b, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:03:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:03:34 user nova-compute[72239]: INFO os_vif [None req-5f4e4f43-ab69-4e25-9397-e4bff5cd0f9f tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:74:46,bridge_name='br-int',has_traffic_filtering=True,id=025cadd3-7b0b-4a32-a973-d48a5ce7cfb4,network=Network(172fb80f-4bbe-4706-91cf-60540fbceb2b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap025cadd3-7b')
Jul 31 15:03:34 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-5f4e4f43-ab69-4e25-9397-e4bff5cd0f9f tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Deleting instance files /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7_del
Jul 31 15:03:34 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-5f4e4f43-ab69-4e25-9397-e4bff5cd0f9f tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Deletion of /opt/stack/data/nova/instances/20abf743-de5b-4122-aad0-e2124c7804b7_del complete
Jul 31 15:03:34 user nova-compute[72239]: INFO nova.compute.manager [None req-5f4e4f43-ab69-4e25-9397-e4bff5cd0f9f tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Took 0.73 seconds to destroy the instance on the hypervisor.
Jul 31 15:03:34 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-5f4e4f43-ab69-4e25-9397-e4bff5cd0f9f tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 15:03:34 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 15:03:34 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 15:03:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:35 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:03:35 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Took 0.66 seconds to deallocate network for instance.
Jul 31 15:03:35 user nova-compute[72239]: DEBUG nova.compute.manager [req-5a1163b8-41a6-44b3-a3bb-5705a15ed73b req-185ce082-e6a6-4c1f-9e02-c4cbca073998 service nova] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Received event network-vif-deleted-025cadd3-7b0b-4a32-a973-d48a5ce7cfb4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:03:35 user nova-compute[72239]: INFO nova.compute.manager [req-5a1163b8-41a6-44b3-a3bb-5705a15ed73b req-185ce082-e6a6-4c1f-9e02-c4cbca073998 service nova] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Neutron deleted interface 025cadd3-7b0b-4a32-a973-d48a5ce7cfb4; detaching it from the instance and deleting it from the info cache
Jul 31 15:03:35 user nova-compute[72239]: DEBUG nova.network.neutron [req-5a1163b8-41a6-44b3-a3bb-5705a15ed73b req-185ce082-e6a6-4c1f-9e02-c4cbca073998 service nova] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:03:35 user nova-compute[72239]: DEBUG nova.compute.manager [req-5a1163b8-41a6-44b3-a3bb-5705a15ed73b req-185ce082-e6a6-4c1f-9e02-c4cbca073998 service nova] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Detach interface failed, port_id=025cadd3-7b0b-4a32-a973-d48a5ce7cfb4, reason: Instance 20abf743-de5b-4122-aad0-e2124c7804b7 could not be found. {{(pid=72239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 15:03:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5f4e4f43-ab69-4e25-9397-e4bff5cd0f9f tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:03:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5f4e4f43-ab69-4e25-9397-e4bff5cd0f9f tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:03:35 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-5f4e4f43-ab69-4e25-9397-e4bff5cd0f9f tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:03:35 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-5f4e4f43-ab69-4e25-9397-e4bff5cd0f9f tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:03:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5f4e4f43-ab69-4e25-9397-e4bff5cd0f9f tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.268s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:03:35 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-5f4e4f43-ab69-4e25-9397-e4bff5cd0f9f tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Deleted allocations for instance 20abf743-de5b-4122-aad0-e2124c7804b7
Jul 31 15:03:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5f4e4f43-ab69-4e25-9397-e4bff5cd0f9f tempest-ServerBootFromVolumeStableRescueTest-148379254 tempest-ServerBootFromVolumeStableRescueTest-148379254-project-member] Lock "20abf743-de5b-4122-aad0-e2124c7804b7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.863s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:03:36 user nova-compute[72239]: DEBUG nova.compute.manager [req-01ba26d9-4b38-49b6-a7e8-ab3a0331fab6 req-9f5459dd-20c5-474d-9670-1cbcccbc93b2 service nova] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Received event network-vif-plugged-025cadd3-7b0b-4a32-a973-d48a5ce7cfb4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:03:36 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-01ba26d9-4b38-49b6-a7e8-ab3a0331fab6 req-9f5459dd-20c5-474d-9670-1cbcccbc93b2 service nova] Acquiring lock "20abf743-de5b-4122-aad0-e2124c7804b7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:03:36 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-01ba26d9-4b38-49b6-a7e8-ab3a0331fab6 req-9f5459dd-20c5-474d-9670-1cbcccbc93b2 service nova] Lock "20abf743-de5b-4122-aad0-e2124c7804b7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:03:36 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-01ba26d9-4b38-49b6-a7e8-ab3a0331fab6 req-9f5459dd-20c5-474d-9670-1cbcccbc93b2 service nova] Lock "20abf743-de5b-4122-aad0-e2124c7804b7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:03:36 user nova-compute[72239]: DEBUG nova.compute.manager [req-01ba26d9-4b38-49b6-a7e8-ab3a0331fab6 req-9f5459dd-20c5-474d-9670-1cbcccbc93b2 service nova] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] No waiting events found dispatching network-vif-plugged-025cadd3-7b0b-4a32-a973-d48a5ce7cfb4 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:03:36 user nova-compute[72239]: WARNING nova.compute.manager [req-01ba26d9-4b38-49b6-a7e8-ab3a0331fab6 req-9f5459dd-20c5-474d-9670-1cbcccbc93b2 service nova] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Received unexpected event network-vif-plugged-025cadd3-7b0b-4a32-a973-d48a5ce7cfb4 for instance with vm_state deleted and task_state None.
Jul 31 15:03:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:49 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690815814.4904552, 20abf743-de5b-4122-aad0-e2124c7804b7 => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:03:49 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] VM Stopped (Lifecycle Event)
Jul 31 15:03:49 user nova-compute[72239]: DEBUG nova.compute.manager [None req-6ef537ba-7719-4e08-9fa3-6793e4884149 None None] [instance: 20abf743-de5b-4122-aad0-e2124c7804b7] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:03:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:03:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:03 user nova-compute[72239]: DEBUG nova.compute.manager [None req-dcb815ac-52d3-4c9d-8cce-ac03b5452588 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:04:03 user nova-compute[72239]: INFO nova.compute.manager [None req-dcb815ac-52d3-4c9d-8cce-ac03b5452588 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] instance snapshotting
Jul 31 15:04:03 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-dcb815ac-52d3-4c9d-8cce-ac03b5452588 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Beginning live snapshot process
Jul 31 15:04:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-dcb815ac-52d3-4c9d-8cce-ac03b5452588 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk --force-share --output=json -f qcow2 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-dcb815ac-52d3-4c9d-8cce-ac03b5452588 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk --force-share --output=json -f qcow2" returned: 0 in 0.135s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-dcb815ac-52d3-4c9d-8cce-ac03b5452588 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk --force-share --output=json -f qcow2 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-dcb815ac-52d3-4c9d-8cce-ac03b5452588 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk --force-share --output=json -f qcow2" returned: 0 in 0.135s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-dcb815ac-52d3-4c9d-8cce-ac03b5452588 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-dcb815ac-52d3-4c9d-8cce-ac03b5452588 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.138s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-dcb815ac-52d3-4c9d-8cce-ac03b5452588 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpgicg28ad/5bc68d299d254d01bfab2d4015b6c20c.delta 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-dcb815ac-52d3-4c9d-8cce-ac03b5452588 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpgicg28ad/5bc68d299d254d01bfab2d4015b6c20c.delta 1073741824" returned: 0 in 0.053s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:04 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-dcb815ac-52d3-4c9d-8cce-ac03b5452588 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 31 15:04:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:04:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-dcb815ac-52d3-4c9d-8cce-ac03b5452588 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=72239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 15:04:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-dcb815ac-52d3-4c9d-8cce-ac03b5452588 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=72239) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 31 15:04:05 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-dcb815ac-52d3-4c9d-8cce-ac03b5452588 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 31 15:04:05 user nova-compute[72239]: DEBUG nova.privsep.utils [None req-dcb815ac-52d3-4c9d-8cce-ac03b5452588 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72239) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 15:04:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-dcb815ac-52d3-4c9d-8cce-ac03b5452588 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpgicg28ad/5bc68d299d254d01bfab2d4015b6c20c.delta /opt/stack/data/nova/instances/snapshots/tmpgicg28ad/5bc68d299d254d01bfab2d4015b6c20c {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-dcb815ac-52d3-4c9d-8cce-ac03b5452588 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpgicg28ad/5bc68d299d254d01bfab2d4015b6c20c.delta /opt/stack/data/nova/instances/snapshots/tmpgicg28ad/5bc68d299d254d01bfab2d4015b6c20c" returned: 0 in 0.351s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:06 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-dcb815ac-52d3-4c9d-8cce-ac03b5452588 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Snapshot extracted, beginning image upload
Jul 31 15:04:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Acquiring lock "9ece926f-02cc-4909-80a2-6476885cc18a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:04:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Lock "9ece926f-02cc-4909-80a2-6476885cc18a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:04:07 user nova-compute[72239]: DEBUG nova.compute.manager [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 15:04:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:04:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:04:07 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 15:04:07 user nova-compute[72239]: INFO nova.compute.claims [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Claim successful on node user
Jul 31 15:04:07 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:04:07 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:04:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.396s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:04:07 user nova-compute[72239]: DEBUG nova.compute.manager [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 15:04:07 user nova-compute[72239]: DEBUG nova.compute.manager [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 15:04:07 user nova-compute[72239]: DEBUG nova.network.neutron [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 15:04:07 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 15:04:07 user nova-compute[72239]: DEBUG nova.compute.manager [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 15:04:07 user nova-compute[72239]: DEBUG nova.policy [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21222ab2b99941978eb3c3e511547e65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '36f4d01080114839b14b23997a4dc1f3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 15:04:07 user nova-compute[72239]: DEBUG nova.compute.manager [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 15:04:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 15:04:07 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Creating image(s)
Jul 31 15:04:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ece926f-02cc-4909-80a2-6476885cc18a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:04:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Lock "/opt/stack/data/nova/instances/9ece926f-02cc-4909-80a2-6476885cc18a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:04:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Lock "/opt/stack/data/nova/instances/9ece926f-02cc-4909-80a2-6476885cc18a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:04:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.169s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Acquiring lock "ca449065000c92aac3b7b9fa685f9a7710929444" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:04:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:04:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.177s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/9ece926f-02cc-4909-80a2-6476885cc18a/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/9ece926f-02cc-4909-80a2-6476885cc18a/disk 1073741824" returned: 0 in 0.060s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:04:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.153s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:08 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ece926f-02cc-4909-80a2-6476885cc18a/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 15:04:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ece926f-02cc-4909-80a2-6476885cc18a/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:08 user nova-compute[72239]: DEBUG nova.network.neutron [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Successfully created port: aa6c04e0-092c-418b-bd4d-30123e4d9643 {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 15:04:08 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ece926f-02cc-4909-80a2-6476885cc18a/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:08 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Cannot resize image /opt/stack/data/nova/instances/9ece926f-02cc-4909-80a2-6476885cc18a/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 15:04:08 user nova-compute[72239]: DEBUG nova.objects.instance [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Lazy-loading 'migration_context' on Instance uuid 9ece926f-02cc-4909-80a2-6476885cc18a {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:04:08 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 15:04:08 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Ensure instance console log exists: /opt/stack/data/nova/instances/9ece926f-02cc-4909-80a2-6476885cc18a/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 15:04:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:04:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:04:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:04:08 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-dcb815ac-52d3-4c9d-8cce-ac03b5452588 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Snapshot image upload complete
Jul 31 15:04:08 user nova-compute[72239]: INFO nova.compute.manager [None req-dcb815ac-52d3-4c9d-8cce-ac03b5452588 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Took 4.97 seconds to snapshot the instance on the hypervisor.
Jul 31 15:04:09 user nova-compute[72239]: DEBUG nova.network.neutron [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Successfully updated port: aa6c04e0-092c-418b-bd4d-30123e4d9643 {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Acquiring lock "refresh_cache-9ece926f-02cc-4909-80a2-6476885cc18a" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Acquired lock "refresh_cache-9ece926f-02cc-4909-80a2-6476885cc18a" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG nova.network.neutron [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG nova.compute.manager [req-a1ed2b17-d2fc-4c80-a82f-4142a48a4c19 req-b01c463a-8ab4-4a4d-83b8-2e874ef779f8 service nova] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Received event network-changed-aa6c04e0-092c-418b-bd4d-30123e4d9643 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG nova.compute.manager [req-a1ed2b17-d2fc-4c80-a82f-4142a48a4c19 req-b01c463a-8ab4-4a4d-83b8-2e874ef779f8 service nova] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Refreshing instance network info cache due to event network-changed-aa6c04e0-092c-418b-bd4d-30123e4d9643. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a1ed2b17-d2fc-4c80-a82f-4142a48a4c19 req-b01c463a-8ab4-4a4d-83b8-2e874ef779f8 service nova] Acquiring lock "refresh_cache-9ece926f-02cc-4909-80a2-6476885cc18a" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG nova.network.neutron [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Rebuilding the list of instances to heal {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Skipping network cache update for instance because it is Building. {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-c10918e9-9731-48ea-860e-8a02cb6a0ad9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-c10918e9-9731-48ea-860e-8a02cb6a0ad9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG nova.objects.instance [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lazy-loading 'info_cache' on Instance uuid c10918e9-9731-48ea-860e-8a02cb6a0ad9 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG nova.network.neutron [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Updating instance_info_cache with network_info: [{"id": "aa6c04e0-092c-418b-bd4d-30123e4d9643", "address": "fa:16:3e:8a:b2:e2", "network": {"id": "afcad268-9e48-452e-ae62-cbeaf3f538dd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-791822524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f4d01080114839b14b23997a4dc1f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa6c04e0-09", "ovs_interfaceid": "aa6c04e0-092c-418b-bd4d-30123e4d9643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Releasing lock "refresh_cache-9ece926f-02cc-4909-80a2-6476885cc18a" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG nova.compute.manager [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Instance network_info: |[{"id": "aa6c04e0-092c-418b-bd4d-30123e4d9643", "address": "fa:16:3e:8a:b2:e2", "network": {"id": "afcad268-9e48-452e-ae62-cbeaf3f538dd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-791822524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f4d01080114839b14b23997a4dc1f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa6c04e0-09", "ovs_interfaceid": "aa6c04e0-092c-418b-bd4d-30123e4d9643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a1ed2b17-d2fc-4c80-a82f-4142a48a4c19 req-b01c463a-8ab4-4a4d-83b8-2e874ef779f8 service nova] Acquired lock "refresh_cache-9ece926f-02cc-4909-80a2-6476885cc18a" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG nova.network.neutron [req-a1ed2b17-d2fc-4c80-a82f-4142a48a4c19 req-b01c463a-8ab4-4a4d-83b8-2e874ef779f8 service nova] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Refreshing network info cache for port aa6c04e0-092c-418b-bd4d-30123e4d9643 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Start _get_guest_xml network_info=[{"id": "aa6c04e0-092c-418b-bd4d-30123e4d9643", "address": "fa:16:3e:8a:b2:e2", "network": {"id": "afcad268-9e48-452e-ae62-cbeaf3f538dd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-791822524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f4d01080114839b14b23997a4dc1f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa6c04e0-09", "ovs_interfaceid": "aa6c04e0-092c-418b-bd4d-30123e4d9643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 15:04:09 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:04:09 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:04:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1390124767',display_name='tempest-ServersNegativeTestJSON-server-1390124767',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1390124767',id=39,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36f4d01080114839b14b23997a4dc1f3',ramdisk_id='',reservation_id='r-bdkru5mf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-628169841',owner_user_name='tempest-ServersNegativeTestJSON-628169841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T15:04:08Z,user_data=None,user_id='21222ab2b99941978eb3c3e511547e65',uuid=9ece926f-02cc-4909-80a2-6476885cc18a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa6c04e0-092c-418b-bd4d-30123e4d9643", "address": "fa:16:3e:8a:b2:e2", "network": {"id": "afcad268-9e48-452e-ae62-cbeaf3f538dd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-791822524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f4d01080114839b14b23997a4dc1f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa6c04e0-09", "ovs_interfaceid": "aa6c04e0-092c-418b-bd4d-30123e4d9643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Converting VIF {"id": "aa6c04e0-092c-418b-bd4d-30123e4d9643", "address": "fa:16:3e:8a:b2:e2", "network": {"id": "afcad268-9e48-452e-ae62-cbeaf3f538dd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-791822524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f4d01080114839b14b23997a4dc1f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa6c04e0-09", "ovs_interfaceid": "aa6c04e0-092c-418b-bd4d-30123e4d9643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:b2:e2,bridge_name='br-int',has_traffic_filtering=True,id=aa6c04e0-092c-418b-bd4d-30123e4d9643,network=Network(afcad268-9e48-452e-ae62-cbeaf3f538dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa6c04e0-09') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG nova.objects.instance [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ece926f-02cc-4909-80a2-6476885cc18a {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] End _get_guest_xml xml=<domain type="kvm">
Jul 31 15:04:09 user nova-compute[72239]:   <uuid>9ece926f-02cc-4909-80a2-6476885cc18a</uuid>
Jul 31 15:04:09 user nova-compute[72239]:   <name>instance-00000027</name>
Jul 31 15:04:09 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 15:04:09 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 15:04:09 user nova-compute[72239]:   <metadata>
Jul 31 15:04:09 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 15:04:09 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 15:04:09 user nova-compute[72239]:       <nova:name>tempest-ServersNegativeTestJSON-server-1390124767</nova:name>
Jul 31 15:04:09 user nova-compute[72239]:       <nova:creationTime>2023-07-31 15:04:09</nova:creationTime>
Jul 31 15:04:09 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 15:04:09 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 15:04:09 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 15:04:09 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 15:04:09 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 15:04:09 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 15:04:09 user nova-compute[72239]:       </nova:flavor>
Jul 31 15:04:09 user nova-compute[72239]:       <nova:owner>
Jul 31 15:04:09 user nova-compute[72239]:         <nova:user uuid="21222ab2b99941978eb3c3e511547e65">tempest-ServersNegativeTestJSON-628169841-project-member</nova:user>
Jul 31 15:04:09 user nova-compute[72239]:         <nova:project uuid="36f4d01080114839b14b23997a4dc1f3">tempest-ServersNegativeTestJSON-628169841</nova:project>
Jul 31 15:04:09 user nova-compute[72239]:       </nova:owner>
Jul 31 15:04:09 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 15:04:09 user nova-compute[72239]:       <nova:ports>
Jul 31 15:04:09 user nova-compute[72239]:         <nova:port uuid="aa6c04e0-092c-418b-bd4d-30123e4d9643">
Jul 31 15:04:09 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 31 15:04:09 user nova-compute[72239]:         </nova:port>
Jul 31 15:04:09 user nova-compute[72239]:       </nova:ports>
Jul 31 15:04:09 user nova-compute[72239]:     </nova:instance>
Jul 31 15:04:09 user nova-compute[72239]:   </metadata>
Jul 31 15:04:09 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 15:04:09 user nova-compute[72239]:     <system>
Jul 31 15:04:09 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 15:04:09 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 15:04:09 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 15:04:09 user nova-compute[72239]:       <entry name="serial">9ece926f-02cc-4909-80a2-6476885cc18a</entry>
Jul 31 15:04:09 user nova-compute[72239]:       <entry name="uuid">9ece926f-02cc-4909-80a2-6476885cc18a</entry>
Jul 31 15:04:09 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 15:04:09 user nova-compute[72239]:     </system>
Jul 31 15:04:09 user nova-compute[72239]:   </sysinfo>
Jul 31 15:04:09 user nova-compute[72239]:   <os>
Jul 31 15:04:09 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 15:04:09 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 15:04:09 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 15:04:09 user nova-compute[72239]:   </os>
Jul 31 15:04:09 user nova-compute[72239]:   <features>
Jul 31 15:04:09 user nova-compute[72239]:     <acpi/>
Jul 31 15:04:09 user nova-compute[72239]:     <apic/>
Jul 31 15:04:09 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 15:04:09 user nova-compute[72239]:   </features>
Jul 31 15:04:09 user nova-compute[72239]:   <clock offset="utc">
Jul 31 15:04:09 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 15:04:09 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 15:04:09 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 15:04:09 user nova-compute[72239]:   </clock>
Jul 31 15:04:09 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 15:04:09 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 15:04:09 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 15:04:09 user nova-compute[72239]:   </cpu>
Jul 31 15:04:09 user nova-compute[72239]:   <devices>
Jul 31 15:04:09 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 15:04:09 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 15:04:09 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/9ece926f-02cc-4909-80a2-6476885cc18a/disk"/>
Jul 31 15:04:09 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 15:04:09 user nova-compute[72239]:     </disk>
Jul 31 15:04:09 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 15:04:09 user nova-compute[72239]:       <mac address="fa:16:3e:8a:b2:e2"/>
Jul 31 15:04:09 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:04:09 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 15:04:09 user nova-compute[72239]:       <target dev="tapaa6c04e0-09"/>
Jul 31 15:04:09 user nova-compute[72239]:     </interface>
Jul 31 15:04:09 user nova-compute[72239]:     <serial type="pty">
Jul 31 15:04:09 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/9ece926f-02cc-4909-80a2-6476885cc18a/console.log" append="off"/>
Jul 31 15:04:09 user nova-compute[72239]:     </serial>
Jul 31 15:04:09 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 15:04:09 user nova-compute[72239]:     <video>
Jul 31 15:04:09 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:04:09 user nova-compute[72239]:     </video>
Jul 31 15:04:09 user nova-compute[72239]:     <rng model="virtio">
Jul 31 15:04:09 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 15:04:09 user nova-compute[72239]:     </rng>
Jul 31 15:04:09 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 15:04:09 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 15:04:09 user nova-compute[72239]:       <stats period="10"/>
Jul 31 15:04:09 user nova-compute[72239]:     </memballoon>
Jul 31 15:04:09 user nova-compute[72239]:   </devices>
Jul 31 15:04:09 user nova-compute[72239]: </domain>
Jul 31 15:04:09 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1390124767',display_name='tempest-ServersNegativeTestJSON-server-1390124767',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1390124767',id=39,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='36f4d01080114839b14b23997a4dc1f3',ramdisk_id='',reservation_id='r-bdkru5mf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-628169841',owner_user_name='tempest-ServersNegativeTestJSON-628169841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T15:04:08Z,user_data=None,user_id='21222ab2b99941978eb3c3e511547e65',uuid=9ece926f-02cc-4909-80a2-6476885cc18a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa6c04e0-092c-418b-bd4d-30123e4d9643", "address": "fa:16:3e:8a:b2:e2", "network": {"id": "afcad268-9e48-452e-ae62-cbeaf3f538dd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-791822524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f4d01080114839b14b23997a4dc1f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa6c04e0-09", "ovs_interfaceid": "aa6c04e0-092c-418b-bd4d-30123e4d9643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Converting VIF {"id": "aa6c04e0-092c-418b-bd4d-30123e4d9643", "address": "fa:16:3e:8a:b2:e2", "network": {"id": "afcad268-9e48-452e-ae62-cbeaf3f538dd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-791822524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f4d01080114839b14b23997a4dc1f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa6c04e0-09", "ovs_interfaceid": "aa6c04e0-092c-418b-bd4d-30123e4d9643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:b2:e2,bridge_name='br-int',has_traffic_filtering=True,id=aa6c04e0-092c-418b-bd4d-30123e4d9643,network=Network(afcad268-9e48-452e-ae62-cbeaf3f538dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa6c04e0-09') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG os_vif [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:b2:e2,bridge_name='br-int',has_traffic_filtering=True,id=aa6c04e0-092c-418b-bd4d-30123e4d9643,network=Network(afcad268-9e48-452e-ae62-cbeaf3f538dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa6c04e0-09') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa6c04e0-09, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapaa6c04e0-09, col_values=(('external_ids', {'iface-id': 'aa6c04e0-092c-418b-bd4d-30123e4d9643', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:b2:e2', 'vm-uuid': '9ece926f-02cc-4909-80a2-6476885cc18a'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:09 user nova-compute[72239]: INFO os_vif [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:b2:e2,bridge_name='br-int',has_traffic_filtering=True,id=aa6c04e0-092c-418b-bd4d-30123e4d9643,network=Network(afcad268-9e48-452e-ae62-cbeaf3f538dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa6c04e0-09')
Jul 31 15:04:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:04:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] No VIF found with MAC fa:16:3e:8a:b2:e2, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 15:04:10 user nova-compute[72239]: DEBUG nova.network.neutron [req-a1ed2b17-d2fc-4c80-a82f-4142a48a4c19 req-b01c463a-8ab4-4a4d-83b8-2e874ef779f8 service nova] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Updated VIF entry in instance network info cache for port aa6c04e0-092c-418b-bd4d-30123e4d9643. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:04:10 user nova-compute[72239]: DEBUG nova.network.neutron [req-a1ed2b17-d2fc-4c80-a82f-4142a48a4c19 req-b01c463a-8ab4-4a4d-83b8-2e874ef779f8 service nova] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Updating instance_info_cache with network_info: [{"id": "aa6c04e0-092c-418b-bd4d-30123e4d9643", "address": "fa:16:3e:8a:b2:e2", "network": {"id": "afcad268-9e48-452e-ae62-cbeaf3f538dd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-791822524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f4d01080114839b14b23997a4dc1f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa6c04e0-09", "ovs_interfaceid": "aa6c04e0-092c-418b-bd4d-30123e4d9643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:04:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a1ed2b17-d2fc-4c80-a82f-4142a48a4c19 req-b01c463a-8ab4-4a4d-83b8-2e874ef779f8 service nova] Releasing lock "refresh_cache-9ece926f-02cc-4909-80a2-6476885cc18a" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:04:10 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Updating instance_info_cache with network_info: [{"id": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "address": "fa:16:3e:56:1c:d6", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8307e7-0d", "ovs_interfaceid": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:04:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-c10918e9-9731-48ea-860e-8a02cb6a0ad9" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:04:10 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 15:04:10 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:04:10 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:04:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Acquiring lock "95c53d76-a495-4922-a7af-fcbf8321f19b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:04:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "95c53d76-a495-4922-a7af-fcbf8321f19b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:04:11 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 15:04:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:04:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:04:11 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 15:04:11 user nova-compute[72239]: INFO nova.compute.claims [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Claim successful on node user
Jul 31 15:04:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:11 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:04:11 user nova-compute[72239]: DEBUG nova.compute.manager [req-98d81253-c9de-43f1-bcdb-ba1108287dd8 req-1084b45f-726c-464a-b722-477a6a327094 service nova] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Received event network-vif-plugged-aa6c04e0-092c-418b-bd4d-30123e4d9643 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:04:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-98d81253-c9de-43f1-bcdb-ba1108287dd8 req-1084b45f-726c-464a-b722-477a6a327094 service nova] Acquiring lock "9ece926f-02cc-4909-80a2-6476885cc18a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:04:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-98d81253-c9de-43f1-bcdb-ba1108287dd8 req-1084b45f-726c-464a-b722-477a6a327094 service nova] Lock "9ece926f-02cc-4909-80a2-6476885cc18a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:04:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-98d81253-c9de-43f1-bcdb-ba1108287dd8 req-1084b45f-726c-464a-b722-477a6a327094 service nova] Lock "9ece926f-02cc-4909-80a2-6476885cc18a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:04:11 user nova-compute[72239]: DEBUG nova.compute.manager [req-98d81253-c9de-43f1-bcdb-ba1108287dd8 req-1084b45f-726c-464a-b722-477a6a327094 service nova] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] No waiting events found dispatching network-vif-plugged-aa6c04e0-092c-418b-bd4d-30123e4d9643 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:04:11 user nova-compute[72239]: WARNING nova.compute.manager [req-98d81253-c9de-43f1-bcdb-ba1108287dd8 req-1084b45f-726c-464a-b722-477a6a327094 service nova] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Received unexpected event network-vif-plugged-aa6c04e0-092c-418b-bd4d-30123e4d9643 for instance with vm_state building and task_state spawning.
Jul 31 15:04:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:11 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:04:11 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:04:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.468s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:04:11 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 15:04:11 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 15:04:11 user nova-compute[72239]: DEBUG nova.network.neutron [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 15:04:11 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 15:04:11 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 15:04:11 user nova-compute[72239]: DEBUG nova.policy [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fc15f7d4660746f59b6a8fb70f729521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4228abbe80ac416fbcc6013767ca9384', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 15:04:12 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 15:04:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 15:04:12 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Creating image(s)
Jul 31 15:04:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Acquiring lock "/opt/stack/data/nova/instances/95c53d76-a495-4922-a7af-fcbf8321f19b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:04:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "/opt/stack/data/nova/instances/95c53d76-a495-4922-a7af-fcbf8321f19b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:04:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "/opt/stack/data/nova/instances/95c53d76-a495-4922-a7af-fcbf8321f19b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:04:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Acquiring lock "5825a553da02692306cdc0be0b5942c2e71a880a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:04:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "5825a553da02692306cdc0be0b5942c2e71a880a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:04:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5825a553da02692306cdc0be0b5942c2e71a880a.part --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:13 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:04:13 user nova-compute[72239]: DEBUG nova.network.neutron [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Successfully created port: 8422c73f-f89d-4170-b460-a31f0e8fe9ad {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 15:04:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:13 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:04:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5825a553da02692306cdc0be0b5942c2e71a880a.part --force-share --output=json" returned: 0 in 0.156s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:13 user nova-compute[72239]: DEBUG nova.virt.images [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] 87a24c01-7f66-4f70-af50-d5c9b09045dc was qcow2, converting to raw {{(pid=72239) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 31 15:04:13 user nova-compute[72239]: DEBUG nova.privsep.utils [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72239) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 15:04:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5825a553da02692306cdc0be0b5942c2e71a880a.part /opt/stack/data/nova/instances/_base/5825a553da02692306cdc0be0b5942c2e71a880a.converted {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:13 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:04:13 user nova-compute[72239]: DEBUG nova.compute.manager [req-e2077cc2-b16d-4a66-aaa2-40f1846505b9 req-66c649c0-a348-40ac-a796-b84cadbcdb34 service nova] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Received event network-vif-plugged-aa6c04e0-092c-418b-bd4d-30123e4d9643 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:04:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e2077cc2-b16d-4a66-aaa2-40f1846505b9 req-66c649c0-a348-40ac-a796-b84cadbcdb34 service nova] Acquiring lock "9ece926f-02cc-4909-80a2-6476885cc18a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:04:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e2077cc2-b16d-4a66-aaa2-40f1846505b9 req-66c649c0-a348-40ac-a796-b84cadbcdb34 service nova] Lock "9ece926f-02cc-4909-80a2-6476885cc18a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:04:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e2077cc2-b16d-4a66-aaa2-40f1846505b9 req-66c649c0-a348-40ac-a796-b84cadbcdb34 service nova] Lock "9ece926f-02cc-4909-80a2-6476885cc18a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:04:13 user nova-compute[72239]: DEBUG nova.compute.manager [req-e2077cc2-b16d-4a66-aaa2-40f1846505b9 req-66c649c0-a348-40ac-a796-b84cadbcdb34 service nova] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] No waiting events found dispatching network-vif-plugged-aa6c04e0-092c-418b-bd4d-30123e4d9643 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:04:13 user nova-compute[72239]: WARNING nova.compute.manager [req-e2077cc2-b16d-4a66-aaa2-40f1846505b9 req-66c649c0-a348-40ac-a796-b84cadbcdb34 service nova] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Received unexpected event network-vif-plugged-aa6c04e0-092c-418b-bd4d-30123e4d9643 for instance with vm_state building and task_state spawning.
Jul 31 15:04:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5825a553da02692306cdc0be0b5942c2e71a880a.part /opt/stack/data/nova/instances/_base/5825a553da02692306cdc0be0b5942c2e71a880a.converted" returned: 0 in 0.818s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5825a553da02692306cdc0be0b5942c2e71a880a.converted --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5825a553da02692306cdc0be0b5942c2e71a880a.converted --force-share --output=json" returned: 0 in 0.141s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "5825a553da02692306cdc0be0b5942c2e71a880a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.672s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:04:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5825a553da02692306cdc0be0b5942c2e71a880a --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:14 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815854.8009772, 9ece926f-02cc-4909-80a2-6476885cc18a => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:04:14 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] VM Resumed (Lifecycle Event)
Jul 31 15:04:14 user nova-compute[72239]: DEBUG nova.network.neutron [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Successfully updated port: 8422c73f-f89d-4170-b460-a31f0e8fe9ad {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 15:04:14 user nova-compute[72239]: DEBUG nova.compute.manager [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 15:04:14 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 15:04:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5825a553da02692306cdc0be0b5942c2e71a880a --force-share --output=json" returned: 0 in 0.143s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Acquiring lock "5825a553da02692306cdc0be0b5942c2e71a880a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:04:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "5825a553da02692306cdc0be0b5942c2e71a880a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:04:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5825a553da02692306cdc0be0b5942c2e71a880a --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:14 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:04:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Acquiring lock "refresh_cache-95c53d76-a495-4922-a7af-fcbf8321f19b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:04:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Acquired lock "refresh_cache-95c53d76-a495-4922-a7af-fcbf8321f19b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:04:14 user nova-compute[72239]: DEBUG nova.network.neutron [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 15:04:14 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Instance spawned successfully.
Jul 31 15:04:14 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 15:04:14 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:04:14 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 15:04:14 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815854.8022008, 9ece926f-02cc-4909-80a2-6476885cc18a => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:04:14 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] VM Started (Lifecycle Event)
Jul 31 15:04:14 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:04:14 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:04:14 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:04:14 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:04:14 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:04:14 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:04:14 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:04:14 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:04:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5825a553da02692306cdc0be0b5942c2e71a880a --force-share --output=json" returned: 0 in 0.142s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5825a553da02692306cdc0be0b5942c2e71a880a,backing_fmt=raw /opt/stack/data/nova/instances/95c53d76-a495-4922-a7af-fcbf8321f19b/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG nova.network.neutron [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 15:04:15 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 15:04:15 user nova-compute[72239]: INFO nova.compute.manager [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Took 7.31 seconds to spawn the instance on the hypervisor.
Jul 31 15:04:15 user nova-compute[72239]: DEBUG nova.compute.manager [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5825a553da02692306cdc0be0b5942c2e71a880a,backing_fmt=raw /opt/stack/data/nova/instances/95c53d76-a495-4922-a7af-fcbf8321f19b/disk 1073741824" returned: 0 in 0.070s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "5825a553da02692306cdc0be0b5942c2e71a880a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.215s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5825a553da02692306cdc0be0b5942c2e71a880a --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:15 user nova-compute[72239]: INFO nova.compute.manager [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Took 8.15 seconds to build instance.
Jul 31 15:04:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5825a553da02692306cdc0be0b5942c2e71a880a --force-share --output=json" returned: 0 in 0.183s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG nova.objects.instance [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lazy-loading 'migration_context' on Instance uuid 95c53d76-a495-4922-a7af-fcbf8321f19b {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-69b8cbbf-1b87-4fb1-b299-d750706239c8 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Lock "9ece926f-02cc-4909-80a2-6476885cc18a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.250s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Ensure instance console log exists: /opt/stack/data/nova/instances/95c53d76-a495-4922-a7af-fcbf8321f19b/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG nova.network.neutron [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Updating instance_info_cache with network_info: [{"id": "8422c73f-f89d-4170-b460-a31f0e8fe9ad", "address": "fa:16:3e:4d:1c:7f", "network": {"id": "39af8721-7023-4cb5-9e06-293f319d5d93", "bridge": "br-int", "label": "tempest-TestStampPattern-549999556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228abbe80ac416fbcc6013767ca9384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8422c73f-f8", "ovs_interfaceid": "8422c73f-f89d-4170-b460-a31f0e8fe9ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Releasing lock "refresh_cache-95c53d76-a495-4922-a7af-fcbf8321f19b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Instance network_info: |[{"id": "8422c73f-f89d-4170-b460-a31f0e8fe9ad", "address": "fa:16:3e:4d:1c:7f", "network": {"id": "39af8721-7023-4cb5-9e06-293f319d5d93", "bridge": "br-int", "label": "tempest-TestStampPattern-549999556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228abbe80ac416fbcc6013767ca9384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8422c73f-f8", "ovs_interfaceid": "8422c73f-f89d-4170-b460-a31f0e8fe9ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Start _get_guest_xml network_info=[{"id": "8422c73f-f89d-4170-b460-a31f0e8fe9ad", "address": "fa:16:3e:4d:1c:7f", "network": {"id": "39af8721-7023-4cb5-9e06-293f319d5d93", "bridge": "br-int", "label": "tempest-TestStampPattern-549999556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228abbe80ac416fbcc6013767ca9384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8422c73f-f8", "ovs_interfaceid": "8422c73f-f89d-4170-b460-a31f0e8fe9ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='526f6f1536f87cdd372f204ab06eb475',container_format='bare',created_at=2023-07-31T15:04:03Z,direct_url=<?>,disk_format='qcow2',id=87a24c01-7f66-4f70-af50-d5c9b09045dc,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1706473634',owner='4228abbe80ac416fbcc6013767ca9384',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-31T15:04:09Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '87a24c01-7f66-4f70-af50-d5c9b09045dc'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:04:15 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:04:15 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:04:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='526f6f1536f87cdd372f204ab06eb475',container_format='bare',created_at=2023-07-31T15:04:03Z,direct_url=<?>,disk_format='qcow2',id=87a24c01-7f66-4f70-af50-d5c9b09045dc,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1706473634',owner='4228abbe80ac416fbcc6013767ca9384',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-31T15:04:09Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:04:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-981630035',display_name='tempest-TestStampPattern-server-981630035',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-981630035',id=40,image_ref='87a24c01-7f66-4f70-af50-d5c9b09045dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtzUkuhD+wwUbFtr7G/xwzzWTycEUmu5aFIujMoqcCgETcqAHEigBAjoG6HJEMVeMKVtot/DjyoIAoKu2HGxjf4jAREiiEvxQvonoCgtEXCLIHvDszAezjEtchB2nDfpg==',key_name='tempest-TestStampPattern-1537860596',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4228abbe80ac416fbcc6013767ca9384',ramdisk_id='',reservation_id='r-i1pe7yqx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0a89aa93-374f-4487-893b-58c15d42c84c',image_min_disk='1',image_min_ram='0',image_owner_id='4228abbe80ac416fbcc6013767ca9384',image_owner_project_name='tempest-TestStampPattern-1615288352',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1615288352-project-member',image_user_id='fc15f7d4660746f59b6a8fb70f729521',network_allocated='True',owner_project_name='tempest-TestStampPattern-1615288352',owner_user_name='tempest-TestStampPattern-1615288352-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T15:04:12Z,user_data=None,user_id='fc15f7d4660746f59b6a8fb70f729521',uuid=95c53d76-a495-4922-a7af-fcbf8321f19b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8422c73f-f89d-4170-b460-a31f0e8fe9ad", "address": "fa:16:3e:4d:1c:7f", "network": {"id": "39af8721-7023-4cb5-9e06-293f319d5d93", "bridge": "br-int", "label": "tempest-TestStampPattern-549999556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228abbe80ac416fbcc6013767ca9384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8422c73f-f8", "ovs_interfaceid": "8422c73f-f89d-4170-b460-a31f0e8fe9ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Converting VIF {"id": "8422c73f-f89d-4170-b460-a31f0e8fe9ad", "address": "fa:16:3e:4d:1c:7f", "network": {"id": "39af8721-7023-4cb5-9e06-293f319d5d93", "bridge": "br-int", "label": "tempest-TestStampPattern-549999556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228abbe80ac416fbcc6013767ca9384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8422c73f-f8", "ovs_interfaceid": "8422c73f-f89d-4170-b460-a31f0e8fe9ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:1c:7f,bridge_name='br-int',has_traffic_filtering=True,id=8422c73f-f89d-4170-b460-a31f0e8fe9ad,network=Network(39af8721-7023-4cb5-9e06-293f319d5d93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8422c73f-f8') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG nova.objects.instance [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lazy-loading 'pci_devices' on Instance uuid 95c53d76-a495-4922-a7af-fcbf8321f19b {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] End _get_guest_xml xml=<domain type="kvm">
Jul 31 15:04:15 user nova-compute[72239]:   <uuid>95c53d76-a495-4922-a7af-fcbf8321f19b</uuid>
Jul 31 15:04:15 user nova-compute[72239]:   <name>instance-00000028</name>
Jul 31 15:04:15 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 15:04:15 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 15:04:15 user nova-compute[72239]:   <metadata>
Jul 31 15:04:15 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 15:04:15 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 15:04:15 user nova-compute[72239]:       <nova:name>tempest-TestStampPattern-server-981630035</nova:name>
Jul 31 15:04:15 user nova-compute[72239]:       <nova:creationTime>2023-07-31 15:04:15</nova:creationTime>
Jul 31 15:04:15 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 15:04:15 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 15:04:15 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 15:04:15 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 15:04:15 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 15:04:15 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 15:04:15 user nova-compute[72239]:       </nova:flavor>
Jul 31 15:04:15 user nova-compute[72239]:       <nova:owner>
Jul 31 15:04:15 user nova-compute[72239]:         <nova:user uuid="fc15f7d4660746f59b6a8fb70f729521">tempest-TestStampPattern-1615288352-project-member</nova:user>
Jul 31 15:04:15 user nova-compute[72239]:         <nova:project uuid="4228abbe80ac416fbcc6013767ca9384">tempest-TestStampPattern-1615288352</nova:project>
Jul 31 15:04:15 user nova-compute[72239]:       </nova:owner>
Jul 31 15:04:15 user nova-compute[72239]:       <nova:root type="image" uuid="87a24c01-7f66-4f70-af50-d5c9b09045dc"/>
Jul 31 15:04:15 user nova-compute[72239]:       <nova:ports>
Jul 31 15:04:15 user nova-compute[72239]:         <nova:port uuid="8422c73f-f89d-4170-b460-a31f0e8fe9ad">
Jul 31 15:04:15 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 31 15:04:15 user nova-compute[72239]:         </nova:port>
Jul 31 15:04:15 user nova-compute[72239]:       </nova:ports>
Jul 31 15:04:15 user nova-compute[72239]:     </nova:instance>
Jul 31 15:04:15 user nova-compute[72239]:   </metadata>
Jul 31 15:04:15 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 15:04:15 user nova-compute[72239]:     <system>
Jul 31 15:04:15 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 15:04:15 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 15:04:15 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 15:04:15 user nova-compute[72239]:       <entry name="serial">95c53d76-a495-4922-a7af-fcbf8321f19b</entry>
Jul 31 15:04:15 user nova-compute[72239]:       <entry name="uuid">95c53d76-a495-4922-a7af-fcbf8321f19b</entry>
Jul 31 15:04:15 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 15:04:15 user nova-compute[72239]:     </system>
Jul 31 15:04:15 user nova-compute[72239]:   </sysinfo>
Jul 31 15:04:15 user nova-compute[72239]:   <os>
Jul 31 15:04:15 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 15:04:15 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 15:04:15 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 15:04:15 user nova-compute[72239]:   </os>
Jul 31 15:04:15 user nova-compute[72239]:   <features>
Jul 31 15:04:15 user nova-compute[72239]:     <acpi/>
Jul 31 15:04:15 user nova-compute[72239]:     <apic/>
Jul 31 15:04:15 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 15:04:15 user nova-compute[72239]:   </features>
Jul 31 15:04:15 user nova-compute[72239]:   <clock offset="utc">
Jul 31 15:04:15 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 15:04:15 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 15:04:15 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 15:04:15 user nova-compute[72239]:   </clock>
Jul 31 15:04:15 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 15:04:15 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 15:04:15 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 15:04:15 user nova-compute[72239]:   </cpu>
Jul 31 15:04:15 user nova-compute[72239]:   <devices>
Jul 31 15:04:15 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 15:04:15 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 15:04:15 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/95c53d76-a495-4922-a7af-fcbf8321f19b/disk"/>
Jul 31 15:04:15 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 15:04:15 user nova-compute[72239]:     </disk>
Jul 31 15:04:15 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 15:04:15 user nova-compute[72239]:       <mac address="fa:16:3e:4d:1c:7f"/>
Jul 31 15:04:15 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:04:15 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 15:04:15 user nova-compute[72239]:       <target dev="tap8422c73f-f8"/>
Jul 31 15:04:15 user nova-compute[72239]:     </interface>
Jul 31 15:04:15 user nova-compute[72239]:     <serial type="pty">
Jul 31 15:04:15 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/95c53d76-a495-4922-a7af-fcbf8321f19b/console.log" append="off"/>
Jul 31 15:04:15 user nova-compute[72239]:     </serial>
Jul 31 15:04:15 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 15:04:15 user nova-compute[72239]:     <video>
Jul 31 15:04:15 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:04:15 user nova-compute[72239]:     </video>
Jul 31 15:04:15 user nova-compute[72239]:     <rng model="virtio">
Jul 31 15:04:15 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 15:04:15 user nova-compute[72239]:     </rng>
Jul 31 15:04:15 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 15:04:15 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 15:04:15 user nova-compute[72239]:       <stats period="10"/>
Jul 31 15:04:15 user nova-compute[72239]:     </memballoon>
Jul 31 15:04:15 user nova-compute[72239]:   </devices>
Jul 31 15:04:15 user nova-compute[72239]: </domain>
Jul 31 15:04:15 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:04:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-981630035',display_name='tempest-TestStampPattern-server-981630035',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-981630035',id=40,image_ref='87a24c01-7f66-4f70-af50-d5c9b09045dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtzUkuhD+wwUbFtr7G/xwzzWTycEUmu5aFIujMoqcCgETcqAHEigBAjoG6HJEMVeMKVtot/DjyoIAoKu2HGxjf4jAREiiEvxQvonoCgtEXCLIHvDszAezjEtchB2nDfpg==',key_name='tempest-TestStampPattern-1537860596',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4228abbe80ac416fbcc6013767ca9384',ramdisk_id='',reservation_id='r-i1pe7yqx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0a89aa93-374f-4487-893b-58c15d42c84c',image_min_disk='1',image_min_ram='0',image_owner_id='4228abbe80ac416fbcc6013767ca9384',image_owner_project_name='tempest-TestStampPattern-1615288352',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1615288352-project-member',image_user_id='fc15f7d4660746f59b6a8fb70f729521',network_allocated='True',owner_project_name='tempest-TestStampPattern-1615288352',owner_user_name='tempest-TestStampPattern-1615288352-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T15:04:12Z,user_data=None,user_id='fc15f7d4660746f59b6a8fb70f729521',uuid=95c53d76-a495-4922-a7af-fcbf8321f19b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8422c73f-f89d-4170-b460-a31f0e8fe9ad", "address": "fa:16:3e:4d:1c:7f", "network": {"id": "39af8721-7023-4cb5-9e06-293f319d5d93", "bridge": "br-int", "label": "tempest-TestStampPattern-549999556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228abbe80ac416fbcc6013767ca9384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8422c73f-f8", "ovs_interfaceid": "8422c73f-f89d-4170-b460-a31f0e8fe9ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Converting VIF {"id": "8422c73f-f89d-4170-b460-a31f0e8fe9ad", "address": "fa:16:3e:4d:1c:7f", "network": {"id": "39af8721-7023-4cb5-9e06-293f319d5d93", "bridge": "br-int", "label": "tempest-TestStampPattern-549999556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228abbe80ac416fbcc6013767ca9384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8422c73f-f8", "ovs_interfaceid": "8422c73f-f89d-4170-b460-a31f0e8fe9ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:1c:7f,bridge_name='br-int',has_traffic_filtering=True,id=8422c73f-f89d-4170-b460-a31f0e8fe9ad,network=Network(39af8721-7023-4cb5-9e06-293f319d5d93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8422c73f-f8') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG os_vif [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:1c:7f,bridge_name='br-int',has_traffic_filtering=True,id=8422c73f-f89d-4170-b460-a31f0e8fe9ad,network=Network(39af8721-7023-4cb5-9e06-293f319d5d93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8422c73f-f8') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8422c73f-f8, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8422c73f-f8, col_values=(('external_ids', {'iface-id': '8422c73f-f89d-4170-b460-a31f0e8fe9ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:1c:7f', 'vm-uuid': '95c53d76-a495-4922-a7af-fcbf8321f19b'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:15 user nova-compute[72239]: INFO os_vif [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:1c:7f,bridge_name='br-int',has_traffic_filtering=True,id=8422c73f-f89d-4170-b460-a31f0e8fe9ad,network=Network(39af8721-7023-4cb5-9e06-293f319d5d93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8422c73f-f8')
Jul 31 15:04:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] No VIF found with MAC fa:16:3e:4d:1c:7f, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG nova.compute.manager [req-9717e14e-5754-414a-b01a-fb2dda36ca78 req-45ee3cb1-a7ba-4a6c-87f9-b00aa1a621af service nova] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Received event network-changed-8422c73f-f89d-4170-b460-a31f0e8fe9ad {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG nova.compute.manager [req-9717e14e-5754-414a-b01a-fb2dda36ca78 req-45ee3cb1-a7ba-4a6c-87f9-b00aa1a621af service nova] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Refreshing instance network info cache due to event network-changed-8422c73f-f89d-4170-b460-a31f0e8fe9ad. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-9717e14e-5754-414a-b01a-fb2dda36ca78 req-45ee3cb1-a7ba-4a6c-87f9-b00aa1a621af service nova] Acquiring lock "refresh_cache-95c53d76-a495-4922-a7af-fcbf8321f19b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-9717e14e-5754-414a-b01a-fb2dda36ca78 req-45ee3cb1-a7ba-4a6c-87f9-b00aa1a621af service nova] Acquired lock "refresh_cache-95c53d76-a495-4922-a7af-fcbf8321f19b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:04:15 user nova-compute[72239]: DEBUG nova.network.neutron [req-9717e14e-5754-414a-b01a-fb2dda36ca78 req-45ee3cb1-a7ba-4a6c-87f9-b00aa1a621af service nova] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Refreshing network info cache for port 8422c73f-f89d-4170-b460-a31f0e8fe9ad {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:04:16 user nova-compute[72239]: DEBUG nova.network.neutron [req-9717e14e-5754-414a-b01a-fb2dda36ca78 req-45ee3cb1-a7ba-4a6c-87f9-b00aa1a621af service nova] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Updated VIF entry in instance network info cache for port 8422c73f-f89d-4170-b460-a31f0e8fe9ad. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:04:16 user nova-compute[72239]: DEBUG nova.network.neutron [req-9717e14e-5754-414a-b01a-fb2dda36ca78 req-45ee3cb1-a7ba-4a6c-87f9-b00aa1a621af service nova] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Updating instance_info_cache with network_info: [{"id": "8422c73f-f89d-4170-b460-a31f0e8fe9ad", "address": "fa:16:3e:4d:1c:7f", "network": {"id": "39af8721-7023-4cb5-9e06-293f319d5d93", "bridge": "br-int", "label": "tempest-TestStampPattern-549999556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228abbe80ac416fbcc6013767ca9384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8422c73f-f8", "ovs_interfaceid": "8422c73f-f89d-4170-b460-a31f0e8fe9ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:04:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-9717e14e-5754-414a-b01a-fb2dda36ca78 req-45ee3cb1-a7ba-4a6c-87f9-b00aa1a621af service nova] Releasing lock "refresh_cache-95c53d76-a495-4922-a7af-fcbf8321f19b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:04:16 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:16 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:16 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:17 user nova-compute[72239]: DEBUG nova.compute.manager [req-736ca58f-be2b-4dbb-946c-d744f1a13159 req-eadc0282-4375-4b96-861d-d608b1e5361f service nova] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Received event network-vif-plugged-8422c73f-f89d-4170-b460-a31f0e8fe9ad {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:04:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-736ca58f-be2b-4dbb-946c-d744f1a13159 req-eadc0282-4375-4b96-861d-d608b1e5361f service nova] Acquiring lock "95c53d76-a495-4922-a7af-fcbf8321f19b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:04:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-736ca58f-be2b-4dbb-946c-d744f1a13159 req-eadc0282-4375-4b96-861d-d608b1e5361f service nova] Lock "95c53d76-a495-4922-a7af-fcbf8321f19b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:04:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-736ca58f-be2b-4dbb-946c-d744f1a13159 req-eadc0282-4375-4b96-861d-d608b1e5361f service nova] Lock "95c53d76-a495-4922-a7af-fcbf8321f19b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:04:17 user nova-compute[72239]: DEBUG nova.compute.manager [req-736ca58f-be2b-4dbb-946c-d744f1a13159 req-eadc0282-4375-4b96-861d-d608b1e5361f service nova] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] No waiting events found dispatching network-vif-plugged-8422c73f-f89d-4170-b460-a31f0e8fe9ad {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:04:17 user nova-compute[72239]: WARNING nova.compute.manager [req-736ca58f-be2b-4dbb-946c-d744f1a13159 req-eadc0282-4375-4b96-861d-d608b1e5361f service nova] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Received unexpected event network-vif-plugged-8422c73f-f89d-4170-b460-a31f0e8fe9ad for instance with vm_state building and task_state spawning.
Jul 31 15:04:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:18 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:04:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:04:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:04:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:04:18 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 15:04:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-0ec6ab1d-7721-4e2f-b2b7-22402c94b9ba req-235e7125-f230-4b4d-bf0e-3cedec813155 service nova] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Received event network-vif-plugged-8422c73f-f89d-4170-b460-a31f0e8fe9ad {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:04:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0ec6ab1d-7721-4e2f-b2b7-22402c94b9ba req-235e7125-f230-4b4d-bf0e-3cedec813155 service nova] Acquiring lock "95c53d76-a495-4922-a7af-fcbf8321f19b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:04:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0ec6ab1d-7721-4e2f-b2b7-22402c94b9ba req-235e7125-f230-4b4d-bf0e-3cedec813155 service nova] Lock "95c53d76-a495-4922-a7af-fcbf8321f19b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:04:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0ec6ab1d-7721-4e2f-b2b7-22402c94b9ba req-235e7125-f230-4b4d-bf0e-3cedec813155 service nova] Lock "95c53d76-a495-4922-a7af-fcbf8321f19b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:04:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-0ec6ab1d-7721-4e2f-b2b7-22402c94b9ba req-235e7125-f230-4b4d-bf0e-3cedec813155 service nova] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] No waiting events found dispatching network-vif-plugged-8422c73f-f89d-4170-b460-a31f0e8fe9ad {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:04:19 user nova-compute[72239]: WARNING nova.compute.manager [req-0ec6ab1d-7721-4e2f-b2b7-22402c94b9ba req-235e7125-f230-4b4d-bf0e-3cedec813155 service nova] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Received unexpected event network-vif-plugged-8422c73f-f89d-4170-b460-a31f0e8fe9ad for instance with vm_state building and task_state spawning.
Jul 31 15:04:19 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815859.3124125, 95c53d76-a495-4922-a7af-fcbf8321f19b => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:04:19 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] VM Resumed (Lifecycle Event)
Jul 31 15:04:19 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 15:04:19 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 15:04:19 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Instance spawned successfully.
Jul 31 15:04:19 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 15:04:19 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:04:19 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:04:19 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:04:19 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:04:19 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 15:04:19 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815859.3143344, 95c53d76-a495-4922-a7af-fcbf8321f19b => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:04:19 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] VM Started (Lifecycle Event)
Jul 31 15:04:19 user nova-compute[72239]: INFO nova.compute.manager [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Took 7.40 seconds to spawn the instance on the hypervisor.
Jul 31 15:04:19 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:04:19 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:04:19 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:04:19 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 15:04:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:19 user nova-compute[72239]: INFO nova.compute.manager [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Took 8.27 seconds to build instance.
Jul 31 15:04:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1a70f031-e5ad-4d11-b7a7-d647d6e61bb0 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "95c53d76-a495-4922-a7af-fcbf8321f19b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.417s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:04:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8652db6-b595-497f-a55d-8c0520bc18aa/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8652db6-b595-497f-a55d-8c0520bc18aa/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:19 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8652db6-b595-497f-a55d-8c0520bc18aa/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b8652db6-b595-497f-a55d-8c0520bc18aa/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:20 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 15:04:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/824b19e8-b4af-4fd4-a1ef-f214e25caef2/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/824b19e8-b4af-4fd4-a1ef-f214e25caef2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/824b19e8-b4af-4fd4-a1ef-f214e25caef2/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/824b19e8-b4af-4fd4-a1ef-f214e25caef2/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95c53d76-a495-4922-a7af-fcbf8321f19b/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95c53d76-a495-4922-a7af-fcbf8321f19b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95c53d76-a495-4922-a7af-fcbf8321f19b/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95c53d76-a495-4922-a7af-fcbf8321f19b/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:21 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:21 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:21 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:21 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:21 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:21 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ece926f-02cc-4909-80a2-6476885cc18a/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:21 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ece926f-02cc-4909-80a2-6476885cc18a/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:21 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ece926f-02cc-4909-80a2-6476885cc18a/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:21 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ece926f-02cc-4909-80a2-6476885cc18a/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:21 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04eeae20-361e-4ac1-84be-e25cec586f76/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04eeae20-361e-4ac1-84be-e25cec586f76/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04eeae20-361e-4ac1-84be-e25cec586f76/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04eeae20-361e-4ac1-84be-e25cec586f76/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:22 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:04:22 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:04:22 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=7611MB free_disk=25.077457427978516GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 15:04:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:04:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:04:22 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance c10918e9-9731-48ea-860e-8a02cb6a0ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:04:22 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 3d70608b-fc54-4178-9aa6-98ca6198a37b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:04:22 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 0a89aa93-374f-4487-893b-58c15d42c84c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:04:22 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance f98cea94-e905-47c5-bf88-5f5694934966 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:04:22 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 824b19e8-b4af-4fd4-a1ef-f214e25caef2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:04:22 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance b8652db6-b595-497f-a55d-8c0520bc18aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:04:22 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 04eeae20-361e-4ac1-84be-e25cec586f76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:04:22 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 9ece926f-02cc-4909-80a2-6476885cc18a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:04:22 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 95c53d76-a495-4922-a7af-fcbf8321f19b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:04:22 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 15:04:22 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 15:04:23 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:04:23 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:04:23 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 15:04:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.522s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:04:25 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:04:25 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 15:04:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "3d70608b-fc54-4178-9aa6-98ca6198a37b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:04:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "3d70608b-fc54-4178-9aa6-98ca6198a37b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:04:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "3d70608b-fc54-4178-9aa6-98ca6198a37b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:04:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "3d70608b-fc54-4178-9aa6-98ca6198a37b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:04:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "3d70608b-fc54-4178-9aa6-98ca6198a37b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:04:26 user nova-compute[72239]: INFO nova.compute.manager [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Terminating instance
Jul 31 15:04:26 user nova-compute[72239]: DEBUG nova.compute.manager [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 15:04:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:26 user nova-compute[72239]: DEBUG nova.compute.manager [req-5ad0f575-efa7-4731-860d-d7eceac0d8f2 req-a6c3baff-f925-48f8-8791-05248540a31a service nova] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Received event network-vif-unplugged-d115f55c-2a02-4b41-88b0-0922039e58ba {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:04:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5ad0f575-efa7-4731-860d-d7eceac0d8f2 req-a6c3baff-f925-48f8-8791-05248540a31a service nova] Acquiring lock "3d70608b-fc54-4178-9aa6-98ca6198a37b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:04:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5ad0f575-efa7-4731-860d-d7eceac0d8f2 req-a6c3baff-f925-48f8-8791-05248540a31a service nova] Lock "3d70608b-fc54-4178-9aa6-98ca6198a37b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:04:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5ad0f575-efa7-4731-860d-d7eceac0d8f2 req-a6c3baff-f925-48f8-8791-05248540a31a service nova] Lock "3d70608b-fc54-4178-9aa6-98ca6198a37b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:04:26 user nova-compute[72239]: DEBUG nova.compute.manager [req-5ad0f575-efa7-4731-860d-d7eceac0d8f2 req-a6c3baff-f925-48f8-8791-05248540a31a service nova] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] No waiting events found dispatching network-vif-unplugged-d115f55c-2a02-4b41-88b0-0922039e58ba {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:04:26 user nova-compute[72239]: DEBUG nova.compute.manager [req-5ad0f575-efa7-4731-860d-d7eceac0d8f2 req-a6c3baff-f925-48f8-8791-05248540a31a service nova] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Received event network-vif-unplugged-d115f55c-2a02-4b41-88b0-0922039e58ba for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 15:04:27 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Instance destroyed successfully.
Jul 31 15:04:27 user nova-compute[72239]: DEBUG nova.objects.instance [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lazy-loading 'resources' on Instance uuid 3d70608b-fc54-4178-9aa6-98ca6198a37b {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T14:57:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-2050515265',display_name='tempest-ServerActionsTestOtherA-server-2050515265',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-2050515265',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcC0f3guhYTNzECKpfyNk4cXj6Y8F4GpucRwb/0EBaXIalClpDyM69s13M23SyVQiCvr0tglg8FRaf5C4ibRcE2Gd6CEj06wnsuSnTBc8jPOcwf8pDTnQMrdikVLzRidg==',key_name='tempest-keypair-538819016',keypairs=<?>,launch_index=0,launched_at=2023-07-31T15:00:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='217b0eef1c154602850f4cf2d81b7ead',ramdisk_id='',reservation_id='r-4t9012f3',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-456571617',owner_user_name='tempest-ServerActionsTestOtherA-456571617-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T15:01:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0e2796894b249cc868a888fac759983',uuid=3d70608b-fc54-4178-9aa6-98ca6198a37b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d115f55c-2a02-4b41-88b0-0922039e58ba", "address": "fa:16:3e:15:91:63", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115f55c-2a", "ovs_interfaceid": "d115f55c-2a02-4b41-88b0-0922039e58ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Converting VIF {"id": "d115f55c-2a02-4b41-88b0-0922039e58ba", "address": "fa:16:3e:15:91:63", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd115f55c-2a", "ovs_interfaceid": "d115f55c-2a02-4b41-88b0-0922039e58ba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:91:63,bridge_name='br-int',has_traffic_filtering=True,id=d115f55c-2a02-4b41-88b0-0922039e58ba,network=Network(6d954fa8-21ae-4438-b6c0-6ae7fb37718c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd115f55c-2a') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG os_vif [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:91:63,bridge_name='br-int',has_traffic_filtering=True,id=d115f55c-2a02-4b41-88b0-0922039e58ba,network=Network(6d954fa8-21ae-4438-b6c0-6ae7fb37718c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd115f55c-2a') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd115f55c-2a, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:04:27 user nova-compute[72239]: INFO os_vif [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:91:63,bridge_name='br-int',has_traffic_filtering=True,id=d115f55c-2a02-4b41-88b0-0922039e58ba,network=Network(6d954fa8-21ae-4438-b6c0-6ae7fb37718c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd115f55c-2a')
Jul 31 15:04:27 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SEvDcOrt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:04:27 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:04:27 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8218371d-d439-4bb9-834d-fe5bea14b130]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d0790a-2a38-47af-a3cd-ef40413b041a]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 15:04:27 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 (non-flash)
Jul 31 15:04:27 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41182a3010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468'): ({'sdc'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Removing single pathed devices sdc {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[096d1f6e-dad5-4b87-b6d7-b9b1ba438462]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a28c05-99d1-48b7-911d-2a44fa21dda7]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Flushing IO for device /dev/sdc {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.030s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc0989a-dcc4-43d7-8b06-6e632e4955e4]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c30a22-fe71-4dd2-b333-59d0d4deca49]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] SCSI volumes sdc have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_f18d375', '/dev/disk/by-id/scsi-23635636139393566', '/dev/disk/by-id/scsi-1SCST_BIOf18d375-65ca995f167dc5e5') {{(pid=83493) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0faf9797-1f71-4a40-b4ac-2cffee8517e0]: (4, None) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[757371b8-c468-42df-b1a8-a04d80725463]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[78894c92-6d27-4b2e-b293-7fbda4fa2ec0]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468, portal: 172.16.0.220,3260]
Jul 31 15:04:27 user nova-compute[72239]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468, portal: 172.16.0.220,3260] successful.
Jul 31 15:04:27 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911a7119-d076-4773-9b93-ec934911c468 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[48637ad0-08d6-41a2-9d99-94481ee2b142]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] <== disconnect_volume: return (323ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 15:04:27 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Deleting instance files /opt/stack/data/nova/instances/3d70608b-fc54-4178-9aa6-98ca6198a37b_del
Jul 31 15:04:27 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Deletion of /opt/stack/data/nova/instances/3d70608b-fc54-4178-9aa6-98ca6198a37b_del complete
Jul 31 15:04:27 user nova-compute[72239]: INFO nova.compute.manager [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Took 1.26 seconds to destroy the instance on the hypervisor.
Jul 31 15:04:27 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 15:04:27 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 15:04:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:28 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:04:28 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Took 1.02 seconds to deallocate network for instance.
Jul 31 15:04:28 user nova-compute[72239]: DEBUG nova.compute.manager [req-8d651dc1-4564-40b9-b382-ca8c08e69a33 req-85289dd6-5218-41af-a304-a7f7b2e44441 service nova] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Received event network-vif-deleted-d115f55c-2a02-4b41-88b0-0922039e58ba {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:04:28 user nova-compute[72239]: INFO nova.compute.manager [req-8d651dc1-4564-40b9-b382-ca8c08e69a33 req-85289dd6-5218-41af-a304-a7f7b2e44441 service nova] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Neutron deleted interface d115f55c-2a02-4b41-88b0-0922039e58ba; detaching it from the instance and deleting it from the info cache
Jul 31 15:04:28 user nova-compute[72239]: DEBUG nova.network.neutron [req-8d651dc1-4564-40b9-b382-ca8c08e69a33 req-85289dd6-5218-41af-a304-a7f7b2e44441 service nova] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:04:28 user nova-compute[72239]: DEBUG nova.compute.manager [req-8d651dc1-4564-40b9-b382-ca8c08e69a33 req-85289dd6-5218-41af-a304-a7f7b2e44441 service nova] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Detach interface failed, port_id=d115f55c-2a02-4b41-88b0-0922039e58ba, reason: Instance 3d70608b-fc54-4178-9aa6-98ca6198a37b could not be found. {{(pid=72239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 15:04:28 user nova-compute[72239]: DEBUG nova.compute.manager [req-2a3dbca2-4836-46ba-85be-13b9401e384f req-d56bc149-8a44-4d8a-888e-5bd30ecf8870 service nova] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Received event network-vif-plugged-d115f55c-2a02-4b41-88b0-0922039e58ba {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:04:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-2a3dbca2-4836-46ba-85be-13b9401e384f req-d56bc149-8a44-4d8a-888e-5bd30ecf8870 service nova] Acquiring lock "3d70608b-fc54-4178-9aa6-98ca6198a37b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:04:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-2a3dbca2-4836-46ba-85be-13b9401e384f req-d56bc149-8a44-4d8a-888e-5bd30ecf8870 service nova] Lock "3d70608b-fc54-4178-9aa6-98ca6198a37b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:04:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-2a3dbca2-4836-46ba-85be-13b9401e384f req-d56bc149-8a44-4d8a-888e-5bd30ecf8870 service nova] Lock "3d70608b-fc54-4178-9aa6-98ca6198a37b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:04:28 user nova-compute[72239]: DEBUG nova.compute.manager [req-2a3dbca2-4836-46ba-85be-13b9401e384f req-d56bc149-8a44-4d8a-888e-5bd30ecf8870 service nova] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] No waiting events found dispatching network-vif-plugged-d115f55c-2a02-4b41-88b0-0922039e58ba {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:04:28 user nova-compute[72239]: WARNING nova.compute.manager [req-2a3dbca2-4836-46ba-85be-13b9401e384f req-d56bc149-8a44-4d8a-888e-5bd30ecf8870 service nova] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Received unexpected event network-vif-plugged-d115f55c-2a02-4b41-88b0-0922039e58ba for instance with vm_state active and task_state deleting.
Jul 31 15:04:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:32 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:33 user nova-compute[72239]: INFO nova.compute.manager [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Took 4.47 seconds to detach 1 volumes for instance.
Jul 31 15:04:33 user nova-compute[72239]: DEBUG nova.compute.manager [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Deleting volume: 911a7119-d076-4773-9b93-ec934911c468 {{(pid=72239) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 31 15:04:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:04:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:04:33 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:04:33 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:04:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.334s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:04:33 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Deleted allocations for instance 3d70608b-fc54-4178-9aa6-98ca6198a37b
Jul 31 15:04:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-3610a54e-a10d-42a9-838d-b8232a41b58b tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "3d70608b-fc54-4178-9aa6-98ca6198a37b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 7.344s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:04:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:39 user nova-compute[72239]: DEBUG nova.compute.manager [req-296b9823-3323-43d0-9434-42548f91610f req-2d2e38ea-f0de-455d-acfe-996d9f6879ef service nova] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Received event network-changed-6fdab9d3-d8f2-4406-ab69-d876d6137de6 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:04:39 user nova-compute[72239]: DEBUG nova.compute.manager [req-296b9823-3323-43d0-9434-42548f91610f req-2d2e38ea-f0de-455d-acfe-996d9f6879ef service nova] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Refreshing instance network info cache due to event network-changed-6fdab9d3-d8f2-4406-ab69-d876d6137de6. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:04:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-296b9823-3323-43d0-9434-42548f91610f req-2d2e38ea-f0de-455d-acfe-996d9f6879ef service nova] Acquiring lock "refresh_cache-824b19e8-b4af-4fd4-a1ef-f214e25caef2" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:04:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-296b9823-3323-43d0-9434-42548f91610f req-2d2e38ea-f0de-455d-acfe-996d9f6879ef service nova] Acquired lock "refresh_cache-824b19e8-b4af-4fd4-a1ef-f214e25caef2" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:04:39 user nova-compute[72239]: DEBUG nova.network.neutron [req-296b9823-3323-43d0-9434-42548f91610f req-2d2e38ea-f0de-455d-acfe-996d9f6879ef service nova] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Refreshing network info cache for port 6fdab9d3-d8f2-4406-ab69-d876d6137de6 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:04:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:39 user nova-compute[72239]: DEBUG nova.network.neutron [req-296b9823-3323-43d0-9434-42548f91610f req-2d2e38ea-f0de-455d-acfe-996d9f6879ef service nova] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Updated VIF entry in instance network info cache for port 6fdab9d3-d8f2-4406-ab69-d876d6137de6. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:04:39 user nova-compute[72239]: DEBUG nova.network.neutron [req-296b9823-3323-43d0-9434-42548f91610f req-2d2e38ea-f0de-455d-acfe-996d9f6879ef service nova] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Updating instance_info_cache with network_info: [{"id": "6fdab9d3-d8f2-4406-ab69-d876d6137de6", "address": "fa:16:3e:31:fb:ca", "network": {"id": "d728d291-b79b-4b43-a125-8e6d1667788b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2121566835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcfa13175edf4a009a781d344397d17b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fdab9d3-d8", "ovs_interfaceid": "6fdab9d3-d8f2-4406-ab69-d876d6137de6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:04:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-296b9823-3323-43d0-9434-42548f91610f req-2d2e38ea-f0de-455d-acfe-996d9f6879ef service nova] Releasing lock "refresh_cache-824b19e8-b4af-4fd4-a1ef-f214e25caef2" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:04:42 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690815867.1936984, 3d70608b-fc54-4178-9aa6-98ca6198a37b => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:04:42 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] VM Stopped (Lifecycle Event)
Jul 31 15:04:42 user nova-compute[72239]: DEBUG nova.compute.manager [None req-3547c18d-eea2-4354-80c6-988f04171e29 None None] [instance: 3d70608b-fc54-4178-9aa6-98ca6198a37b] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:04:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Acquiring lock "824b19e8-b4af-4fd4-a1ef-f214e25caef2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:04:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Lock "824b19e8-b4af-4fd4-a1ef-f214e25caef2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:04:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:44 user nova-compute[72239]: DEBUG nova.objects.instance [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Lazy-loading 'flavor' on Instance uuid 824b19e8-b4af-4fd4-a1ef-f214e25caef2 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:04:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Lock "824b19e8-b4af-4fd4-a1ef-f214e25caef2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:04:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Acquiring lock "824b19e8-b4af-4fd4-a1ef-f214e25caef2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:04:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Lock "824b19e8-b4af-4fd4-a1ef-f214e25caef2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:04:44 user nova-compute[72239]: INFO nova.compute.manager [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Attaching volume 9f69cb81-3955-4a99-a073-ad4ddb9ed8b7 to /dev/vdb
Jul 31 15:04:44 user nova-compute[72239]: DEBUG os_brick.utils [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:04:44 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:44 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:44 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b595fb83-119a-4125-a29d-52248c25de57]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:04:44 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:44 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:44 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0506e1ac-4c2c-4211-b3eb-099f1e13f04a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:04:44 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:44 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:44 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c39f8aa9-578c-4829-a339-d8b712ea88fe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:04:44 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[76020eb3-1d00-406f-816a-e9d51941d3fd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:04:44 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:44 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:04:44 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 15:04:44 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:44 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:04:44 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 15:04:44 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3b36ce-261e-429c-9c0e-3a14a8820b81]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:04:44 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 15:04:44 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 15:04:44 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 15:04:44 user nova-compute[72239]: DEBUG os_brick.utils [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:04:44 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Updating existing volume attachment record: 93d971d7-b1dd-488f-adfe-b4c3552dc845 {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 15:04:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Acquiring lock "a0ad5b63-4c93-4d82-8f1d-3dc851c1de49" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:04:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Lock "a0ad5b63-4c93-4d82-8f1d-3dc851c1de49" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:04:48 user nova-compute[72239]: DEBUG nova.compute.manager [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 15:04:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:04:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:04:48 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 15:04:48 user nova-compute[72239]: INFO nova.compute.claims [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Claim successful on node user
Jul 31 15:04:48 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:04:48 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:04:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.399s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:04:48 user nova-compute[72239]: DEBUG nova.compute.manager [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 15:04:48 user nova-compute[72239]: DEBUG nova.compute.manager [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 15:04:48 user nova-compute[72239]: DEBUG nova.network.neutron [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 15:04:48 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 15:04:48 user nova-compute[72239]: DEBUG nova.compute.manager [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 15:04:49 user nova-compute[72239]: DEBUG nova.policy [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd586e37da55746eb89ac48d602f85a88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '92ffcf9b2b124aaeb786147058bfe5ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 15:04:49 user nova-compute[72239]: DEBUG nova.compute.manager [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 15:04:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 15:04:49 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Creating image(s)
Jul 31 15:04:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Acquiring lock "/opt/stack/data/nova/instances/a0ad5b63-4c93-4d82-8f1d-3dc851c1de49/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:04:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Lock "/opt/stack/data/nova/instances/a0ad5b63-4c93-4d82-8f1d-3dc851c1de49/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:04:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Lock "/opt/stack/data/nova/instances/a0ad5b63-4c93-4d82-8f1d-3dc851c1de49/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:04:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.177s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Acquiring lock "ca449065000c92aac3b7b9fa685f9a7710929444" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:04:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:04:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.143s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/a0ad5b63-4c93-4d82-8f1d-3dc851c1de49/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/a0ad5b63-4c93-4d82-8f1d-3dc851c1de49/disk 1073741824" returned: 0 in 0.053s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:04:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.138s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:49 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a0ad5b63-4c93-4d82-8f1d-3dc851c1de49/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 15:04:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0ad5b63-4c93-4d82-8f1d-3dc851c1de49/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:49 user nova-compute[72239]: DEBUG nova.network.neutron [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Successfully created port: 145c1a27-3d11-4494-bcd6-6127430af85f {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 15:04:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:49 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0ad5b63-4c93-4d82-8f1d-3dc851c1de49/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:49 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Cannot resize image /opt/stack/data/nova/instances/a0ad5b63-4c93-4d82-8f1d-3dc851c1de49/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 15:04:49 user nova-compute[72239]: DEBUG nova.objects.instance [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Lazy-loading 'migration_context' on Instance uuid a0ad5b63-4c93-4d82-8f1d-3dc851c1de49 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:04:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 15:04:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Ensure instance console log exists: /opt/stack/data/nova/instances/a0ad5b63-4c93-4d82-8f1d-3dc851c1de49/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 15:04:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:04:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:04:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:04:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-278cd19c-016b-4550-8af9-0d73f3a3b313 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "b8652db6-b595-497f-a55d-8c0520bc18aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:04:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-278cd19c-016b-4550-8af9-0d73f3a3b313 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "b8652db6-b595-497f-a55d-8c0520bc18aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:04:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-278cd19c-016b-4550-8af9-0d73f3a3b313 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "b8652db6-b595-497f-a55d-8c0520bc18aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:04:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-278cd19c-016b-4550-8af9-0d73f3a3b313 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "b8652db6-b595-497f-a55d-8c0520bc18aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:04:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-278cd19c-016b-4550-8af9-0d73f3a3b313 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "b8652db6-b595-497f-a55d-8c0520bc18aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:04:50 user nova-compute[72239]: INFO nova.compute.manager [None req-278cd19c-016b-4550-8af9-0d73f3a3b313 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Terminating instance
Jul 31 15:04:50 user nova-compute[72239]: DEBUG nova.compute.manager [None req-278cd19c-016b-4550-8af9-0d73f3a3b313 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 15:04:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:50 user nova-compute[72239]: DEBUG nova.compute.manager [req-7637494c-f0b3-4b5f-adbd-bf184a497f90 req-58068553-6d71-4244-8317-393b0a43a1ce service nova] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Received event network-vif-unplugged-7c709373-3d22-47b8-84d4-2a66ab39628a {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:04:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7637494c-f0b3-4b5f-adbd-bf184a497f90 req-58068553-6d71-4244-8317-393b0a43a1ce service nova] Acquiring lock "b8652db6-b595-497f-a55d-8c0520bc18aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:04:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7637494c-f0b3-4b5f-adbd-bf184a497f90 req-58068553-6d71-4244-8317-393b0a43a1ce service nova] Lock "b8652db6-b595-497f-a55d-8c0520bc18aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:04:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7637494c-f0b3-4b5f-adbd-bf184a497f90 req-58068553-6d71-4244-8317-393b0a43a1ce service nova] Lock "b8652db6-b595-497f-a55d-8c0520bc18aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:04:50 user nova-compute[72239]: DEBUG nova.compute.manager [req-7637494c-f0b3-4b5f-adbd-bf184a497f90 req-58068553-6d71-4244-8317-393b0a43a1ce service nova] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] No waiting events found dispatching network-vif-unplugged-7c709373-3d22-47b8-84d4-2a66ab39628a {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:04:50 user nova-compute[72239]: DEBUG nova.compute.manager [req-7637494c-f0b3-4b5f-adbd-bf184a497f90 req-58068553-6d71-4244-8317-393b0a43a1ce service nova] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Received event network-vif-unplugged-7c709373-3d22-47b8-84d4-2a66ab39628a for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 15:04:51 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Instance destroyed successfully.
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.objects.instance [None req-278cd19c-016b-4550-8af9-0d73f3a3b313 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lazy-loading 'resources' on Instance uuid b8652db6-b595-497f-a55d-8c0520bc18aa {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-278cd19c-016b-4550-8af9-0d73f3a3b313 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T14:59:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1746021859',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1746021859',id=32,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBnHcaugoyVumipcH9iWbR1lH6GyUbvVWTu+gfxF3nDw9/alFMI2osrbpxmfLtRTIlFFqqtkJSfR4W10naiWe1TJWlwBT0OPz5w5h/X7U2hW973fUJVazvi3CvbACNSR5w==',key_name='tempest-keypair-1252123597',keypairs=<?>,launch_index=0,launched_at=2023-07-31T15:03:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a6715a7ff38401d844b620cb8d8769e',ramdisk_id='',reservation_id='r-twj02w4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-599528407',owner_user_name='tempest-AttachVolumeShelveTestJSON-599528407-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T15:03:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='70c6001a7ac5434fbc5ac7d003edd4eb',uuid=b8652db6-b595-497f-a55d-8c0520bc18aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c709373-3d22-47b8-84d4-2a66ab39628a", "address": "fa:16:3e:9c:a0:63", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c709373-3d", "ovs_interfaceid": "7c709373-3d22-47b8-84d4-2a66ab39628a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-278cd19c-016b-4550-8af9-0d73f3a3b313 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Converting VIF {"id": "7c709373-3d22-47b8-84d4-2a66ab39628a", "address": "fa:16:3e:9c:a0:63", "network": {"id": "37a946a3-d20a-4694-8647-73e84d2b0cb1", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-104829061-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a6715a7ff38401d844b620cb8d8769e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c709373-3d", "ovs_interfaceid": "7c709373-3d22-47b8-84d4-2a66ab39628a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-278cd19c-016b-4550-8af9-0d73f3a3b313 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:a0:63,bridge_name='br-int',has_traffic_filtering=True,id=7c709373-3d22-47b8-84d4-2a66ab39628a,network=Network(37a946a3-d20a-4694-8647-73e84d2b0cb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c709373-3d') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG os_vif [None req-278cd19c-016b-4550-8af9-0d73f3a3b313 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:a0:63,bridge_name='br-int',has_traffic_filtering=True,id=7c709373-3d22-47b8-84d4-2a66ab39628a,network=Network(37a946a3-d20a-4694-8647-73e84d2b0cb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c709373-3d') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c709373-3d, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:04:51 user nova-compute[72239]: INFO os_vif [None req-278cd19c-016b-4550-8af9-0d73f3a3b313 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:a0:63,bridge_name='br-int',has_traffic_filtering=True,id=7c709373-3d22-47b8-84d4-2a66ab39628a,network=Network(37a946a3-d20a-4694-8647-73e84d2b0cb1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c709373-3d')
Jul 31 15:04:51 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-278cd19c-016b-4550-8af9-0d73f3a3b313 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Deleting instance files /opt/stack/data/nova/instances/b8652db6-b595-497f-a55d-8c0520bc18aa_del
Jul 31 15:04:51 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-278cd19c-016b-4550-8af9-0d73f3a3b313 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Deletion of /opt/stack/data/nova/instances/b8652db6-b595-497f-a55d-8c0520bc18aa_del complete
Jul 31 15:04:51 user nova-compute[72239]: INFO nova.compute.manager [None req-278cd19c-016b-4550-8af9-0d73f3a3b313 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Took 0.98 seconds to destroy the instance on the hypervisor.
Jul 31 15:04:51 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-278cd19c-016b-4550-8af9-0d73f3a3b313 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.network.neutron [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Successfully updated port: 145c1a27-3d11-4494-bcd6-6127430af85f {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Acquiring lock "refresh_cache-a0ad5b63-4c93-4d82-8f1d-3dc851c1de49" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Acquired lock "refresh_cache-a0ad5b63-4c93-4d82-8f1d-3dc851c1de49" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.network.neutron [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.compute.manager [req-99f460cd-5fcc-4078-8bed-413edb30a787 req-0b18d947-7e8e-4cbb-adae-d0525ebf8d79 service nova] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Received event network-changed-145c1a27-3d11-4494-bcd6-6127430af85f {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.compute.manager [req-99f460cd-5fcc-4078-8bed-413edb30a787 req-0b18d947-7e8e-4cbb-adae-d0525ebf8d79 service nova] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Refreshing instance network info cache due to event network-changed-145c1a27-3d11-4494-bcd6-6127430af85f. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-99f460cd-5fcc-4078-8bed-413edb30a787 req-0b18d947-7e8e-4cbb-adae-d0525ebf8d79 service nova] Acquiring lock "refresh_cache-a0ad5b63-4c93-4d82-8f1d-3dc851c1de49" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.network.neutron [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.network.neutron [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Updating instance_info_cache with network_info: [{"id": "145c1a27-3d11-4494-bcd6-6127430af85f", "address": "fa:16:3e:a8:8c:a8", "network": {"id": "ee08e64c-9a31-4b92-aa9e-08bcf26fa155", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1612671911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ffcf9b2b124aaeb786147058bfe5ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap145c1a27-3d", "ovs_interfaceid": "145c1a27-3d11-4494-bcd6-6127430af85f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Releasing lock "refresh_cache-a0ad5b63-4c93-4d82-8f1d-3dc851c1de49" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.compute.manager [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Instance network_info: |[{"id": "145c1a27-3d11-4494-bcd6-6127430af85f", "address": "fa:16:3e:a8:8c:a8", "network": {"id": "ee08e64c-9a31-4b92-aa9e-08bcf26fa155", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1612671911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ffcf9b2b124aaeb786147058bfe5ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap145c1a27-3d", "ovs_interfaceid": "145c1a27-3d11-4494-bcd6-6127430af85f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-99f460cd-5fcc-4078-8bed-413edb30a787 req-0b18d947-7e8e-4cbb-adae-d0525ebf8d79 service nova] Acquired lock "refresh_cache-a0ad5b63-4c93-4d82-8f1d-3dc851c1de49" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.network.neutron [req-99f460cd-5fcc-4078-8bed-413edb30a787 req-0b18d947-7e8e-4cbb-adae-d0525ebf8d79 service nova] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Refreshing network info cache for port 145c1a27-3d11-4494-bcd6-6127430af85f {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Start _get_guest_xml network_info=[{"id": "145c1a27-3d11-4494-bcd6-6127430af85f", "address": "fa:16:3e:a8:8c:a8", "network": {"id": "ee08e64c-9a31-4b92-aa9e-08bcf26fa155", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1612671911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ffcf9b2b124aaeb786147058bfe5ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap145c1a27-3d", "ovs_interfaceid": "145c1a27-3d11-4494-bcd6-6127430af85f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 15:04:51 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:04:51 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:04:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1724598213',display_name='tempest-VolumesActionsTest-instance-1724598213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1724598213',id=41,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92ffcf9b2b124aaeb786147058bfe5ca',ramdisk_id='',reservation_id='r-jrfie8rf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-251272510',owner_user_name='tempest-VolumesActionsTest-251272510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T15:04:49Z,user_data=None,user_id='d586e37da55746eb89ac48d602f85a88',uuid=a0ad5b63-4c93-4d82-8f1d-3dc851c1de49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "145c1a27-3d11-4494-bcd6-6127430af85f", "address": "fa:16:3e:a8:8c:a8", "network": {"id": "ee08e64c-9a31-4b92-aa9e-08bcf26fa155", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1612671911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ffcf9b2b124aaeb786147058bfe5ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap145c1a27-3d", "ovs_interfaceid": "145c1a27-3d11-4494-bcd6-6127430af85f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Converting VIF {"id": "145c1a27-3d11-4494-bcd6-6127430af85f", "address": "fa:16:3e:a8:8c:a8", "network": {"id": "ee08e64c-9a31-4b92-aa9e-08bcf26fa155", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1612671911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ffcf9b2b124aaeb786147058bfe5ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap145c1a27-3d", "ovs_interfaceid": "145c1a27-3d11-4494-bcd6-6127430af85f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:8c:a8,bridge_name='br-int',has_traffic_filtering=True,id=145c1a27-3d11-4494-bcd6-6127430af85f,network=Network(ee08e64c-9a31-4b92-aa9e-08bcf26fa155),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap145c1a27-3d') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.objects.instance [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Lazy-loading 'pci_devices' on Instance uuid a0ad5b63-4c93-4d82-8f1d-3dc851c1de49 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] End _get_guest_xml xml=<domain type="kvm">
Jul 31 15:04:51 user nova-compute[72239]:   <uuid>a0ad5b63-4c93-4d82-8f1d-3dc851c1de49</uuid>
Jul 31 15:04:51 user nova-compute[72239]:   <name>instance-00000029</name>
Jul 31 15:04:51 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 15:04:51 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 15:04:51 user nova-compute[72239]:   <metadata>
Jul 31 15:04:51 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 15:04:51 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 15:04:51 user nova-compute[72239]:       <nova:name>tempest-VolumesActionsTest-instance-1724598213</nova:name>
Jul 31 15:04:51 user nova-compute[72239]:       <nova:creationTime>2023-07-31 15:04:51</nova:creationTime>
Jul 31 15:04:51 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 15:04:51 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 15:04:51 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 15:04:51 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 15:04:51 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 15:04:51 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 15:04:51 user nova-compute[72239]:       </nova:flavor>
Jul 31 15:04:51 user nova-compute[72239]:       <nova:owner>
Jul 31 15:04:51 user nova-compute[72239]:         <nova:user uuid="d586e37da55746eb89ac48d602f85a88">tempest-VolumesActionsTest-251272510-project-member</nova:user>
Jul 31 15:04:51 user nova-compute[72239]:         <nova:project uuid="92ffcf9b2b124aaeb786147058bfe5ca">tempest-VolumesActionsTest-251272510</nova:project>
Jul 31 15:04:51 user nova-compute[72239]:       </nova:owner>
Jul 31 15:04:51 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 15:04:51 user nova-compute[72239]:       <nova:ports>
Jul 31 15:04:51 user nova-compute[72239]:         <nova:port uuid="145c1a27-3d11-4494-bcd6-6127430af85f">
Jul 31 15:04:51 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 31 15:04:51 user nova-compute[72239]:         </nova:port>
Jul 31 15:04:51 user nova-compute[72239]:       </nova:ports>
Jul 31 15:04:51 user nova-compute[72239]:     </nova:instance>
Jul 31 15:04:51 user nova-compute[72239]:   </metadata>
Jul 31 15:04:51 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 15:04:51 user nova-compute[72239]:     <system>
Jul 31 15:04:51 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 15:04:51 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 15:04:51 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 15:04:51 user nova-compute[72239]:       <entry name="serial">a0ad5b63-4c93-4d82-8f1d-3dc851c1de49</entry>
Jul 31 15:04:51 user nova-compute[72239]:       <entry name="uuid">a0ad5b63-4c93-4d82-8f1d-3dc851c1de49</entry>
Jul 31 15:04:51 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 15:04:51 user nova-compute[72239]:     </system>
Jul 31 15:04:51 user nova-compute[72239]:   </sysinfo>
Jul 31 15:04:51 user nova-compute[72239]:   <os>
Jul 31 15:04:51 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 15:04:51 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 15:04:51 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 15:04:51 user nova-compute[72239]:   </os>
Jul 31 15:04:51 user nova-compute[72239]:   <features>
Jul 31 15:04:51 user nova-compute[72239]:     <acpi/>
Jul 31 15:04:51 user nova-compute[72239]:     <apic/>
Jul 31 15:04:51 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 15:04:51 user nova-compute[72239]:   </features>
Jul 31 15:04:51 user nova-compute[72239]:   <clock offset="utc">
Jul 31 15:04:51 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 15:04:51 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 15:04:51 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 15:04:51 user nova-compute[72239]:   </clock>
Jul 31 15:04:51 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 15:04:51 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 15:04:51 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 15:04:51 user nova-compute[72239]:   </cpu>
Jul 31 15:04:51 user nova-compute[72239]:   <devices>
Jul 31 15:04:51 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 15:04:51 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 15:04:51 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/a0ad5b63-4c93-4d82-8f1d-3dc851c1de49/disk"/>
Jul 31 15:04:51 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 15:04:51 user nova-compute[72239]:     </disk>
Jul 31 15:04:51 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 15:04:51 user nova-compute[72239]:       <mac address="fa:16:3e:a8:8c:a8"/>
Jul 31 15:04:51 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:04:51 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 15:04:51 user nova-compute[72239]:       <target dev="tap145c1a27-3d"/>
Jul 31 15:04:51 user nova-compute[72239]:     </interface>
Jul 31 15:04:51 user nova-compute[72239]:     <serial type="pty">
Jul 31 15:04:51 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/a0ad5b63-4c93-4d82-8f1d-3dc851c1de49/console.log" append="off"/>
Jul 31 15:04:51 user nova-compute[72239]:     </serial>
Jul 31 15:04:51 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 15:04:51 user nova-compute[72239]:     <video>
Jul 31 15:04:51 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:04:51 user nova-compute[72239]:     </video>
Jul 31 15:04:51 user nova-compute[72239]:     <rng model="virtio">
Jul 31 15:04:51 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 15:04:51 user nova-compute[72239]:     </rng>
Jul 31 15:04:51 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 15:04:51 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 15:04:51 user nova-compute[72239]:       <stats period="10"/>
Jul 31 15:04:51 user nova-compute[72239]:     </memballoon>
Jul 31 15:04:51 user nova-compute[72239]:   </devices>
Jul 31 15:04:51 user nova-compute[72239]: </domain>
Jul 31 15:04:51 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:04:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1724598213',display_name='tempest-VolumesActionsTest-instance-1724598213',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1724598213',id=41,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='92ffcf9b2b124aaeb786147058bfe5ca',ramdisk_id='',reservation_id='r-jrfie8rf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-251272510',owner_user_name='tempest-VolumesActionsTest-251272510-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T15:04:49Z,user_data=None,user_id='d586e37da55746eb89ac48d602f85a88',uuid=a0ad5b63-4c93-4d82-8f1d-3dc851c1de49,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "145c1a27-3d11-4494-bcd6-6127430af85f", "address": "fa:16:3e:a8:8c:a8", "network": {"id": "ee08e64c-9a31-4b92-aa9e-08bcf26fa155", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1612671911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ffcf9b2b124aaeb786147058bfe5ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap145c1a27-3d", "ovs_interfaceid": "145c1a27-3d11-4494-bcd6-6127430af85f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Converting VIF {"id": "145c1a27-3d11-4494-bcd6-6127430af85f", "address": "fa:16:3e:a8:8c:a8", "network": {"id": "ee08e64c-9a31-4b92-aa9e-08bcf26fa155", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1612671911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ffcf9b2b124aaeb786147058bfe5ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap145c1a27-3d", "ovs_interfaceid": "145c1a27-3d11-4494-bcd6-6127430af85f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:8c:a8,bridge_name='br-int',has_traffic_filtering=True,id=145c1a27-3d11-4494-bcd6-6127430af85f,network=Network(ee08e64c-9a31-4b92-aa9e-08bcf26fa155),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap145c1a27-3d') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG os_vif [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:8c:a8,bridge_name='br-int',has_traffic_filtering=True,id=145c1a27-3d11-4494-bcd6-6127430af85f,network=Network(ee08e64c-9a31-4b92-aa9e-08bcf26fa155),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap145c1a27-3d') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap145c1a27-3d, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap145c1a27-3d, col_values=(('external_ids', {'iface-id': '145c1a27-3d11-4494-bcd6-6127430af85f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:8c:a8', 'vm-uuid': 'a0ad5b63-4c93-4d82-8f1d-3dc851c1de49'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:51 user nova-compute[72239]: INFO os_vif [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:8c:a8,bridge_name='br-int',has_traffic_filtering=True,id=145c1a27-3d11-4494-bcd6-6127430af85f,network=Network(ee08e64c-9a31-4b92-aa9e-08bcf26fa155),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap145c1a27-3d')
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:04:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] No VIF found with MAC fa:16:3e:a8:8c:a8, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG nova.network.neutron [req-99f460cd-5fcc-4078-8bed-413edb30a787 req-0b18d947-7e8e-4cbb-adae-d0525ebf8d79 service nova] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Updated VIF entry in instance network info cache for port 145c1a27-3d11-4494-bcd6-6127430af85f. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG nova.network.neutron [req-99f460cd-5fcc-4078-8bed-413edb30a787 req-0b18d947-7e8e-4cbb-adae-d0525ebf8d79 service nova] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Updating instance_info_cache with network_info: [{"id": "145c1a27-3d11-4494-bcd6-6127430af85f", "address": "fa:16:3e:a8:8c:a8", "network": {"id": "ee08e64c-9a31-4b92-aa9e-08bcf26fa155", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1612671911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ffcf9b2b124aaeb786147058bfe5ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap145c1a27-3d", "ovs_interfaceid": "145c1a27-3d11-4494-bcd6-6127430af85f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:04:52 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Took 1.08 seconds to deallocate network for instance.
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-99f460cd-5fcc-4078-8bed-413edb30a787 req-0b18d947-7e8e-4cbb-adae-d0525ebf8d79 service nova] Releasing lock "refresh_cache-a0ad5b63-4c93-4d82-8f1d-3dc851c1de49" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bhPgTZnl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:04:52 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:04:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:04:52 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:04:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:04:52 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7 -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ef2032-64c3-4a98-af71-809e0f36a921]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 15:04:52 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-278cd19c-016b-4550-8af9-0d73f3a3b313 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-278cd19c-016b-4550-8af9-0d73f3a3b313 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec86816-52a7-4560-ab36-23f0bb4416bb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7] added
Jul 31 15:04:52 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG nova.compute.manager [req-60f09d42-f090-4972-90b3-8f702f38ced0 req-424e7671-a5cd-4340-8014-efbed70636b5 service nova] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Received event network-vif-deleted-7c709373-3d22-47b8-84d4-2a66ab39628a {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2418a64d-9966-4f6b-987c-964562bb59eb]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[080b2176-5d77-45bf-a94d-f1311321edb9]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bhPgTZnl {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bhPgTZnl" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[458c8908-ff76-41ae-9cff-70ae62156885]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bhPgTZnl'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d34a55-748e-4dc0-b1a0-91471434e940]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26ec881-7ce7-462b-8bd9-b3928779654d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 15:04:52 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 15:04:52 user nova-compute[72239]:  {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:04:52 user nova-compute[72239]: WARNING os_brick.initiator.connectors.iscsi [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 15:04:52 user nova-compute[72239]: 
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7 -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[637cd6c9-a86d-43b7-b8ac-09f01bcec22f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7, portal: 172.16.0.220,3260]
Jul 31 15:04:52 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7, portal: 172.16.0.220,3260] successful.
Jul 31 15:04:52 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7883f802-ebf9-46ce-b504-9fd6475ec21b]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[61eee524-f8fb-48b2-947d-46fd79f4b1da]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7 (non-flash)
Jul 31 15:04:52 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7 (non-flash)
Jul 31 15:04:52 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0be9f5e-d239-4975-a674-cef64f5e9cc1]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bhPgTZnl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG nova.compute.manager [req-cefa52ea-9d81-4867-aed4-ba5288df1d86 req-54f3abcb-1a33-4b72-b00c-45eaadc3238b service nova] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Received event network-vif-plugged-7c709373-3d22-47b8-84d4-2a66ab39628a {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-cefa52ea-9d81-4867-aed4-ba5288df1d86 req-54f3abcb-1a33-4b72-b00c-45eaadc3238b service nova] Acquiring lock "b8652db6-b595-497f-a55d-8c0520bc18aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-cefa52ea-9d81-4867-aed4-ba5288df1d86 req-54f3abcb-1a33-4b72-b00c-45eaadc3238b service nova] Lock "b8652db6-b595-497f-a55d-8c0520bc18aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-cefa52ea-9d81-4867-aed4-ba5288df1d86 req-54f3abcb-1a33-4b72-b00c-45eaadc3238b service nova] Lock "b8652db6-b595-497f-a55d-8c0520bc18aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG nova.compute.manager [req-cefa52ea-9d81-4867-aed4-ba5288df1d86 req-54f3abcb-1a33-4b72-b00c-45eaadc3238b service nova] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] No waiting events found dispatching network-vif-plugged-7c709373-3d22-47b8-84d4-2a66ab39628a {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:04:52 user nova-compute[72239]: WARNING nova.compute.manager [req-cefa52ea-9d81-4867-aed4-ba5288df1d86 req-54f3abcb-1a33-4b72-b00c-45eaadc3238b service nova] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Received unexpected event network-vif-plugged-7c709373-3d22-47b8-84d4-2a66ab39628a for instance with vm_state deleted and task_state None.
Jul 31 15:04:52 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-278cd19c-016b-4550-8af9-0d73f3a3b313 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-278cd19c-016b-4550-8af9-0d73f3a3b313 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-278cd19c-016b-4550-8af9-0d73f3a3b313 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.354s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:04:52 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-278cd19c-016b-4550-8af9-0d73f3a3b313 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Deleted allocations for instance b8652db6-b595-497f-a55d-8c0520bc18aa
Jul 31 15:04:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-278cd19c-016b-4550-8af9-0d73f3a3b313 tempest-AttachVolumeShelveTestJSON-599528407 tempest-AttachVolumeShelveTestJSON-599528407-project-member] Lock "b8652db6-b595-497f-a55d-8c0520bc18aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.613s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:04:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:53 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:04:53 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23361346634323465', 'path': '/dev/sdb'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:04:53 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361346634323465', 'path': '/dev/sdb'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 15:04:53 user nova-compute[72239]: DEBUG nova.objects.instance [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Lazy-loading 'flavor' on Instance uuid 824b19e8-b4af-4fd4-a1ef-f214e25caef2 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:04:53 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 15:04:53 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:04:53 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 15:04:53 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 15:04:53 user nova-compute[72239]:   <serial>9f69cb81-3955-4a99-a073-ad4ddb9ed8b7</serial>
Jul 31 15:04:53 user nova-compute[72239]: </disk>
Jul 31 15:04:53 user nova-compute[72239]:  {{(pid=72239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 15:04:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:54 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:04:54 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:04:54 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] No VIF found with MAC fa:16:3e:31:fb:ca, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 15:04:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-266559c2-7e85-426e-994d-09ff71541380 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Lock "824b19e8-b4af-4fd4-a1ef-f214e25caef2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.935s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:04:54 user nova-compute[72239]: DEBUG nova.compute.manager [req-cf78cadb-92e2-4171-8743-29c79dc822ec req-39b697d0-ea66-44d9-b25c-f11123fda808 service nova] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Received event network-vif-plugged-145c1a27-3d11-4494-bcd6-6127430af85f {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:04:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-cf78cadb-92e2-4171-8743-29c79dc822ec req-39b697d0-ea66-44d9-b25c-f11123fda808 service nova] Acquiring lock "a0ad5b63-4c93-4d82-8f1d-3dc851c1de49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:04:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-cf78cadb-92e2-4171-8743-29c79dc822ec req-39b697d0-ea66-44d9-b25c-f11123fda808 service nova] Lock "a0ad5b63-4c93-4d82-8f1d-3dc851c1de49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:04:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-cf78cadb-92e2-4171-8743-29c79dc822ec req-39b697d0-ea66-44d9-b25c-f11123fda808 service nova] Lock "a0ad5b63-4c93-4d82-8f1d-3dc851c1de49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:04:54 user nova-compute[72239]: DEBUG nova.compute.manager [req-cf78cadb-92e2-4171-8743-29c79dc822ec req-39b697d0-ea66-44d9-b25c-f11123fda808 service nova] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] No waiting events found dispatching network-vif-plugged-145c1a27-3d11-4494-bcd6-6127430af85f {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:04:54 user nova-compute[72239]: WARNING nova.compute.manager [req-cf78cadb-92e2-4171-8743-29c79dc822ec req-39b697d0-ea66-44d9-b25c-f11123fda808 service nova] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Received unexpected event network-vif-plugged-145c1a27-3d11-4494-bcd6-6127430af85f for instance with vm_state building and task_state spawning.
Jul 31 15:04:54 user nova-compute[72239]: DEBUG nova.compute.manager [req-cf78cadb-92e2-4171-8743-29c79dc822ec req-39b697d0-ea66-44d9-b25c-f11123fda808 service nova] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Received event network-vif-plugged-145c1a27-3d11-4494-bcd6-6127430af85f {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:04:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-cf78cadb-92e2-4171-8743-29c79dc822ec req-39b697d0-ea66-44d9-b25c-f11123fda808 service nova] Acquiring lock "a0ad5b63-4c93-4d82-8f1d-3dc851c1de49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:04:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-cf78cadb-92e2-4171-8743-29c79dc822ec req-39b697d0-ea66-44d9-b25c-f11123fda808 service nova] Lock "a0ad5b63-4c93-4d82-8f1d-3dc851c1de49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:04:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-cf78cadb-92e2-4171-8743-29c79dc822ec req-39b697d0-ea66-44d9-b25c-f11123fda808 service nova] Lock "a0ad5b63-4c93-4d82-8f1d-3dc851c1de49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:04:54 user nova-compute[72239]: DEBUG nova.compute.manager [req-cf78cadb-92e2-4171-8743-29c79dc822ec req-39b697d0-ea66-44d9-b25c-f11123fda808 service nova] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] No waiting events found dispatching network-vif-plugged-145c1a27-3d11-4494-bcd6-6127430af85f {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:04:54 user nova-compute[72239]: WARNING nova.compute.manager [req-cf78cadb-92e2-4171-8743-29c79dc822ec req-39b697d0-ea66-44d9-b25c-f11123fda808 service nova] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Received unexpected event network-vif-plugged-145c1a27-3d11-4494-bcd6-6127430af85f for instance with vm_state building and task_state spawning.
Jul 31 15:04:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:55 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815895.8652992, a0ad5b63-4c93-4d82-8f1d-3dc851c1de49 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:04:55 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] VM Resumed (Lifecycle Event)
Jul 31 15:04:55 user nova-compute[72239]: DEBUG nova.compute.manager [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 15:04:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 15:04:55 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Instance spawned successfully.
Jul 31 15:04:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 15:04:55 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:04:55 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:04:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:04:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:04:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:04:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:04:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:04:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:04:55 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 15:04:55 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815895.8685982, a0ad5b63-4c93-4d82-8f1d-3dc851c1de49 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:04:55 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] VM Started (Lifecycle Event)
Jul 31 15:04:55 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:04:55 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:04:55 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 15:04:55 user nova-compute[72239]: INFO nova.compute.manager [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Took 6.91 seconds to spawn the instance on the hypervisor.
Jul 31 15:04:55 user nova-compute[72239]: DEBUG nova.compute.manager [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:04:56 user nova-compute[72239]: INFO nova.compute.manager [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Took 7.64 seconds to build instance.
Jul 31 15:04:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-246eaf17-204c-4d36-917d-101afda746ba tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Lock "a0ad5b63-4c93-4d82-8f1d-3dc851c1de49" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.739s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:04:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bbc1e368-2354-4ca9-a6be-39b15da49c0c tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Acquiring lock "824b19e8-b4af-4fd4-a1ef-f214e25caef2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bbc1e368-2354-4ca9-a6be-39b15da49c0c tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Lock "824b19e8-b4af-4fd4-a1ef-f214e25caef2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:04:57 user nova-compute[72239]: INFO nova.compute.manager [None req-bbc1e368-2354-4ca9-a6be-39b15da49c0c tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Detaching volume 9f69cb81-3955-4a99-a073-ad4ddb9ed8b7
Jul 31 15:04:57 user nova-compute[72239]: INFO nova.virt.block_device [None req-bbc1e368-2354-4ca9-a6be-39b15da49c0c tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Attempting to driver detach volume 9f69cb81-3955-4a99-a073-ad4ddb9ed8b7 from mountpoint /dev/vdb
Jul 31 15:04:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bbc1e368-2354-4ca9-a6be-39b15da49c0c tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Attempting to detach device vdb from instance 824b19e8-b4af-4fd4-a1ef-f214e25caef2 from the persistent domain config. {{(pid=72239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-bbc1e368-2354-4ca9-a6be-39b15da49c0c tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 15:04:57 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:04:57 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 15:04:57 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 15:04:57 user nova-compute[72239]:   <serial>9f69cb81-3955-4a99-a073-ad4ddb9ed8b7</serial>
Jul 31 15:04:57 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 15:04:57 user nova-compute[72239]: </disk>
Jul 31 15:04:57 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 15:04:57 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-bbc1e368-2354-4ca9-a6be-39b15da49c0c tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Successfully detached device vdb from instance 824b19e8-b4af-4fd4-a1ef-f214e25caef2 from the persistent domain config.
Jul 31 15:04:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bbc1e368-2354-4ca9-a6be-39b15da49c0c tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 824b19e8-b4af-4fd4-a1ef-f214e25caef2 from the live domain config. {{(pid=72239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-bbc1e368-2354-4ca9-a6be-39b15da49c0c tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 15:04:57 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:04:57 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 15:04:57 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 15:04:57 user nova-compute[72239]:   <serial>9f69cb81-3955-4a99-a073-ad4ddb9ed8b7</serial>
Jul 31 15:04:57 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 15:04:57 user nova-compute[72239]: </disk>
Jul 31 15:04:57 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Received event <DeviceRemovedEvent: 1690815897.7486844, 824b19e8-b4af-4fd4-a1ef-f214e25caef2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72239) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bbc1e368-2354-4ca9-a6be-39b15da49c0c tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 824b19e8-b4af-4fd4-a1ef-f214e25caef2 {{(pid=72239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 15:04:57 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-bbc1e368-2354-4ca9-a6be-39b15da49c0c tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Successfully detached device vdb from instance 824b19e8-b4af-4fd4-a1ef-f214e25caef2 from the live domain config.
Jul 31 15:04:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbc1e368-2354-4ca9-a6be-39b15da49c0c tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc1e368-2354-4ca9-a6be-39b15da49c0c tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bhPgTZnl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:04:57 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-bbc1e368-2354-4ca9-a6be-39b15da49c0c tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:04:57 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-bbc1e368-2354-4ca9-a6be-39b15da49c0c tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-bbc1e368-2354-4ca9-a6be-39b15da49c0c tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc1e368-2354-4ca9-a6be-39b15da49c0c tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a62fba7-0173-4990-959e-1d66cbfa2354]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3430eabf-ab18-41e7-93cb-e948b4a6e3a1]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc1e368-2354-4ca9-a6be-39b15da49c0c tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7 (non-flash)
Jul 31 15:04:57 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc1e368-2354-4ca9-a6be-39b15da49c0c tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7 (non-flash)
Jul 31 15:04:57 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc1e368-2354-4ca9-a6be-39b15da49c0c tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41182d5090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7'): ({'sdb'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-bbc1e368-2354-4ca9-a6be-39b15da49c0c tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Removing single pathed devices sdb {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fedc378-fb3a-48c8-ac94-e6c63eb39c6e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b52e836-ff15-4844-96d8-28e9eeb0d98e]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-bbc1e368-2354-4ca9-a6be-39b15da49c0c tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Flushing IO for device /dev/sdb {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fd932c-a12c-49f0-bfe7-336f841683c8]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-bbc1e368-2354-4ca9-a6be-39b15da49c0c tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d34ec6f-1332-4edf-8097-4fc144d7246d]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-bbc1e368-2354-4ca9-a6be-39b15da49c0c tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-bbc1e368-2354-4ca9-a6be-39b15da49c0c tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc1e368-2354-4ca9-a6be-39b15da49c0c tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66170b1-0308-43e2-8cc7-7597dca7a101]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc1e368-2354-4ca9-a6be-39b15da49c0c tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:04:57 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7 -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:58 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66209a0-41a9-443e-8b84-e1556b10a45e]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:04:58 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc1e368-2354-4ca9-a6be-39b15da49c0c tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7, portal: 172.16.0.220,3260]
Jul 31 15:04:58 user nova-compute[72239]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7, portal: 172.16.0.220,3260] successful.
Jul 31 15:04:58 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:04:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7 -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:04:58 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9f69cb81-3955-4a99-a073-ad4ddb9ed8b7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:04:58 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98d8b99-6036-4b3c-b179-091607c21f5e]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:04:58 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc1e368-2354-4ca9-a6be-39b15da49c0c tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:04:58 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-bbc1e368-2354-4ca9-a6be-39b15da49c0c tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:04:58 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbc1e368-2354-4ca9-a6be-39b15da49c0c tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] <== disconnect_volume: return (291ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:04:58 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbc1e368-2354-4ca9-a6be-39b15da49c0c tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 15:04:58 user nova-compute[72239]: DEBUG nova.objects.instance [None req-bbc1e368-2354-4ca9-a6be-39b15da49c0c tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Lazy-loading 'flavor' on Instance uuid 824b19e8-b4af-4fd4-a1ef-f214e25caef2 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:04:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bbc1e368-2354-4ca9-a6be-39b15da49c0c tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Lock "824b19e8-b4af-4fd4-a1ef-f214e25caef2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.812s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:04:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:06 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690815890.9971497, b8652db6-b595-497f-a55d-8c0520bc18aa => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:05:06 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] VM Stopped (Lifecycle Event)
Jul 31 15:05:06 user nova-compute[72239]: DEBUG nova.compute.manager [None req-e6e96062-3bc4-4c1e-a333-86493cf7c0cb None None] [instance: b8652db6-b595-497f-a55d-8c0520bc18aa] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:05:06 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:05:06 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:06 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:05:06 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:05:06 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:05:06 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:07 user nova-compute[72239]: DEBUG nova.compute.manager [req-6778b117-a4b0-4f37-b834-4b64aae7d550 req-6d190ad2-0cfb-48c7-b843-84a454bd40cf service nova] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Received event network-changed-f41e1aaf-748e-4124-853d-b77e0c79ce72 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:05:07 user nova-compute[72239]: DEBUG nova.compute.manager [req-6778b117-a4b0-4f37-b834-4b64aae7d550 req-6d190ad2-0cfb-48c7-b843-84a454bd40cf service nova] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Refreshing instance network info cache due to event network-changed-f41e1aaf-748e-4124-853d-b77e0c79ce72. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:05:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-6778b117-a4b0-4f37-b834-4b64aae7d550 req-6d190ad2-0cfb-48c7-b843-84a454bd40cf service nova] Acquiring lock "refresh_cache-04eeae20-361e-4ac1-84be-e25cec586f76" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:05:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-6778b117-a4b0-4f37-b834-4b64aae7d550 req-6d190ad2-0cfb-48c7-b843-84a454bd40cf service nova] Acquired lock "refresh_cache-04eeae20-361e-4ac1-84be-e25cec586f76" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:05:07 user nova-compute[72239]: DEBUG nova.network.neutron [req-6778b117-a4b0-4f37-b834-4b64aae7d550 req-6d190ad2-0cfb-48c7-b843-84a454bd40cf service nova] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Refreshing network info cache for port f41e1aaf-748e-4124-853d-b77e0c79ce72 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:05:07 user nova-compute[72239]: DEBUG nova.network.neutron [req-6778b117-a4b0-4f37-b834-4b64aae7d550 req-6d190ad2-0cfb-48c7-b843-84a454bd40cf service nova] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Updated VIF entry in instance network info cache for port f41e1aaf-748e-4124-853d-b77e0c79ce72. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:05:07 user nova-compute[72239]: DEBUG nova.network.neutron [req-6778b117-a4b0-4f37-b834-4b64aae7d550 req-6d190ad2-0cfb-48c7-b843-84a454bd40cf service nova] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Updating instance_info_cache with network_info: [{"id": "f41e1aaf-748e-4124-853d-b77e0c79ce72", "address": "fa:16:3e:9b:c2:3f", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf41e1aaf-74", "ovs_interfaceid": "f41e1aaf-748e-4124-853d-b77e0c79ce72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:05:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-6778b117-a4b0-4f37-b834-4b64aae7d550 req-6d190ad2-0cfb-48c7-b843-84a454bd40cf service nova] Releasing lock "refresh_cache-04eeae20-361e-4ac1-84be-e25cec586f76" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:05:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:10 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:05:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "04eeae20-361e-4ac1-84be-e25cec586f76" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:05:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "04eeae20-361e-4ac1-84be-e25cec586f76" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:05:10 user nova-compute[72239]: DEBUG nova.objects.instance [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lazy-loading 'flavor' on Instance uuid 04eeae20-361e-4ac1-84be-e25cec586f76 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:05:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "04eeae20-361e-4ac1-84be-e25cec586f76" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:05:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "04eeae20-361e-4ac1-84be-e25cec586f76" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:05:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "04eeae20-361e-4ac1-84be-e25cec586f76" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:05:11 user nova-compute[72239]: INFO nova.compute.manager [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Attaching volume d5be3789-ad28-4f11-b104-71ecc4f40658 to /dev/vdb
Jul 31 15:05:11 user nova-compute[72239]: DEBUG os_brick.utils [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:05:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:11 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e5d14f-cb59-4ec2-8dbe-d44417ac2ce1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:05:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:11 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f606801c-e0f3-4a0e-973b-aa796d1ee0ce]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:05:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:11 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[92005a42-7ded-4419-ac95-a196640f1296]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:05:11 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8b0830-8d82-4b4a-90dc-fa53c1a9b1d4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:05:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:05:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 15:05:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:05:11 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 15:05:11 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e896c709-add0-4259-a071-06a0df95e39b]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:05:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 15:05:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 15:05:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 15:05:11 user nova-compute[72239]: DEBUG os_brick.utils [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:05:11 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Updating existing volume attachment record: d329a6eb-5608-498c-b1e5-eccd67846300 {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 15:05:11 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:05:11 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 15:05:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-0a89aa93-374f-4487-893b-58c15d42c84c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:05:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-0a89aa93-374f-4487-893b-58c15d42c84c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:05:11 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 15:05:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:11 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Updating instance_info_cache with network_info: [{"id": "73d584f4-4986-4f0c-8483-18ef254a21f4", "address": "fa:16:3e:22:aa:8c", "network": {"id": "39af8721-7023-4cb5-9e06-293f319d5d93", "bridge": "br-int", "label": "tempest-TestStampPattern-549999556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228abbe80ac416fbcc6013767ca9384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73d584f4-49", "ovs_interfaceid": "73d584f4-4986-4f0c-8483-18ef254a21f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:05:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-0a89aa93-374f-4487-893b-58c15d42c84c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:05:11 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 15:05:11 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:05:11 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:05:12 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:05:12 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Cleaning up deleted instances {{(pid=72239) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 15:05:12 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] There are 0 instances to clean {{(pid=72239) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 15:05:14 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:05:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:15 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:05:16 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:05:16 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:20 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:05:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:05:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:05:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:05:20 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 15:05:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0ad5b63-4c93-4d82-8f1d-3dc851c1de49/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0ad5b63-4c93-4d82-8f1d-3dc851c1de49/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0ad5b63-4c93-4d82-8f1d-3dc851c1de49/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0ad5b63-4c93-4d82-8f1d-3dc851c1de49/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:21 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:21 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:21 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:21 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/824b19e8-b4af-4fd4-a1ef-f214e25caef2/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:21 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/824b19e8-b4af-4fd4-a1ef-f214e25caef2/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:21 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/824b19e8-b4af-4fd4-a1ef-f214e25caef2/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:21 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/824b19e8-b4af-4fd4-a1ef-f214e25caef2/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:21 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95c53d76-a495-4922-a7af-fcbf8321f19b/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:21 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95c53d76-a495-4922-a7af-fcbf8321f19b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:21 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95c53d76-a495-4922-a7af-fcbf8321f19b/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:21 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95c53d76-a495-4922-a7af-fcbf8321f19b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:21 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:21 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ece926f-02cc-4909-80a2-6476885cc18a/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ece926f-02cc-4909-80a2-6476885cc18a/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ece926f-02cc-4909-80a2-6476885cc18a/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ff326067-a020-4c9f-87c9-dc69b84e16cd tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ff326067-a020-4c9f-87c9-dc69b84e16cd tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ff326067-a020-4c9f-87c9-dc69b84e16cd tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ff326067-a020-4c9f-87c9-dc69b84e16cd tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ff326067-a020-4c9f-87c9-dc69b84e16cd tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:05:22 user nova-compute[72239]: INFO nova.compute.manager [None req-ff326067-a020-4c9f-87c9-dc69b84e16cd tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Terminating instance
Jul 31 15:05:22 user nova-compute[72239]: DEBUG nova.compute.manager [None req-ff326067-a020-4c9f-87c9-dc69b84e16cd tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LOWDBswF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:05:22 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:05:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:05:22 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:05:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:05:22 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 15:05:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658 -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf197fb-dae4-48be-a07d-7995715a0437]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 15:05:22 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658 -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ece926f-02cc-4909-80a2-6476885cc18a/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04eeae20-361e-4ac1-84be-e25cec586f76/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8017729e-fad8-4fb2-9aea-c5d5810fffbf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658] added
Jul 31 15:05:22 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6a0104-c7da-42f9-bdc0-0aede3307083]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[65693c47-1e85-4212-bfad-1bbf67d1bf2d]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LOWDBswF {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LOWDBswF" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab9f9f3-e0a1-458f-b47f-fff5f913fa11]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LOWDBswF'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04eeae20-361e-4ac1-84be-e25cec586f76/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04eeae20-361e-4ac1-84be-e25cec586f76/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d9d861-01cb-4798-abf4-0e46b3fff0ac]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:05:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d67de6-f624-46ce-a08e-c748a86d594c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 15:05:23 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 15:05:23 user nova-compute[72239]:  {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:05:23 user nova-compute[72239]: WARNING os_brick.initiator.connectors.iscsi [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 15:05:23 user nova-compute[72239]: 
Jul 31 15:05:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658 -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad2ddc9-7cc9-4bf7-a20c-2652063e0b81]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658, portal: 172.16.0.220,3260]
Jul 31 15:05:23 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658, portal: 172.16.0.220,3260] successful.
Jul 31 15:05:23 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b41b10a-a726-4829-8ad7-ea9f5ea84016]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/04eeae20-361e-4ac1-84be-e25cec586f76/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2933e0-7596-4977-870d-613a44012ac6]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658 (non-flash)
Jul 31 15:05:23 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658 (non-flash)
Jul 31 15:05:23 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.393s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf06cba2-1fe1-4eba-89e5-47d8a4245514]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LOWDBswF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG nova.compute.manager [req-7829b587-593f-42b2-b820-d0b155c960d4 req-142f729c-db35-4691-8bd2-ee71511468f2 service nova] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Received event network-vif-unplugged-8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7829b587-593f-42b2-b820-d0b155c960d4 req-142f729c-db35-4691-8bd2-ee71511468f2 service nova] Acquiring lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7829b587-593f-42b2-b820-d0b155c960d4 req-142f729c-db35-4691-8bd2-ee71511468f2 service nova] Lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7829b587-593f-42b2-b820-d0b155c960d4 req-142f729c-db35-4691-8bd2-ee71511468f2 service nova] Lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG nova.compute.manager [req-7829b587-593f-42b2-b820-d0b155c960d4 req-142f729c-db35-4691-8bd2-ee71511468f2 service nova] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] No waiting events found dispatching network-vif-unplugged-8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG nova.compute.manager [req-7829b587-593f-42b2-b820-d0b155c960d4 req-142f729c-db35-4691-8bd2-ee71511468f2 service nova] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Received event network-vif-unplugged-8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 15:05:23 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:05:23 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:05:23 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=7566MB free_disk=25.034912109375GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:05:23 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Instance destroyed successfully.
Jul 31 15:05:23 user nova-compute[72239]: DEBUG nova.objects.instance [None req-ff326067-a020-4c9f-87c9-dc69b84e16cd tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lazy-loading 'resources' on Instance uuid c10918e9-9731-48ea-860e-8a02cb6a0ad9 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-ff326067-a020-4c9f-87c9-dc69b84e16cd tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T14:49:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1591567707',display_name='tempest-ServerActionsTestOtherA-server-1620341665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1591567707',id=16,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCcC0f3guhYTNzECKpfyNk4cXj6Y8F4GpucRwb/0EBaXIalClpDyM69s13M23SyVQiCvr0tglg8FRaf5C4ibRcE2Gd6CEj06wnsuSnTBc8jPOcwf8pDTnQMrdikVLzRidg==',key_name='tempest-keypair-538819016',keypairs=<?>,launch_index=0,launched_at=2023-07-31T14:53:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='217b0eef1c154602850f4cf2d81b7ead',ramdisk_id='',reservation_id='r-qi1uxdkp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-456571617',owner_user_name='tempest-ServerActionsTestOtherA-456571617-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T14:53:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d0e2796894b249cc868a888fac759983',uuid=c10918e9-9731-48ea-860e-8a02cb6a0ad9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "address": "fa:16:3e:56:1c:d6", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8307e7-0d", "ovs_interfaceid": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-ff326067-a020-4c9f-87c9-dc69b84e16cd tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Converting VIF {"id": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "address": "fa:16:3e:56:1c:d6", "network": {"id": "6d954fa8-21ae-4438-b6c0-6ae7fb37718c", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-482963277-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "217b0eef1c154602850f4cf2d81b7ead", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b8307e7-0d", "ovs_interfaceid": "8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-ff326067-a020-4c9f-87c9-dc69b84e16cd tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:1c:d6,bridge_name='br-int',has_traffic_filtering=True,id=8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed,network=Network(6d954fa8-21ae-4438-b6c0-6ae7fb37718c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8307e7-0d') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG os_vif [None req-ff326067-a020-4c9f-87c9-dc69b84e16cd tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:1c:d6,bridge_name='br-int',has_traffic_filtering=True,id=8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed,network=Network(6d954fa8-21ae-4438-b6c0-6ae7fb37718c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8307e7-0d') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b8307e7-0d, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:05:23 user nova-compute[72239]: INFO os_vif [None req-ff326067-a020-4c9f-87c9-dc69b84e16cd tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:1c:d6,bridge_name='br-int',has_traffic_filtering=True,id=8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed,network=Network(6d954fa8-21ae-4438-b6c0-6ae7fb37718c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b8307e7-0d')
Jul 31 15:05:23 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-ff326067-a020-4c9f-87c9-dc69b84e16cd tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Deleting instance files /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9_del
Jul 31 15:05:23 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-ff326067-a020-4c9f-87c9-dc69b84e16cd tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Deletion of /opt/stack/data/nova/instances/c10918e9-9731-48ea-860e-8a02cb6a0ad9_del complete
Jul 31 15:05:23 user nova-compute[72239]: INFO nova.compute.manager [None req-ff326067-a020-4c9f-87c9-dc69b84e16cd tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Took 1.20 seconds to destroy the instance on the hypervisor.
Jul 31 15:05:23 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-ff326067-a020-4c9f-87c9-dc69b84e16cd tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 15:05:23 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 15:05:24 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance c10918e9-9731-48ea-860e-8a02cb6a0ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:05:24 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 0a89aa93-374f-4487-893b-58c15d42c84c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:05:24 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance f98cea94-e905-47c5-bf88-5f5694934966 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:05:24 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 824b19e8-b4af-4fd4-a1ef-f214e25caef2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:05:24 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 04eeae20-361e-4ac1-84be-e25cec586f76 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:05:24 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 9ece926f-02cc-4909-80a2-6476885cc18a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:05:24 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 95c53d76-a495-4922-a7af-fcbf8321f19b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:05:24 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance a0ad5b63-4c93-4d82-8f1d-3dc851c1de49 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:05:24 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 15:05:24 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 15:05:24 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Refreshing inventories for resource provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 15:05:24 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Updating ProviderTree inventory for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 15:05:24 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Updating inventory in ProviderTree for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 15:05:24 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Refreshing aggregate associations for resource provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e, aggregates: None {{(pid=72239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 15:05:24 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.433s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:05:24 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] <== connect_volume: return (1434ms) {'type': 'block', 'scsi_wwn': '23135643461366366', 'path': '/dev/sdb'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:05:24 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135643461366366', 'path': '/dev/sdb'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 15:05:24 user nova-compute[72239]: DEBUG nova.objects.instance [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lazy-loading 'flavor' on Instance uuid 04eeae20-361e-4ac1-84be-e25cec586f76 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:05:24 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Refreshing trait associations for resource provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI {{(pid=72239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 15:05:24 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 15:05:24 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:05:24 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 15:05:24 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 15:05:24 user nova-compute[72239]:   <serial>d5be3789-ad28-4f11-b104-71ecc4f40658</serial>
Jul 31 15:05:24 user nova-compute[72239]: </disk>
Jul 31 15:05:24 user nova-compute[72239]:  {{(pid=72239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 15:05:24 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:05:24 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Took 0.48 seconds to deallocate network for instance.
Jul 31 15:05:24 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:05:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ff326067-a020-4c9f-87c9-dc69b84e16cd tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:05:24 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:05:24 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 15:05:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.697s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:05:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ff326067-a020-4c9f-87c9-dc69b84e16cd tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.037s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:05:24 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:05:24 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Cleaning up deleted instances with incomplete migration  {{(pid=72239) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 15:05:24 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:05:24 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:05:24 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] No VIF found with MAC fa:16:3e:9b:c2:3f, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 15:05:24 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-ff326067-a020-4c9f-87c9-dc69b84e16cd tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:05:24 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-ff326067-a020-4c9f-87c9-dc69b84e16cd tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:05:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ff326067-a020-4c9f-87c9-dc69b84e16cd tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.277s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:05:24 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-ff326067-a020-4c9f-87c9-dc69b84e16cd tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Deleted allocations for instance c10918e9-9731-48ea-860e-8a02cb6a0ad9
Jul 31 15:05:24 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-42918a40-7325-4215-a9b5-3406c20d07b7 tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "04eeae20-361e-4ac1-84be-e25cec586f76" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.723s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:05:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ff326067-a020-4c9f-87c9-dc69b84e16cd tempest-ServerActionsTestOtherA-456571617 tempest-ServerActionsTestOtherA-456571617-project-member] Lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.204s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:05:25 user nova-compute[72239]: DEBUG nova.compute.manager [req-5963d0d3-9fe9-4dfc-99da-7c1f85be46d1 req-2d5ecadf-c910-48c9-a7c7-252b691003c5 service nova] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Received event network-vif-plugged-8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:05:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5963d0d3-9fe9-4dfc-99da-7c1f85be46d1 req-2d5ecadf-c910-48c9-a7c7-252b691003c5 service nova] Acquiring lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:05:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5963d0d3-9fe9-4dfc-99da-7c1f85be46d1 req-2d5ecadf-c910-48c9-a7c7-252b691003c5 service nova] Lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:05:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5963d0d3-9fe9-4dfc-99da-7c1f85be46d1 req-2d5ecadf-c910-48c9-a7c7-252b691003c5 service nova] Lock "c10918e9-9731-48ea-860e-8a02cb6a0ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:05:25 user nova-compute[72239]: DEBUG nova.compute.manager [req-5963d0d3-9fe9-4dfc-99da-7c1f85be46d1 req-2d5ecadf-c910-48c9-a7c7-252b691003c5 service nova] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] No waiting events found dispatching network-vif-plugged-8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:05:25 user nova-compute[72239]: WARNING nova.compute.manager [req-5963d0d3-9fe9-4dfc-99da-7c1f85be46d1 req-2d5ecadf-c910-48c9-a7c7-252b691003c5 service nova] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Received unexpected event network-vif-plugged-8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed for instance with vm_state deleted and task_state None.
Jul 31 15:05:25 user nova-compute[72239]: DEBUG nova.compute.manager [req-5963d0d3-9fe9-4dfc-99da-7c1f85be46d1 req-2d5ecadf-c910-48c9-a7c7-252b691003c5 service nova] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Received event network-vif-deleted-8b8307e7-0d4a-4ca9-b5ad-740bcf6a31ed {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:05:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b10a4943-25dd-4da5-9870-73515ecf0b5f tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "04eeae20-361e-4ac1-84be-e25cec586f76" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:05:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b10a4943-25dd-4da5-9870-73515ecf0b5f tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "04eeae20-361e-4ac1-84be-e25cec586f76" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:05:25 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:05:25 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 15:05:25 user nova-compute[72239]: INFO nova.compute.manager [None req-b10a4943-25dd-4da5-9870-73515ecf0b5f tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Detaching volume d5be3789-ad28-4f11-b104-71ecc4f40658
Jul 31 15:05:25 user nova-compute[72239]: INFO nova.virt.block_device [None req-b10a4943-25dd-4da5-9870-73515ecf0b5f tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Attempting to driver detach volume d5be3789-ad28-4f11-b104-71ecc4f40658 from mountpoint /dev/vdb
Jul 31 15:05:25 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b10a4943-25dd-4da5-9870-73515ecf0b5f tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Attempting to detach device vdb from instance 04eeae20-361e-4ac1-84be-e25cec586f76 from the persistent domain config. {{(pid=72239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 15:05:25 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-b10a4943-25dd-4da5-9870-73515ecf0b5f tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 15:05:25 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:05:25 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 15:05:25 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 15:05:25 user nova-compute[72239]:   <serial>d5be3789-ad28-4f11-b104-71ecc4f40658</serial>
Jul 31 15:05:25 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 15:05:25 user nova-compute[72239]: </disk>
Jul 31 15:05:25 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 15:05:25 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-b10a4943-25dd-4da5-9870-73515ecf0b5f tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Successfully detached device vdb from instance 04eeae20-361e-4ac1-84be-e25cec586f76 from the persistent domain config.
Jul 31 15:05:25 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b10a4943-25dd-4da5-9870-73515ecf0b5f tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 04eeae20-361e-4ac1-84be-e25cec586f76 from the live domain config. {{(pid=72239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 15:05:25 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-b10a4943-25dd-4da5-9870-73515ecf0b5f tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 15:05:25 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:05:25 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 15:05:25 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 15:05:25 user nova-compute[72239]:   <serial>d5be3789-ad28-4f11-b104-71ecc4f40658</serial>
Jul 31 15:05:25 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 15:05:25 user nova-compute[72239]: </disk>
Jul 31 15:05:25 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Received event <DeviceRemovedEvent: 1690815926.0632129, 04eeae20-361e-4ac1-84be-e25cec586f76 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72239) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b10a4943-25dd-4da5-9870-73515ecf0b5f tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 04eeae20-361e-4ac1-84be-e25cec586f76 {{(pid=72239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 15:05:26 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-b10a4943-25dd-4da5-9870-73515ecf0b5f tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Successfully detached device vdb from instance 04eeae20-361e-4ac1-84be-e25cec586f76 from the live domain config.
Jul 31 15:05:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b10a4943-25dd-4da5-9870-73515ecf0b5f tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10a4943-25dd-4da5-9870-73515ecf0b5f tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LOWDBswF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:05:26 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-b10a4943-25dd-4da5-9870-73515ecf0b5f tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:05:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-b10a4943-25dd-4da5-9870-73515ecf0b5f tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-b10a4943-25dd-4da5-9870-73515ecf0b5f tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10a4943-25dd-4da5-9870-73515ecf0b5f tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dd2948c-27a1-4ee9-b506-bdcae5ef4e8e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[313a3505-27b0-409b-82b7-4edaa202ed67]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10a4943-25dd-4da5-9870-73515ecf0b5f tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658 (non-flash)
Jul 31 15:05:26 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10a4943-25dd-4da5-9870-73515ecf0b5f tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658 (non-flash)
Jul 31 15:05:26 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10a4943-25dd-4da5-9870-73515ecf0b5f tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41007d3880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658'): ({'sdb'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-b10a4943-25dd-4da5-9870-73515ecf0b5f tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Removing single pathed devices sdb {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[07124cc3-1108-4b34-8bd4-78cda89c3b55]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1fa9a7a-c3cc-4c1e-86a7-b6ef7761ef4d]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-b10a4943-25dd-4da5-9870-73515ecf0b5f tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Flushing IO for device /dev/sdb {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[44fb3d89-f012-4b65-8cc9-44f46bbf9d70]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-b10a4943-25dd-4da5-9870-73515ecf0b5f tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.093s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d656ff77-57e5-416d-b33c-514f5e40ab2c]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-b10a4943-25dd-4da5-9870-73515ecf0b5f tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-b10a4943-25dd-4da5-9870-73515ecf0b5f tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10a4943-25dd-4da5-9870-73515ecf0b5f tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1180de9e-3e9a-4584-91f2-43d0e29d18e0]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10a4943-25dd-4da5-9870-73515ecf0b5f tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658 -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1379a478-dfcf-4cf9-9218-80e28af65823]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10a4943-25dd-4da5-9870-73515ecf0b5f tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658, portal: 172.16.0.220,3260]
Jul 31 15:05:26 user nova-compute[72239]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658, portal: 172.16.0.220,3260] successful.
Jul 31 15:05:26 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658 -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5be3789-ad28-4f11-b104-71ecc4f40658 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[27675052-e7a0-48be-803b-f0dea4a18060]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10a4943-25dd-4da5-9870-73515ecf0b5f tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-b10a4943-25dd-4da5-9870-73515ecf0b5f tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b10a4943-25dd-4da5-9870-73515ecf0b5f tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] <== disconnect_volume: return (313ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:05:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b10a4943-25dd-4da5-9870-73515ecf0b5f tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 15:05:27 user nova-compute[72239]: DEBUG nova.objects.instance [None req-b10a4943-25dd-4da5-9870-73515ecf0b5f tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lazy-loading 'flavor' on Instance uuid 04eeae20-361e-4ac1-84be-e25cec586f76 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:05:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b10a4943-25dd-4da5-9870-73515ecf0b5f tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "04eeae20-361e-4ac1-84be-e25cec586f76" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.712s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:05:28 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:05:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:33 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:38 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690815923.5197659, c10918e9-9731-48ea-860e-8a02cb6a0ad9 => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:05:38 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] VM Stopped (Lifecycle Event)
Jul 31 15:05:38 user nova-compute[72239]: DEBUG nova.compute.manager [None req-0afa3012-08dd-4226-83bf-30338f0a5171 None None] [instance: c10918e9-9731-48ea-860e-8a02cb6a0ad9] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:05:38 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Acquiring lock "9ba7bc46-392d-4fd7-a85e-84b728d34d2e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:05:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lock "9ba7bc46-392d-4fd7-a85e-84b728d34d2e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:05:51 user nova-compute[72239]: DEBUG nova.compute.manager [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 15:05:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:05:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:05:51 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 15:05:51 user nova-compute[72239]: INFO nova.compute.claims [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Claim successful on node user
Jul 31 15:05:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2c7ff851-3470-4062-81e7-8ceff43935cb tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Acquiring lock "824b19e8-b4af-4fd4-a1ef-f214e25caef2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:05:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2c7ff851-3470-4062-81e7-8ceff43935cb tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Lock "824b19e8-b4af-4fd4-a1ef-f214e25caef2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:05:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2c7ff851-3470-4062-81e7-8ceff43935cb tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Acquiring lock "824b19e8-b4af-4fd4-a1ef-f214e25caef2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:05:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2c7ff851-3470-4062-81e7-8ceff43935cb tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Lock "824b19e8-b4af-4fd4-a1ef-f214e25caef2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:05:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2c7ff851-3470-4062-81e7-8ceff43935cb tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Lock "824b19e8-b4af-4fd4-a1ef-f214e25caef2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:05:51 user nova-compute[72239]: INFO nova.compute.manager [None req-2c7ff851-3470-4062-81e7-8ceff43935cb tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Terminating instance
Jul 31 15:05:52 user nova-compute[72239]: DEBUG nova.compute.manager [None req-2c7ff851-3470-4062-81e7-8ceff43935cb tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 15:05:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:52 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:05:52 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:05:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.528s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:05:52 user nova-compute[72239]: DEBUG nova.compute.manager [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 15:05:52 user nova-compute[72239]: DEBUG nova.compute.manager [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 15:05:52 user nova-compute[72239]: DEBUG nova.network.neutron [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 15:05:52 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 15:05:52 user nova-compute[72239]: DEBUG nova.compute.manager [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 15:05:52 user nova-compute[72239]: DEBUG nova.compute.manager [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 15:05:52 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 15:05:52 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Creating image(s)
Jul 31 15:05:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ba7bc46-392d-4fd7-a85e-84b728d34d2e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:05:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lock "/opt/stack/data/nova/instances/9ba7bc46-392d-4fd7-a85e-84b728d34d2e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:05:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lock "/opt/stack/data/nova/instances/9ba7bc46-392d-4fd7-a85e-84b728d34d2e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:05:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.140s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Acquiring lock "ca449065000c92aac3b7b9fa685f9a7710929444" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:05:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:05:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:52 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Instance destroyed successfully.
Jul 31 15:05:52 user nova-compute[72239]: DEBUG nova.objects.instance [None req-2c7ff851-3470-4062-81e7-8ceff43935cb tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Lazy-loading 'resources' on Instance uuid 824b19e8-b4af-4fd4-a1ef-f214e25caef2 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:05:52 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-2c7ff851-3470-4062-81e7-8ceff43935cb tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:02:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-959569854',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-959569854',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-9595698',id=37,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxwTiPCyvHmXbSWjtOjYze0FJpgz8a/UYUS10zj6t3r35HECrTZDEhNfpUS2+XwVZlwrtDoa/Ggigxjy1KzsZTv47NWAJYiq8kOKM+v1JQxQYVmpaYrIlM0creEbZXjYg==',key_name='tempest-keypair-1808541430',keypairs=<?>,launch_index=0,launched_at=2023-07-31T15:02:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fcfa13175edf4a009a781d344397d17b',ramdisk_id='',reservation_id='r-xt26sodw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1912909993',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T15:02:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='575c2513960842219b5b2e6dd4bbe0c1',uuid=824b19e8-b4af-4fd4-a1ef-f214e25caef2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6fdab9d3-d8f2-4406-ab69-d876d6137de6", "address": "fa:16:3e:31:fb:ca", "network": {"id": "d728d291-b79b-4b43-a125-8e6d1667788b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2121566835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcfa13175edf4a009a781d344397d17b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fdab9d3-d8", "ovs_interfaceid": "6fdab9d3-d8f2-4406-ab69-d876d6137de6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 15:05:52 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-2c7ff851-3470-4062-81e7-8ceff43935cb tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Converting VIF {"id": "6fdab9d3-d8f2-4406-ab69-d876d6137de6", "address": "fa:16:3e:31:fb:ca", "network": {"id": "d728d291-b79b-4b43-a125-8e6d1667788b", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2121566835-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.142", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fcfa13175edf4a009a781d344397d17b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6fdab9d3-d8", "ovs_interfaceid": "6fdab9d3-d8f2-4406-ab69-d876d6137de6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:05:52 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-2c7ff851-3470-4062-81e7-8ceff43935cb tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:fb:ca,bridge_name='br-int',has_traffic_filtering=True,id=6fdab9d3-d8f2-4406-ab69-d876d6137de6,network=Network(d728d291-b79b-4b43-a125-8e6d1667788b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fdab9d3-d8') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:05:52 user nova-compute[72239]: DEBUG os_vif [None req-2c7ff851-3470-4062-81e7-8ceff43935cb tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:fb:ca,bridge_name='br-int',has_traffic_filtering=True,id=6fdab9d3-d8f2-4406-ab69-d876d6137de6,network=Network(d728d291-b79b-4b43-a125-8e6d1667788b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fdab9d3-d8') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 15:05:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6fdab9d3-d8, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:05:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:52 user nova-compute[72239]: INFO os_vif [None req-2c7ff851-3470-4062-81e7-8ceff43935cb tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:fb:ca,bridge_name='br-int',has_traffic_filtering=True,id=6fdab9d3-d8f2-4406-ab69-d876d6137de6,network=Network(d728d291-b79b-4b43-a125-8e6d1667788b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6fdab9d3-d8')
Jul 31 15:05:52 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-2c7ff851-3470-4062-81e7-8ceff43935cb tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Deleting instance files /opt/stack/data/nova/instances/824b19e8-b4af-4fd4-a1ef-f214e25caef2_del
Jul 31 15:05:52 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-2c7ff851-3470-4062-81e7-8ceff43935cb tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Deletion of /opt/stack/data/nova/instances/824b19e8-b4af-4fd4-a1ef-f214e25caef2_del complete
Jul 31 15:05:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.158s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/9ba7bc46-392d-4fd7-a85e-84b728d34d2e/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:52 user nova-compute[72239]: DEBUG nova.policy [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ecf54f41fcb1435487f421510891440e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '680110c45b9b4484ac099c9389ebe1ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 15:05:53 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/9ba7bc46-392d-4fd7-a85e-84b728d34d2e/disk 1073741824" returned: 0 in 0.114s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:05:53 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:53 user nova-compute[72239]: INFO nova.compute.manager [None req-2c7ff851-3470-4062-81e7-8ceff43935cb tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Took 1.08 seconds to destroy the instance on the hypervisor.
Jul 31 15:05:53 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-2c7ff851-3470-4062-81e7-8ceff43935cb tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 15:05:53 user nova-compute[72239]: DEBUG nova.compute.manager [req-559485f8-db2a-4aa4-9f5d-c825d488b3e8 req-de7e5d09-d193-4f4d-9a1a-7bb3d6e6c4d7 service nova] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Received event network-vif-unplugged-6fdab9d3-d8f2-4406-ab69-d876d6137de6 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:05:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-559485f8-db2a-4aa4-9f5d-c825d488b3e8 req-de7e5d09-d193-4f4d-9a1a-7bb3d6e6c4d7 service nova] Acquiring lock "824b19e8-b4af-4fd4-a1ef-f214e25caef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:05:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-559485f8-db2a-4aa4-9f5d-c825d488b3e8 req-de7e5d09-d193-4f4d-9a1a-7bb3d6e6c4d7 service nova] Lock "824b19e8-b4af-4fd4-a1ef-f214e25caef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:05:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-559485f8-db2a-4aa4-9f5d-c825d488b3e8 req-de7e5d09-d193-4f4d-9a1a-7bb3d6e6c4d7 service nova] Lock "824b19e8-b4af-4fd4-a1ef-f214e25caef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:05:53 user nova-compute[72239]: DEBUG nova.compute.manager [req-559485f8-db2a-4aa4-9f5d-c825d488b3e8 req-de7e5d09-d193-4f4d-9a1a-7bb3d6e6c4d7 service nova] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] No waiting events found dispatching network-vif-unplugged-6fdab9d3-d8f2-4406-ab69-d876d6137de6 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:05:53 user nova-compute[72239]: DEBUG nova.compute.manager [req-559485f8-db2a-4aa4-9f5d-c825d488b3e8 req-de7e5d09-d193-4f4d-9a1a-7bb3d6e6c4d7 service nova] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Received event network-vif-unplugged-6fdab9d3-d8f2-4406-ab69-d876d6137de6 for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 15:05:53 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 15:05:53 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 15:05:53 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.155s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:53 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ba7bc46-392d-4fd7-a85e-84b728d34d2e/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 15:05:53 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ba7bc46-392d-4fd7-a85e-84b728d34d2e/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:05:53 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ba7bc46-392d-4fd7-a85e-84b728d34d2e/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:05:53 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Cannot resize image /opt/stack/data/nova/instances/9ba7bc46-392d-4fd7-a85e-84b728d34d2e/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 15:05:53 user nova-compute[72239]: DEBUG nova.objects.instance [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lazy-loading 'migration_context' on Instance uuid 9ba7bc46-392d-4fd7-a85e-84b728d34d2e {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:05:53 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 15:05:53 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Ensure instance console log exists: /opt/stack/data/nova/instances/9ba7bc46-392d-4fd7-a85e-84b728d34d2e/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 15:05:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:05:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:05:53 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:05:54 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:05:54 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Took 1.03 seconds to deallocate network for instance.
Jul 31 15:05:54 user nova-compute[72239]: DEBUG nova.compute.manager [req-e79a9c73-8667-4b83-9c79-0f6b32064b75 req-e24f926c-bbdd-418a-8a04-37ff0757f938 service nova] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Received event network-vif-deleted-6fdab9d3-d8f2-4406-ab69-d876d6137de6 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:05:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2c7ff851-3470-4062-81e7-8ceff43935cb tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:05:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2c7ff851-3470-4062-81e7-8ceff43935cb tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:05:54 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-2c7ff851-3470-4062-81e7-8ceff43935cb tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:05:54 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-2c7ff851-3470-4062-81e7-8ceff43935cb tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:05:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2c7ff851-3470-4062-81e7-8ceff43935cb tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.296s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:05:54 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-2c7ff851-3470-4062-81e7-8ceff43935cb tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Deleted allocations for instance 824b19e8-b4af-4fd4-a1ef-f214e25caef2
Jul 31 15:05:54 user nova-compute[72239]: DEBUG nova.network.neutron [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Successfully created port: 38b94412-ebcb-4c39-9856-d328dac47a43 {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 15:05:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2c7ff851-3470-4062-81e7-8ceff43935cb tempest-TestServerVolumeAttachScenarioOldVersion-1912909993 tempest-TestServerVolumeAttachScenarioOldVersion-1912909993-project-member] Lock "824b19e8-b4af-4fd4-a1ef-f214e25caef2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.650s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:05:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:55 user nova-compute[72239]: DEBUG nova.compute.manager [req-b24fa1de-44ac-4f89-84ed-4a30d4ac7a7d req-95a922c3-9db2-41c1-a757-75988df4f4f3 service nova] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Received event network-vif-plugged-6fdab9d3-d8f2-4406-ab69-d876d6137de6 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:05:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b24fa1de-44ac-4f89-84ed-4a30d4ac7a7d req-95a922c3-9db2-41c1-a757-75988df4f4f3 service nova] Acquiring lock "824b19e8-b4af-4fd4-a1ef-f214e25caef2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:05:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b24fa1de-44ac-4f89-84ed-4a30d4ac7a7d req-95a922c3-9db2-41c1-a757-75988df4f4f3 service nova] Lock "824b19e8-b4af-4fd4-a1ef-f214e25caef2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:05:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b24fa1de-44ac-4f89-84ed-4a30d4ac7a7d req-95a922c3-9db2-41c1-a757-75988df4f4f3 service nova] Lock "824b19e8-b4af-4fd4-a1ef-f214e25caef2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:05:55 user nova-compute[72239]: DEBUG nova.compute.manager [req-b24fa1de-44ac-4f89-84ed-4a30d4ac7a7d req-95a922c3-9db2-41c1-a757-75988df4f4f3 service nova] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] No waiting events found dispatching network-vif-plugged-6fdab9d3-d8f2-4406-ab69-d876d6137de6 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:05:55 user nova-compute[72239]: WARNING nova.compute.manager [req-b24fa1de-44ac-4f89-84ed-4a30d4ac7a7d req-95a922c3-9db2-41c1-a757-75988df4f4f3 service nova] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Received unexpected event network-vif-plugged-6fdab9d3-d8f2-4406-ab69-d876d6137de6 for instance with vm_state deleted and task_state None.
Jul 31 15:05:56 user nova-compute[72239]: DEBUG nova.network.neutron [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Successfully updated port: 38b94412-ebcb-4c39-9856-d328dac47a43 {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 15:05:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Acquiring lock "refresh_cache-9ba7bc46-392d-4fd7-a85e-84b728d34d2e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:05:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Acquired lock "refresh_cache-9ba7bc46-392d-4fd7-a85e-84b728d34d2e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:05:56 user nova-compute[72239]: DEBUG nova.network.neutron [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 15:05:56 user nova-compute[72239]: DEBUG nova.network.neutron [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG nova.compute.manager [req-519fc649-82ef-4052-a60c-990550ce9f93 req-57c7ab2d-4958-41c5-9024-59605f078764 service nova] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Received event network-changed-38b94412-ebcb-4c39-9856-d328dac47a43 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG nova.compute.manager [req-519fc649-82ef-4052-a60c-990550ce9f93 req-57c7ab2d-4958-41c5-9024-59605f078764 service nova] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Refreshing instance network info cache due to event network-changed-38b94412-ebcb-4c39-9856-d328dac47a43. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-519fc649-82ef-4052-a60c-990550ce9f93 req-57c7ab2d-4958-41c5-9024-59605f078764 service nova] Acquiring lock "refresh_cache-9ba7bc46-392d-4fd7-a85e-84b728d34d2e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG nova.network.neutron [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Updating instance_info_cache with network_info: [{"id": "38b94412-ebcb-4c39-9856-d328dac47a43", "address": "fa:16:3e:16:9d:79", "network": {"id": "982c660e-02ba-428c-93d9-774e0c381aba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-768235194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "680110c45b9b4484ac099c9389ebe1ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b94412-eb", "ovs_interfaceid": "38b94412-ebcb-4c39-9856-d328dac47a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Releasing lock "refresh_cache-9ba7bc46-392d-4fd7-a85e-84b728d34d2e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG nova.compute.manager [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Instance network_info: |[{"id": "38b94412-ebcb-4c39-9856-d328dac47a43", "address": "fa:16:3e:16:9d:79", "network": {"id": "982c660e-02ba-428c-93d9-774e0c381aba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-768235194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "680110c45b9b4484ac099c9389ebe1ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b94412-eb", "ovs_interfaceid": "38b94412-ebcb-4c39-9856-d328dac47a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-519fc649-82ef-4052-a60c-990550ce9f93 req-57c7ab2d-4958-41c5-9024-59605f078764 service nova] Acquired lock "refresh_cache-9ba7bc46-392d-4fd7-a85e-84b728d34d2e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG nova.network.neutron [req-519fc649-82ef-4052-a60c-990550ce9f93 req-57c7ab2d-4958-41c5-9024-59605f078764 service nova] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Refreshing network info cache for port 38b94412-ebcb-4c39-9856-d328dac47a43 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Start _get_guest_xml network_info=[{"id": "38b94412-ebcb-4c39-9856-d328dac47a43", "address": "fa:16:3e:16:9d:79", "network": {"id": "982c660e-02ba-428c-93d9-774e0c381aba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-768235194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "680110c45b9b4484ac099c9389ebe1ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b94412-eb", "ovs_interfaceid": "38b94412-ebcb-4c39-9856-d328dac47a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d8d65261-2679-4528-8db1-ece21b9aeb41 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Acquiring lock "9ece926f-02cc-4909-80a2-6476885cc18a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d8d65261-2679-4528-8db1-ece21b9aeb41 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Lock "9ece926f-02cc-4909-80a2-6476885cc18a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d8d65261-2679-4528-8db1-ece21b9aeb41 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Acquiring lock "9ece926f-02cc-4909-80a2-6476885cc18a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d8d65261-2679-4528-8db1-ece21b9aeb41 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Lock "9ece926f-02cc-4909-80a2-6476885cc18a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d8d65261-2679-4528-8db1-ece21b9aeb41 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Lock "9ece926f-02cc-4909-80a2-6476885cc18a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:05:57 user nova-compute[72239]: INFO nova.compute.manager [None req-d8d65261-2679-4528-8db1-ece21b9aeb41 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Terminating instance
Jul 31 15:05:57 user nova-compute[72239]: DEBUG nova.compute.manager [None req-d8d65261-2679-4528-8db1-ece21b9aeb41 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 15:05:57 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:05:57 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:05:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:05:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1519585139',display_name='tempest-TestServerVolumeAttachmentScenario-server-1519585139',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1519585139',id=42,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB05nQUADzTgDT7Sjf7pG1UJRbyQSH2o2BFUxYAOOMlqLQxISuxZy1qbuD/sbzBZhwiK3REgvVhdk/jX7BzduP+IQW2sxfJvd476ZQ52+TtKz41oY1dLAf9Su9f47QfTqA==',key_name='tempest-keypair-451366580',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='680110c45b9b4484ac099c9389ebe1ab',ramdisk_id='',reservation_id='r-x9jpussz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-444464408',owner_user_name='tempest-TestServerVolumeAttachmentScenario-444464408-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T15:05:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecf54f41fcb1435487f421510891440e',uuid=9ba7bc46-392d-4fd7-a85e-84b728d34d2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38b94412-ebcb-4c39-9856-d328dac47a43", "address": "fa:16:3e:16:9d:79", "network": {"id": "982c660e-02ba-428c-93d9-774e0c381aba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-768235194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "680110c45b9b4484ac099c9389ebe1ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b94412-eb", "ovs_interfaceid": "38b94412-ebcb-4c39-9856-d328dac47a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Converting VIF {"id": "38b94412-ebcb-4c39-9856-d328dac47a43", "address": "fa:16:3e:16:9d:79", "network": {"id": "982c660e-02ba-428c-93d9-774e0c381aba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-768235194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "680110c45b9b4484ac099c9389ebe1ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b94412-eb", "ovs_interfaceid": "38b94412-ebcb-4c39-9856-d328dac47a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:9d:79,bridge_name='br-int',has_traffic_filtering=True,id=38b94412-ebcb-4c39-9856-d328dac47a43,network=Network(982c660e-02ba-428c-93d9-774e0c381aba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38b94412-eb') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG nova.objects.instance [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ba7bc46-392d-4fd7-a85e-84b728d34d2e {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] End _get_guest_xml xml=<domain type="kvm">
Jul 31 15:05:57 user nova-compute[72239]:   <uuid>9ba7bc46-392d-4fd7-a85e-84b728d34d2e</uuid>
Jul 31 15:05:57 user nova-compute[72239]:   <name>instance-0000002a</name>
Jul 31 15:05:57 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 15:05:57 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 15:05:57 user nova-compute[72239]:   <metadata>
Jul 31 15:05:57 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 15:05:57 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 15:05:57 user nova-compute[72239]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1519585139</nova:name>
Jul 31 15:05:57 user nova-compute[72239]:       <nova:creationTime>2023-07-31 15:05:57</nova:creationTime>
Jul 31 15:05:57 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 15:05:57 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 15:05:57 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 15:05:57 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 15:05:57 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 15:05:57 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 15:05:57 user nova-compute[72239]:       </nova:flavor>
Jul 31 15:05:57 user nova-compute[72239]:       <nova:owner>
Jul 31 15:05:57 user nova-compute[72239]:         <nova:user uuid="ecf54f41fcb1435487f421510891440e">tempest-TestServerVolumeAttachmentScenario-444464408-project-member</nova:user>
Jul 31 15:05:57 user nova-compute[72239]:         <nova:project uuid="680110c45b9b4484ac099c9389ebe1ab">tempest-TestServerVolumeAttachmentScenario-444464408</nova:project>
Jul 31 15:05:57 user nova-compute[72239]:       </nova:owner>
Jul 31 15:05:57 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 15:05:57 user nova-compute[72239]:       <nova:ports>
Jul 31 15:05:57 user nova-compute[72239]:         <nova:port uuid="38b94412-ebcb-4c39-9856-d328dac47a43">
Jul 31 15:05:57 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 31 15:05:57 user nova-compute[72239]:         </nova:port>
Jul 31 15:05:57 user nova-compute[72239]:       </nova:ports>
Jul 31 15:05:57 user nova-compute[72239]:     </nova:instance>
Jul 31 15:05:57 user nova-compute[72239]:   </metadata>
Jul 31 15:05:57 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 15:05:57 user nova-compute[72239]:     <system>
Jul 31 15:05:57 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 15:05:57 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 15:05:57 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 15:05:57 user nova-compute[72239]:       <entry name="serial">9ba7bc46-392d-4fd7-a85e-84b728d34d2e</entry>
Jul 31 15:05:57 user nova-compute[72239]:       <entry name="uuid">9ba7bc46-392d-4fd7-a85e-84b728d34d2e</entry>
Jul 31 15:05:57 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 15:05:57 user nova-compute[72239]:     </system>
Jul 31 15:05:57 user nova-compute[72239]:   </sysinfo>
Jul 31 15:05:57 user nova-compute[72239]:   <os>
Jul 31 15:05:57 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 15:05:57 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 15:05:57 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 15:05:57 user nova-compute[72239]:   </os>
Jul 31 15:05:57 user nova-compute[72239]:   <features>
Jul 31 15:05:57 user nova-compute[72239]:     <acpi/>
Jul 31 15:05:57 user nova-compute[72239]:     <apic/>
Jul 31 15:05:57 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 15:05:57 user nova-compute[72239]:   </features>
Jul 31 15:05:57 user nova-compute[72239]:   <clock offset="utc">
Jul 31 15:05:57 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 15:05:57 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 15:05:57 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 15:05:57 user nova-compute[72239]:   </clock>
Jul 31 15:05:57 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 15:05:57 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 15:05:57 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 15:05:57 user nova-compute[72239]:   </cpu>
Jul 31 15:05:57 user nova-compute[72239]:   <devices>
Jul 31 15:05:57 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 15:05:57 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 15:05:57 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/9ba7bc46-392d-4fd7-a85e-84b728d34d2e/disk"/>
Jul 31 15:05:57 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 15:05:57 user nova-compute[72239]:     </disk>
Jul 31 15:05:57 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 15:05:57 user nova-compute[72239]:       <mac address="fa:16:3e:16:9d:79"/>
Jul 31 15:05:57 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:05:57 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 15:05:57 user nova-compute[72239]:       <target dev="tap38b94412-eb"/>
Jul 31 15:05:57 user nova-compute[72239]:     </interface>
Jul 31 15:05:57 user nova-compute[72239]:     <serial type="pty">
Jul 31 15:05:57 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/9ba7bc46-392d-4fd7-a85e-84b728d34d2e/console.log" append="off"/>
Jul 31 15:05:57 user nova-compute[72239]:     </serial>
Jul 31 15:05:57 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 15:05:57 user nova-compute[72239]:     <video>
Jul 31 15:05:57 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:05:57 user nova-compute[72239]:     </video>
Jul 31 15:05:57 user nova-compute[72239]:     <rng model="virtio">
Jul 31 15:05:57 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 15:05:57 user nova-compute[72239]:     </rng>
Jul 31 15:05:57 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 15:05:57 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 15:05:57 user nova-compute[72239]:       <stats period="10"/>
Jul 31 15:05:57 user nova-compute[72239]:     </memballoon>
Jul 31 15:05:57 user nova-compute[72239]:   </devices>
Jul 31 15:05:57 user nova-compute[72239]: </domain>
Jul 31 15:05:57 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:05:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1519585139',display_name='tempest-TestServerVolumeAttachmentScenario-server-1519585139',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1519585139',id=42,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB05nQUADzTgDT7Sjf7pG1UJRbyQSH2o2BFUxYAOOMlqLQxISuxZy1qbuD/sbzBZhwiK3REgvVhdk/jX7BzduP+IQW2sxfJvd476ZQ52+TtKz41oY1dLAf9Su9f47QfTqA==',key_name='tempest-keypair-451366580',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='680110c45b9b4484ac099c9389ebe1ab',ramdisk_id='',reservation_id='r-x9jpussz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-444464408',owner_user_name='tempest-TestServerVolumeAttachmentScenario-444464408-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T15:05:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecf54f41fcb1435487f421510891440e',uuid=9ba7bc46-392d-4fd7-a85e-84b728d34d2e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38b94412-ebcb-4c39-9856-d328dac47a43", "address": "fa:16:3e:16:9d:79", "network": {"id": "982c660e-02ba-428c-93d9-774e0c381aba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-768235194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "680110c45b9b4484ac099c9389ebe1ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b94412-eb", "ovs_interfaceid": "38b94412-ebcb-4c39-9856-d328dac47a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Converting VIF {"id": "38b94412-ebcb-4c39-9856-d328dac47a43", "address": "fa:16:3e:16:9d:79", "network": {"id": "982c660e-02ba-428c-93d9-774e0c381aba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-768235194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "680110c45b9b4484ac099c9389ebe1ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b94412-eb", "ovs_interfaceid": "38b94412-ebcb-4c39-9856-d328dac47a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:9d:79,bridge_name='br-int',has_traffic_filtering=True,id=38b94412-ebcb-4c39-9856-d328dac47a43,network=Network(982c660e-02ba-428c-93d9-774e0c381aba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38b94412-eb') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG os_vif [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:9d:79,bridge_name='br-int',has_traffic_filtering=True,id=38b94412-ebcb-4c39-9856-d328dac47a43,network=Network(982c660e-02ba-428c-93d9-774e0c381aba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38b94412-eb') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38b94412-eb, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap38b94412-eb, col_values=(('external_ids', {'iface-id': '38b94412-ebcb-4c39-9856-d328dac47a43', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:9d:79', 'vm-uuid': '9ba7bc46-392d-4fd7-a85e-84b728d34d2e'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:57 user nova-compute[72239]: INFO os_vif [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:9d:79,bridge_name='br-int',has_traffic_filtering=True,id=38b94412-ebcb-4c39-9856-d328dac47a43,network=Network(982c660e-02ba-428c-93d9-774e0c381aba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38b94412-eb')
Jul 31 15:05:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] No VIF found with MAC fa:16:3e:16:9d:79, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:58 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Instance destroyed successfully.
Jul 31 15:05:58 user nova-compute[72239]: DEBUG nova.objects.instance [None req-d8d65261-2679-4528-8db1-ece21b9aeb41 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Lazy-loading 'resources' on Instance uuid 9ece926f-02cc-4909-80a2-6476885cc18a {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:05:58 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-d8d65261-2679-4528-8db1-ece21b9aeb41 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:04:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1390124767',display_name='tempest-ServersNegativeTestJSON-server-1390124767',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1390124767',id=39,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T15:04:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='36f4d01080114839b14b23997a4dc1f3',ramdisk_id='',reservation_id='r-bdkru5mf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-628169841',owner_user_name='tempest-ServersNegativeTestJSON-628169841-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T15:04:15Z,user_data=None,user_id='21222ab2b99941978eb3c3e511547e65',uuid=9ece926f-02cc-4909-80a2-6476885cc18a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa6c04e0-092c-418b-bd4d-30123e4d9643", "address": "fa:16:3e:8a:b2:e2", "network": {"id": "afcad268-9e48-452e-ae62-cbeaf3f538dd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-791822524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f4d01080114839b14b23997a4dc1f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa6c04e0-09", "ovs_interfaceid": "aa6c04e0-092c-418b-bd4d-30123e4d9643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 15:05:58 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-d8d65261-2679-4528-8db1-ece21b9aeb41 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Converting VIF {"id": "aa6c04e0-092c-418b-bd4d-30123e4d9643", "address": "fa:16:3e:8a:b2:e2", "network": {"id": "afcad268-9e48-452e-ae62-cbeaf3f538dd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-791822524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f4d01080114839b14b23997a4dc1f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa6c04e0-09", "ovs_interfaceid": "aa6c04e0-092c-418b-bd4d-30123e4d9643", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:05:58 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-d8d65261-2679-4528-8db1-ece21b9aeb41 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:b2:e2,bridge_name='br-int',has_traffic_filtering=True,id=aa6c04e0-092c-418b-bd4d-30123e4d9643,network=Network(afcad268-9e48-452e-ae62-cbeaf3f538dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa6c04e0-09') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:05:58 user nova-compute[72239]: DEBUG os_vif [None req-d8d65261-2679-4528-8db1-ece21b9aeb41 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:b2:e2,bridge_name='br-int',has_traffic_filtering=True,id=aa6c04e0-092c-418b-bd4d-30123e4d9643,network=Network(afcad268-9e48-452e-ae62-cbeaf3f538dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa6c04e0-09') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 15:05:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa6c04e0-09, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:05:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:05:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:58 user nova-compute[72239]: DEBUG nova.network.neutron [req-519fc649-82ef-4052-a60c-990550ce9f93 req-57c7ab2d-4958-41c5-9024-59605f078764 service nova] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Updated VIF entry in instance network info cache for port 38b94412-ebcb-4c39-9856-d328dac47a43. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:05:58 user nova-compute[72239]: DEBUG nova.network.neutron [req-519fc649-82ef-4052-a60c-990550ce9f93 req-57c7ab2d-4958-41c5-9024-59605f078764 service nova] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Updating instance_info_cache with network_info: [{"id": "38b94412-ebcb-4c39-9856-d328dac47a43", "address": "fa:16:3e:16:9d:79", "network": {"id": "982c660e-02ba-428c-93d9-774e0c381aba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-768235194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "680110c45b9b4484ac099c9389ebe1ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b94412-eb", "ovs_interfaceid": "38b94412-ebcb-4c39-9856-d328dac47a43", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:05:58 user nova-compute[72239]: INFO os_vif [None req-d8d65261-2679-4528-8db1-ece21b9aeb41 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:b2:e2,bridge_name='br-int',has_traffic_filtering=True,id=aa6c04e0-092c-418b-bd4d-30123e4d9643,network=Network(afcad268-9e48-452e-ae62-cbeaf3f538dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa6c04e0-09')
Jul 31 15:05:58 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-d8d65261-2679-4528-8db1-ece21b9aeb41 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Deleting instance files /opt/stack/data/nova/instances/9ece926f-02cc-4909-80a2-6476885cc18a_del
Jul 31 15:05:58 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-d8d65261-2679-4528-8db1-ece21b9aeb41 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Deletion of /opt/stack/data/nova/instances/9ece926f-02cc-4909-80a2-6476885cc18a_del complete
Jul 31 15:05:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-519fc649-82ef-4052-a60c-990550ce9f93 req-57c7ab2d-4958-41c5-9024-59605f078764 service nova] Releasing lock "refresh_cache-9ba7bc46-392d-4fd7-a85e-84b728d34d2e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:05:58 user nova-compute[72239]: INFO nova.compute.manager [None req-d8d65261-2679-4528-8db1-ece21b9aeb41 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Took 0.98 seconds to destroy the instance on the hypervisor.
Jul 31 15:05:58 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-d8d65261-2679-4528-8db1-ece21b9aeb41 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 15:05:58 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 15:05:58 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 15:05:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:59 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:05:59 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Took 0.80 seconds to deallocate network for instance.
Jul 31 15:05:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d8d65261-2679-4528-8db1-ece21b9aeb41 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:05:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d8d65261-2679-4528-8db1-ece21b9aeb41 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:05:59 user nova-compute[72239]: DEBUG nova.compute.manager [req-ee0aabdd-f578-4e75-b702-93bf37edb7d4 req-1143f7f0-6d5f-423e-9be2-44d4df2b63f2 service nova] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Received event network-vif-unplugged-aa6c04e0-092c-418b-bd4d-30123e4d9643 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:05:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ee0aabdd-f578-4e75-b702-93bf37edb7d4 req-1143f7f0-6d5f-423e-9be2-44d4df2b63f2 service nova] Acquiring lock "9ece926f-02cc-4909-80a2-6476885cc18a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:05:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ee0aabdd-f578-4e75-b702-93bf37edb7d4 req-1143f7f0-6d5f-423e-9be2-44d4df2b63f2 service nova] Lock "9ece926f-02cc-4909-80a2-6476885cc18a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:05:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ee0aabdd-f578-4e75-b702-93bf37edb7d4 req-1143f7f0-6d5f-423e-9be2-44d4df2b63f2 service nova] Lock "9ece926f-02cc-4909-80a2-6476885cc18a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:05:59 user nova-compute[72239]: DEBUG nova.compute.manager [req-ee0aabdd-f578-4e75-b702-93bf37edb7d4 req-1143f7f0-6d5f-423e-9be2-44d4df2b63f2 service nova] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] No waiting events found dispatching network-vif-unplugged-aa6c04e0-092c-418b-bd4d-30123e4d9643 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:05:59 user nova-compute[72239]: WARNING nova.compute.manager [req-ee0aabdd-f578-4e75-b702-93bf37edb7d4 req-1143f7f0-6d5f-423e-9be2-44d4df2b63f2 service nova] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Received unexpected event network-vif-unplugged-aa6c04e0-092c-418b-bd4d-30123e4d9643 for instance with vm_state deleted and task_state None.
Jul 31 15:05:59 user nova-compute[72239]: DEBUG nova.compute.manager [req-ee0aabdd-f578-4e75-b702-93bf37edb7d4 req-1143f7f0-6d5f-423e-9be2-44d4df2b63f2 service nova] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Received event network-vif-plugged-aa6c04e0-092c-418b-bd4d-30123e4d9643 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:05:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ee0aabdd-f578-4e75-b702-93bf37edb7d4 req-1143f7f0-6d5f-423e-9be2-44d4df2b63f2 service nova] Acquiring lock "9ece926f-02cc-4909-80a2-6476885cc18a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:05:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ee0aabdd-f578-4e75-b702-93bf37edb7d4 req-1143f7f0-6d5f-423e-9be2-44d4df2b63f2 service nova] Lock "9ece926f-02cc-4909-80a2-6476885cc18a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:05:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ee0aabdd-f578-4e75-b702-93bf37edb7d4 req-1143f7f0-6d5f-423e-9be2-44d4df2b63f2 service nova] Lock "9ece926f-02cc-4909-80a2-6476885cc18a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:05:59 user nova-compute[72239]: DEBUG nova.compute.manager [req-ee0aabdd-f578-4e75-b702-93bf37edb7d4 req-1143f7f0-6d5f-423e-9be2-44d4df2b63f2 service nova] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] No waiting events found dispatching network-vif-plugged-aa6c04e0-092c-418b-bd4d-30123e4d9643 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:05:59 user nova-compute[72239]: WARNING nova.compute.manager [req-ee0aabdd-f578-4e75-b702-93bf37edb7d4 req-1143f7f0-6d5f-423e-9be2-44d4df2b63f2 service nova] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Received unexpected event network-vif-plugged-aa6c04e0-092c-418b-bd4d-30123e4d9643 for instance with vm_state deleted and task_state None.
Jul 31 15:05:59 user nova-compute[72239]: DEBUG nova.compute.manager [req-ee0aabdd-f578-4e75-b702-93bf37edb7d4 req-1143f7f0-6d5f-423e-9be2-44d4df2b63f2 service nova] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Received event network-vif-plugged-aa6c04e0-092c-418b-bd4d-30123e4d9643 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:05:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ee0aabdd-f578-4e75-b702-93bf37edb7d4 req-1143f7f0-6d5f-423e-9be2-44d4df2b63f2 service nova] Acquiring lock "9ece926f-02cc-4909-80a2-6476885cc18a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:05:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ee0aabdd-f578-4e75-b702-93bf37edb7d4 req-1143f7f0-6d5f-423e-9be2-44d4df2b63f2 service nova] Lock "9ece926f-02cc-4909-80a2-6476885cc18a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:05:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ee0aabdd-f578-4e75-b702-93bf37edb7d4 req-1143f7f0-6d5f-423e-9be2-44d4df2b63f2 service nova] Lock "9ece926f-02cc-4909-80a2-6476885cc18a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:05:59 user nova-compute[72239]: DEBUG nova.compute.manager [req-ee0aabdd-f578-4e75-b702-93bf37edb7d4 req-1143f7f0-6d5f-423e-9be2-44d4df2b63f2 service nova] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] No waiting events found dispatching network-vif-plugged-aa6c04e0-092c-418b-bd4d-30123e4d9643 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:05:59 user nova-compute[72239]: WARNING nova.compute.manager [req-ee0aabdd-f578-4e75-b702-93bf37edb7d4 req-1143f7f0-6d5f-423e-9be2-44d4df2b63f2 service nova] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Received unexpected event network-vif-plugged-aa6c04e0-092c-418b-bd4d-30123e4d9643 for instance with vm_state deleted and task_state None.
Jul 31 15:05:59 user nova-compute[72239]: DEBUG nova.compute.manager [req-ee0aabdd-f578-4e75-b702-93bf37edb7d4 req-1143f7f0-6d5f-423e-9be2-44d4df2b63f2 service nova] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Received event network-vif-deleted-aa6c04e0-092c-418b-bd4d-30123e4d9643 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:05:59 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-d8d65261-2679-4528-8db1-ece21b9aeb41 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:05:59 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-d8d65261-2679-4528-8db1-ece21b9aeb41 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:05:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d8d65261-2679-4528-8db1-ece21b9aeb41 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.297s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:05:59 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-d8d65261-2679-4528-8db1-ece21b9aeb41 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Deleted allocations for instance 9ece926f-02cc-4909-80a2-6476885cc18a
Jul 31 15:05:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d8d65261-2679-4528-8db1-ece21b9aeb41 tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Lock "9ece926f-02cc-4909-80a2-6476885cc18a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.285s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:05:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:05:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:06:01 user nova-compute[72239]: DEBUG nova.compute.manager [req-78ea7c39-80ae-4dcc-a8c1-831d07184abc req-10fa67fd-b104-489e-baa7-b7092b6609b2 service nova] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Received event network-vif-plugged-38b94412-ebcb-4c39-9856-d328dac47a43 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:06:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-78ea7c39-80ae-4dcc-a8c1-831d07184abc req-10fa67fd-b104-489e-baa7-b7092b6609b2 service nova] Acquiring lock "9ba7bc46-392d-4fd7-a85e-84b728d34d2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:06:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-78ea7c39-80ae-4dcc-a8c1-831d07184abc req-10fa67fd-b104-489e-baa7-b7092b6609b2 service nova] Lock "9ba7bc46-392d-4fd7-a85e-84b728d34d2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:06:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-78ea7c39-80ae-4dcc-a8c1-831d07184abc req-10fa67fd-b104-489e-baa7-b7092b6609b2 service nova] Lock "9ba7bc46-392d-4fd7-a85e-84b728d34d2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:06:01 user nova-compute[72239]: DEBUG nova.compute.manager [req-78ea7c39-80ae-4dcc-a8c1-831d07184abc req-10fa67fd-b104-489e-baa7-b7092b6609b2 service nova] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] No waiting events found dispatching network-vif-plugged-38b94412-ebcb-4c39-9856-d328dac47a43 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:06:01 user nova-compute[72239]: WARNING nova.compute.manager [req-78ea7c39-80ae-4dcc-a8c1-831d07184abc req-10fa67fd-b104-489e-baa7-b7092b6609b2 service nova] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Received unexpected event network-vif-plugged-38b94412-ebcb-4c39-9856-d328dac47a43 for instance with vm_state building and task_state spawning.
Jul 31 15:06:01 user nova-compute[72239]: DEBUG nova.compute.manager [req-78ea7c39-80ae-4dcc-a8c1-831d07184abc req-10fa67fd-b104-489e-baa7-b7092b6609b2 service nova] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Received event network-vif-plugged-38b94412-ebcb-4c39-9856-d328dac47a43 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:06:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-78ea7c39-80ae-4dcc-a8c1-831d07184abc req-10fa67fd-b104-489e-baa7-b7092b6609b2 service nova] Acquiring lock "9ba7bc46-392d-4fd7-a85e-84b728d34d2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:06:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-78ea7c39-80ae-4dcc-a8c1-831d07184abc req-10fa67fd-b104-489e-baa7-b7092b6609b2 service nova] Lock "9ba7bc46-392d-4fd7-a85e-84b728d34d2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:06:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-78ea7c39-80ae-4dcc-a8c1-831d07184abc req-10fa67fd-b104-489e-baa7-b7092b6609b2 service nova] Lock "9ba7bc46-392d-4fd7-a85e-84b728d34d2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:06:01 user nova-compute[72239]: DEBUG nova.compute.manager [req-78ea7c39-80ae-4dcc-a8c1-831d07184abc req-10fa67fd-b104-489e-baa7-b7092b6609b2 service nova] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] No waiting events found dispatching network-vif-plugged-38b94412-ebcb-4c39-9856-d328dac47a43 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:06:01 user nova-compute[72239]: WARNING nova.compute.manager [req-78ea7c39-80ae-4dcc-a8c1-831d07184abc req-10fa67fd-b104-489e-baa7-b7092b6609b2 service nova] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Received unexpected event network-vif-plugged-38b94412-ebcb-4c39-9856-d328dac47a43 for instance with vm_state building and task_state spawning.
Jul 31 15:06:01 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815961.368322, 9ba7bc46-392d-4fd7-a85e-84b728d34d2e => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:06:01 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] VM Resumed (Lifecycle Event)
Jul 31 15:06:01 user nova-compute[72239]: DEBUG nova.compute.manager [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 15:06:01 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 15:06:01 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Instance spawned successfully.
Jul 31 15:06:01 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 15:06:01 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:06:01 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:06:01 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:06:01 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:06:01 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:06:01 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:06:01 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:06:01 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:06:01 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 15:06:01 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690815961.3697362, 9ba7bc46-392d-4fd7-a85e-84b728d34d2e => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:06:01 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] VM Started (Lifecycle Event)
Jul 31 15:06:01 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:06:01 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:06:01 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 15:06:01 user nova-compute[72239]: INFO nova.compute.manager [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Took 8.89 seconds to spawn the instance on the hypervisor.
Jul 31 15:06:01 user nova-compute[72239]: DEBUG nova.compute.manager [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:06:01 user nova-compute[72239]: INFO nova.compute.manager [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Took 9.78 seconds to build instance.
Jul 31 15:06:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-dec5f493-6dba-4e80-b505-a23b04732281 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lock "9ba7bc46-392d-4fd7-a85e-84b728d34d2e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.880s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:06:03 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:06:03 user nova-compute[72239]: DEBUG nova.compute.manager [req-47e2866c-7d4d-42dc-b9b6-97b9319fc7d9 req-1760e74b-5915-467c-ac03-142c912443e0 service nova] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Received event network-changed-8422c73f-f89d-4170-b460-a31f0e8fe9ad {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:06:03 user nova-compute[72239]: DEBUG nova.compute.manager [req-47e2866c-7d4d-42dc-b9b6-97b9319fc7d9 req-1760e74b-5915-467c-ac03-142c912443e0 service nova] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Refreshing instance network info cache due to event network-changed-8422c73f-f89d-4170-b460-a31f0e8fe9ad. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:06:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-47e2866c-7d4d-42dc-b9b6-97b9319fc7d9 req-1760e74b-5915-467c-ac03-142c912443e0 service nova] Acquiring lock "refresh_cache-95c53d76-a495-4922-a7af-fcbf8321f19b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:06:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-47e2866c-7d4d-42dc-b9b6-97b9319fc7d9 req-1760e74b-5915-467c-ac03-142c912443e0 service nova] Acquired lock "refresh_cache-95c53d76-a495-4922-a7af-fcbf8321f19b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:06:03 user nova-compute[72239]: DEBUG nova.network.neutron [req-47e2866c-7d4d-42dc-b9b6-97b9319fc7d9 req-1760e74b-5915-467c-ac03-142c912443e0 service nova] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Refreshing network info cache for port 8422c73f-f89d-4170-b460-a31f0e8fe9ad {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:06:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Acquiring lock "95c53d76-a495-4922-a7af-fcbf8321f19b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:06:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "95c53d76-a495-4922-a7af-fcbf8321f19b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:06:03 user nova-compute[72239]: DEBUG nova.objects.instance [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lazy-loading 'flavor' on Instance uuid 95c53d76-a495-4922-a7af-fcbf8321f19b {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:06:03 user nova-compute[72239]: DEBUG nova.network.neutron [req-47e2866c-7d4d-42dc-b9b6-97b9319fc7d9 req-1760e74b-5915-467c-ac03-142c912443e0 service nova] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Updated VIF entry in instance network info cache for port 8422c73f-f89d-4170-b460-a31f0e8fe9ad. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:06:03 user nova-compute[72239]: DEBUG nova.network.neutron [req-47e2866c-7d4d-42dc-b9b6-97b9319fc7d9 req-1760e74b-5915-467c-ac03-142c912443e0 service nova] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Updating instance_info_cache with network_info: [{"id": "8422c73f-f89d-4170-b460-a31f0e8fe9ad", "address": "fa:16:3e:4d:1c:7f", "network": {"id": "39af8721-7023-4cb5-9e06-293f319d5d93", "bridge": "br-int", "label": "tempest-TestStampPattern-549999556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228abbe80ac416fbcc6013767ca9384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8422c73f-f8", "ovs_interfaceid": "8422c73f-f89d-4170-b460-a31f0e8fe9ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:06:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "95c53d76-a495-4922-a7af-fcbf8321f19b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:06:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-47e2866c-7d4d-42dc-b9b6-97b9319fc7d9 req-1760e74b-5915-467c-ac03-142c912443e0 service nova] Releasing lock "refresh_cache-95c53d76-a495-4922-a7af-fcbf8321f19b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:06:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Acquiring lock "95c53d76-a495-4922-a7af-fcbf8321f19b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:06:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "95c53d76-a495-4922-a7af-fcbf8321f19b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:06:04 user nova-compute[72239]: INFO nova.compute.manager [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Attaching volume 595e9708-9576-4255-84c4-d6f08e272b91 to /dev/vdb
Jul 31 15:06:04 user nova-compute[72239]: DEBUG os_brick.utils [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:06:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:06:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:06:04 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[95aa43cf-33ae-494b-b503-a5a58f7ae00b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:06:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:06:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:06:04 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3e73013-7415-4e04-a740-3732406e61b0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:06:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:06:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:06:04 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f9caa2-9ca1-4631-9127-37f34220c887]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:06:04 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4326c347-4382-4976-a6d6-0e7cef1b0d2f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:06:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:06:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:06:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 15:06:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:06:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:06:04 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 15:06:04 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6fa00e-620f-4ac2-9aaf-8cf0802b4f3f]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:06:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 15:06:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 15:06:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 15:06:04 user nova-compute[72239]: DEBUG os_brick.utils [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:06:04 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Updating existing volume attachment record: 5e73fcab-8a41-46ac-84a4-9a05f98a027d {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 15:06:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:06:07 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690815952.8004067, 824b19e8-b4af-4fd4-a1ef-f214e25caef2 => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:06:07 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] VM Stopped (Lifecycle Event)
Jul 31 15:06:07 user nova-compute[72239]: DEBUG nova.compute.manager [None req-2cb6c890-c5c0-4615-aae8-06d8ffa15a70 None None] [instance: 824b19e8-b4af-4fd4-a1ef-f214e25caef2] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:06:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:06:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rzPnOwaI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:06:11 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:06:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:06:11 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:06:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:06:11 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 15:06:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91 -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[75eb72df-2e8d-45c7-aa3e-4b31c1dff581]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 15:06:11 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91 -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa78aeb-7ddd-48d4-9a55-bf9dadb02f63]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91] added
Jul 31 15:06:11 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[baae680e-50de-401d-9df3-5f19a0cee953]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fcbb75-7df2-4906-a5dc-c0ca946418cc]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rzPnOwaI {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rzPnOwaI" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7743d9d7-5c6e-4f0e-92df-79ec4606a1d3]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rzPnOwaI'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a814c4e1-a46e-4c6e-9102-ff7c69cfd4b3]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1673cc0a-8cff-4025-acbd-dc09ac790bdc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 15:06:11 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 15:06:11 user nova-compute[72239]:  {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:06:11 user nova-compute[72239]: WARNING os_brick.initiator.connectors.iscsi [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 15:06:11 user nova-compute[72239]: 
Jul 31 15:06:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91 -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21d1386-fe2e-499b-821f-53110111904f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91, portal: 172.16.0.220,3260]
Jul 31 15:06:11 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91, portal: 172.16.0.220,3260] successful.
Jul 31 15:06:11 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[681c0529-f470-4ed6-95c8-6e2b53a84ff3]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ab5962-e593-4c7e-a44e-f6ae72dd7d56]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91 (non-flash)
Jul 31 15:06:11 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91 (non-flash)
Jul 31 15:06:11 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] HCTL ('33', '-', '-', 0) found on session 46 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad3177c-5d4b-4d23-84c5-0f1cb4db2b85]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Searching for a device in session 46 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 15:06:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rzPnOwaI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 15:06:12 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:06:12 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 15:06:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-f98cea94-e905-47c5-bf88-5f5694934966" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:06:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-f98cea94-e905-47c5-bf88-5f5694934966" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:06:12 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 15:06:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:06:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26163393332313861', 'path': '/dev/sdb'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:06:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163393332313861', 'path': '/dev/sdb'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 15:06:12 user nova-compute[72239]: DEBUG nova.objects.instance [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lazy-loading 'flavor' on Instance uuid 95c53d76-a495-4922-a7af-fcbf8321f19b {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:06:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 15:06:12 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:06:12 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 15:06:12 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 15:06:12 user nova-compute[72239]:   <serial>595e9708-9576-4255-84c4-d6f08e272b91</serial>
Jul 31 15:06:12 user nova-compute[72239]: </disk>
Jul 31 15:06:12 user nova-compute[72239]:  {{(pid=72239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 15:06:12 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Updating instance_info_cache with network_info: [{"id": "d9134cdf-ef4b-442f-8a86-313a3a2d5fdf", "address": "fa:16:3e:ce:31:50", "network": {"id": "afcad268-9e48-452e-ae62-cbeaf3f538dd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-791822524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f4d01080114839b14b23997a4dc1f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9134cdf-ef", "ovs_interfaceid": "d9134cdf-ef4b-442f-8a86-313a3a2d5fdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:06:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-f98cea94-e905-47c5-bf88-5f5694934966" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:06:12 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 15:06:12 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:06:12 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:06:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:06:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:06:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] No VIF found with MAC fa:16:3e:4d:1c:7f, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 15:06:13 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690815958.1769145, 9ece926f-02cc-4909-80a2-6476885cc18a => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:06:13 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] VM Stopped (Lifecycle Event)
Jul 31 15:06:13 user nova-compute[72239]: DEBUG nova.compute.manager [None req-008f853f-c0ce-499a-889d-52b5c0163879 None None] [instance: 9ece926f-02cc-4909-80a2-6476885cc18a] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:06:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:06:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-94f3b6df-6263-494c-b711-abd6ca5e19e8 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "95c53d76-a495-4922-a7af-fcbf8321f19b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.098s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:06:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-18d2f474-a472-4d79-8120-373b03d9489d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Acquiring lock "95c53d76-a495-4922-a7af-fcbf8321f19b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-18d2f474-a472-4d79-8120-373b03d9489d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "95c53d76-a495-4922-a7af-fcbf8321f19b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:06:15 user nova-compute[72239]: INFO nova.compute.manager [None req-18d2f474-a472-4d79-8120-373b03d9489d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Detaching volume 595e9708-9576-4255-84c4-d6f08e272b91
Jul 31 15:06:15 user nova-compute[72239]: INFO nova.virt.block_device [None req-18d2f474-a472-4d79-8120-373b03d9489d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Attempting to driver detach volume 595e9708-9576-4255-84c4-d6f08e272b91 from mountpoint /dev/vdb
Jul 31 15:06:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-18d2f474-a472-4d79-8120-373b03d9489d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Attempting to detach device vdb from instance 95c53d76-a495-4922-a7af-fcbf8321f19b from the persistent domain config. {{(pid=72239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-18d2f474-a472-4d79-8120-373b03d9489d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 15:06:15 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:06:15 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 15:06:15 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 15:06:15 user nova-compute[72239]:   <serial>595e9708-9576-4255-84c4-d6f08e272b91</serial>
Jul 31 15:06:15 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 15:06:15 user nova-compute[72239]: </disk>
Jul 31 15:06:15 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 15:06:15 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-18d2f474-a472-4d79-8120-373b03d9489d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Successfully detached device vdb from instance 95c53d76-a495-4922-a7af-fcbf8321f19b from the persistent domain config.
Jul 31 15:06:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-18d2f474-a472-4d79-8120-373b03d9489d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 95c53d76-a495-4922-a7af-fcbf8321f19b from the live domain config. {{(pid=72239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-18d2f474-a472-4d79-8120-373b03d9489d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 15:06:15 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:06:15 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 15:06:15 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 15:06:15 user nova-compute[72239]:   <serial>595e9708-9576-4255-84c4-d6f08e272b91</serial>
Jul 31 15:06:15 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 15:06:15 user nova-compute[72239]: </disk>
Jul 31 15:06:15 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Received event <DeviceRemovedEvent: 1690815975.6456048, 95c53d76-a495-4922-a7af-fcbf8321f19b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72239) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-18d2f474-a472-4d79-8120-373b03d9489d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 95c53d76-a495-4922-a7af-fcbf8321f19b {{(pid=72239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 15:06:15 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-18d2f474-a472-4d79-8120-373b03d9489d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Successfully detached device vdb from instance 95c53d76-a495-4922-a7af-fcbf8321f19b from the live domain config.
Jul 31 15:06:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18d2f474-a472-4d79-8120-373b03d9489d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d2f474-a472-4d79-8120-373b03d9489d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rzPnOwaI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:06:15 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-18d2f474-a472-4d79-8120-373b03d9489d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:06:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-18d2f474-a472-4d79-8120-373b03d9489d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-18d2f474-a472-4d79-8120-373b03d9489d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d2f474-a472-4d79-8120-373b03d9489d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fafbaad5-8645-4829-a782-fb999462a573]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf2e21a-d035-479e-ac82-438f68caa1f8]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d2f474-a472-4d79-8120-373b03d9489d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91 (non-flash)
Jul 31 15:06:15 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d2f474-a472-4d79-8120-373b03d9489d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91 (non-flash)
Jul 31 15:06:15 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d2f474-a472-4d79-8120-373b03d9489d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41007d1d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91'): ({'sdb'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-18d2f474-a472-4d79-8120-373b03d9489d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Removing single pathed devices sdb {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d9cf318-0883-40dc-b63d-308db9d09309]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1cb4ce-bbc5-48ab-a569-7589c98614e5]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-18d2f474-a472-4d79-8120-373b03d9489d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Flushing IO for device /dev/sdb {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[344fd957-1c15-450d-9228-84cb075e8382]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-18d2f474-a472-4d79-8120-373b03d9489d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8441a9-9de8-4c7d-afb1-865cbad4db83]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-18d2f474-a472-4d79-8120-373b03d9489d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-18d2f474-a472-4d79-8120-373b03d9489d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d2f474-a472-4d79-8120-373b03d9489d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c800ca35-fcec-4799-8aec-c89fef80b79d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "04eeae20-361e-4ac1-84be-e25cec586f76" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c800ca35-fcec-4799-8aec-c89fef80b79d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "04eeae20-361e-4ac1-84be-e25cec586f76" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c800ca35-fcec-4799-8aec-c89fef80b79d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "04eeae20-361e-4ac1-84be-e25cec586f76-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c800ca35-fcec-4799-8aec-c89fef80b79d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "04eeae20-361e-4ac1-84be-e25cec586f76-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c800ca35-fcec-4799-8aec-c89fef80b79d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "04eeae20-361e-4ac1-84be-e25cec586f76-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[af898477-666e-43ca-b629-4911f5c60825]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d2f474-a472-4d79-8120-373b03d9489d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:06:15 user nova-compute[72239]: INFO nova.compute.manager [None req-c800ca35-fcec-4799-8aec-c89fef80b79d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Terminating instance
Jul 31 15:06:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91 -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG nova.compute.manager [None req-c800ca35-fcec-4799-8aec-c89fef80b79d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[84579c79-f1ab-43da-b98d-7408c7ab9c38]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d2f474-a472-4d79-8120-373b03d9489d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91, portal: 172.16.0.220,3260]
Jul 31 15:06:15 user nova-compute[72239]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91, portal: 172.16.0.220,3260] successful.
Jul 31 15:06:15 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91 -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:595e9708-9576-4255-84c4-d6f08e272b91 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf6de3a-f886-4d67-9f99-5ffdff2c155e]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d2f474-a472-4d79-8120-373b03d9489d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-18d2f474-a472-4d79-8120-373b03d9489d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-18d2f474-a472-4d79-8120-373b03d9489d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] <== disconnect_volume: return (321ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18d2f474-a472-4d79-8120-373b03d9489d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 15:06:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:06:16 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:06:16 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:06:16 user nova-compute[72239]: DEBUG nova.compute.manager [req-636e2e00-478d-4402-a636-e3656c0b0513 req-94deabb6-8ae3-4fa6-80cd-6e7e63176e61 service nova] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Received event network-vif-unplugged-f41e1aaf-748e-4124-853d-b77e0c79ce72 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:06:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-636e2e00-478d-4402-a636-e3656c0b0513 req-94deabb6-8ae3-4fa6-80cd-6e7e63176e61 service nova] Acquiring lock "04eeae20-361e-4ac1-84be-e25cec586f76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:06:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-636e2e00-478d-4402-a636-e3656c0b0513 req-94deabb6-8ae3-4fa6-80cd-6e7e63176e61 service nova] Lock "04eeae20-361e-4ac1-84be-e25cec586f76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:06:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-636e2e00-478d-4402-a636-e3656c0b0513 req-94deabb6-8ae3-4fa6-80cd-6e7e63176e61 service nova] Lock "04eeae20-361e-4ac1-84be-e25cec586f76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:06:16 user nova-compute[72239]: DEBUG nova.compute.manager [req-636e2e00-478d-4402-a636-e3656c0b0513 req-94deabb6-8ae3-4fa6-80cd-6e7e63176e61 service nova] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] No waiting events found dispatching network-vif-unplugged-f41e1aaf-748e-4124-853d-b77e0c79ce72 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:06:16 user nova-compute[72239]: DEBUG nova.compute.manager [req-636e2e00-478d-4402-a636-e3656c0b0513 req-94deabb6-8ae3-4fa6-80cd-6e7e63176e61 service nova] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Received event network-vif-unplugged-f41e1aaf-748e-4124-853d-b77e0c79ce72 for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 15:06:16 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:06:16 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:06:16 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:06:16 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Instance destroyed successfully.
Jul 31 15:06:16 user nova-compute[72239]: DEBUG nova.objects.instance [None req-c800ca35-fcec-4799-8aec-c89fef80b79d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lazy-loading 'resources' on Instance uuid 04eeae20-361e-4ac1-84be-e25cec586f76 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:06:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-c800ca35-fcec-4799-8aec-c89fef80b79d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:03:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1088042679',display_name='tempest-AttachVolumeNegativeTest-server-1088042679',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1088042679',id=38,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH85RefiIXv4cRkaNqXj0ai4KZWx1j8kN2Jz+6i3TKFWbXcU6EETmV4Ctuf8HD628TGk4SER7z4QSo+CQn4LKb/YHCxwWQbrdah8nHZ1CPiI+WhVxtF+ajhIA09aKFZ+xA==',key_name='tempest-keypair-1325963297',keypairs=<?>,launch_index=0,launched_at=2023-07-31T15:03:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='48e4fe9e81724b9cb6b9d73748f9bdee',ramdisk_id='',reservation_id='r-vz39e0gw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-620954585',owner_user_name='tempest-AttachVolumeNegativeTest-620954585-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T15:03:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='99f609389e884d5490ba160d9fff28e3',uuid=04eeae20-361e-4ac1-84be-e25cec586f76,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f41e1aaf-748e-4124-853d-b77e0c79ce72", "address": "fa:16:3e:9b:c2:3f", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf41e1aaf-74", "ovs_interfaceid": "f41e1aaf-748e-4124-853d-b77e0c79ce72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 15:06:16 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-c800ca35-fcec-4799-8aec-c89fef80b79d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Converting VIF {"id": "f41e1aaf-748e-4124-853d-b77e0c79ce72", "address": "fa:16:3e:9b:c2:3f", "network": {"id": "f83cfb34-b1ca-4a7c-9a36-3654372585f8", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1711837579-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "48e4fe9e81724b9cb6b9d73748f9bdee", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf41e1aaf-74", "ovs_interfaceid": "f41e1aaf-748e-4124-853d-b77e0c79ce72", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:06:16 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-c800ca35-fcec-4799-8aec-c89fef80b79d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9b:c2:3f,bridge_name='br-int',has_traffic_filtering=True,id=f41e1aaf-748e-4124-853d-b77e0c79ce72,network=Network(f83cfb34-b1ca-4a7c-9a36-3654372585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf41e1aaf-74') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:06:16 user nova-compute[72239]: DEBUG os_vif [None req-c800ca35-fcec-4799-8aec-c89fef80b79d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:c2:3f,bridge_name='br-int',has_traffic_filtering=True,id=f41e1aaf-748e-4124-853d-b77e0c79ce72,network=Network(f83cfb34-b1ca-4a7c-9a36-3654372585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf41e1aaf-74') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 15:06:16 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:06:16 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf41e1aaf-74, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:06:16 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:06:16 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:06:16 user nova-compute[72239]: INFO os_vif [None req-c800ca35-fcec-4799-8aec-c89fef80b79d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9b:c2:3f,bridge_name='br-int',has_traffic_filtering=True,id=f41e1aaf-748e-4124-853d-b77e0c79ce72,network=Network(f83cfb34-b1ca-4a7c-9a36-3654372585f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf41e1aaf-74')
Jul 31 15:06:16 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-c800ca35-fcec-4799-8aec-c89fef80b79d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Deleting instance files /opt/stack/data/nova/instances/04eeae20-361e-4ac1-84be-e25cec586f76_del
Jul 31 15:06:16 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-c800ca35-fcec-4799-8aec-c89fef80b79d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Deletion of /opt/stack/data/nova/instances/04eeae20-361e-4ac1-84be-e25cec586f76_del complete
Jul 31 15:06:16 user nova-compute[72239]: INFO nova.compute.manager [None req-c800ca35-fcec-4799-8aec-c89fef80b79d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Took 0.87 seconds to destroy the instance on the hypervisor.
Jul 31 15:06:16 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-c800ca35-fcec-4799-8aec-c89fef80b79d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 15:06:16 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 15:06:16 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 15:06:16 user nova-compute[72239]: DEBUG nova.objects.instance [None req-18d2f474-a472-4d79-8120-373b03d9489d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lazy-loading 'flavor' on Instance uuid 95c53d76-a495-4922-a7af-fcbf8321f19b {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:06:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-18d2f474-a472-4d79-8120-373b03d9489d tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "95c53d76-a495-4922-a7af-fcbf8321f19b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.763s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:06:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:06:17 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:06:17 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Took 0.95 seconds to deallocate network for instance.
Jul 31 15:06:17 user nova-compute[72239]: DEBUG nova.compute.manager [req-26ce55db-b8e7-44d5-b848-763c981eea81 req-af5841df-1970-43b4-ac01-e9a138e793e8 service nova] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Received event network-vif-deleted-f41e1aaf-748e-4124-853d-b77e0c79ce72 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:06:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c800ca35-fcec-4799-8aec-c89fef80b79d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:06:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c800ca35-fcec-4799-8aec-c89fef80b79d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:06:17 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-c800ca35-fcec-4799-8aec-c89fef80b79d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:06:18 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-c800ca35-fcec-4799-8aec-c89fef80b79d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:06:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c800ca35-fcec-4799-8aec-c89fef80b79d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:06:18 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-c800ca35-fcec-4799-8aec-c89fef80b79d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Deleted allocations for instance 04eeae20-361e-4ac1-84be-e25cec586f76
Jul 31 15:06:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c800ca35-fcec-4799-8aec-c89fef80b79d tempest-AttachVolumeNegativeTest-620954585 tempest-AttachVolumeNegativeTest-620954585-project-member] Lock "04eeae20-361e-4ac1-84be-e25cec586f76" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.353s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:06:18 user nova-compute[72239]: DEBUG nova.compute.manager [req-07a9f72a-da08-4428-92fd-01dc9fa8ab15 req-5ed3a683-12c4-4c0b-a69a-26704488d70f service nova] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Received event network-vif-plugged-f41e1aaf-748e-4124-853d-b77e0c79ce72 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:06:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-07a9f72a-da08-4428-92fd-01dc9fa8ab15 req-5ed3a683-12c4-4c0b-a69a-26704488d70f service nova] Acquiring lock "04eeae20-361e-4ac1-84be-e25cec586f76-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:06:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-07a9f72a-da08-4428-92fd-01dc9fa8ab15 req-5ed3a683-12c4-4c0b-a69a-26704488d70f service nova] Lock "04eeae20-361e-4ac1-84be-e25cec586f76-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:06:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-07a9f72a-da08-4428-92fd-01dc9fa8ab15 req-5ed3a683-12c4-4c0b-a69a-26704488d70f service nova] Lock "04eeae20-361e-4ac1-84be-e25cec586f76-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:06:18 user nova-compute[72239]: DEBUG nova.compute.manager [req-07a9f72a-da08-4428-92fd-01dc9fa8ab15 req-5ed3a683-12c4-4c0b-a69a-26704488d70f service nova] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] No waiting events found dispatching network-vif-plugged-f41e1aaf-748e-4124-853d-b77e0c79ce72 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:06:18 user nova-compute[72239]: WARNING nova.compute.manager [req-07a9f72a-da08-4428-92fd-01dc9fa8ab15 req-5ed3a683-12c4-4c0b-a69a-26704488d70f service nova] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Received unexpected event network-vif-plugged-f41e1aaf-748e-4124-853d-b77e0c79ce72 for instance with vm_state deleted and task_state None.
Jul 31 15:06:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:06:21 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:06:22 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:06:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:06:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:06:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:06:22 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 15:06:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ba7bc46-392d-4fd7-a85e-84b728d34d2e/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:06:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ba7bc46-392d-4fd7-a85e-84b728d34d2e/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:06:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ba7bc46-392d-4fd7-a85e-84b728d34d2e/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:06:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ba7bc46-392d-4fd7-a85e-84b728d34d2e/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:06:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0ad5b63-4c93-4d82-8f1d-3dc851c1de49/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:06:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0ad5b63-4c93-4d82-8f1d-3dc851c1de49/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:06:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0ad5b63-4c93-4d82-8f1d-3dc851c1de49/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:06:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a0ad5b63-4c93-4d82-8f1d-3dc851c1de49/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:06:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95c53d76-a495-4922-a7af-fcbf8321f19b/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:06:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95c53d76-a495-4922-a7af-fcbf8321f19b/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:06:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95c53d76-a495-4922-a7af-fcbf8321f19b/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:06:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/95c53d76-a495-4922-a7af-fcbf8321f19b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:06:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:06:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:06:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:06:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:06:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:06:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:06:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:06:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:06:24 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:06:24 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:06:24 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=7945MB free_disk=25.105743408203125GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 15:06:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:06:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:06:24 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 0a89aa93-374f-4487-893b-58c15d42c84c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:06:24 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance f98cea94-e905-47c5-bf88-5f5694934966 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:06:24 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 95c53d76-a495-4922-a7af-fcbf8321f19b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:06:24 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance a0ad5b63-4c93-4d82-8f1d-3dc851c1de49 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:06:24 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 9ba7bc46-392d-4fd7-a85e-84b728d34d2e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:06:24 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 15:06:24 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 15:06:24 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:06:24 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:06:24 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 15:06:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.314s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:06:24 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:06:25 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:06:25 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 15:06:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:06:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:06:31 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690815976.6382418, 04eeae20-361e-4ac1-84be-e25cec586f76 => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:06:31 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] VM Stopped (Lifecycle Event)
Jul 31 15:06:31 user nova-compute[72239]: DEBUG nova.compute.manager [None req-e63790eb-9e60-48e1-9dc8-41fa274acc94 None None] [instance: 04eeae20-361e-4ac1-84be-e25cec586f76] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:06:31 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:06:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:06:36 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:06:41 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:06:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:06:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:06:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:06:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:06:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:06:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-cdaf362b-7f7b-4a13-aeae-3ea78c0a9f58 tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Acquiring lock "a0ad5b63-4c93-4d82-8f1d-3dc851c1de49" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:06:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-cdaf362b-7f7b-4a13-aeae-3ea78c0a9f58 tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Lock "a0ad5b63-4c93-4d82-8f1d-3dc851c1de49" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:06:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-cdaf362b-7f7b-4a13-aeae-3ea78c0a9f58 tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Acquiring lock "a0ad5b63-4c93-4d82-8f1d-3dc851c1de49-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:06:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-cdaf362b-7f7b-4a13-aeae-3ea78c0a9f58 tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Lock "a0ad5b63-4c93-4d82-8f1d-3dc851c1de49-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:06:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-cdaf362b-7f7b-4a13-aeae-3ea78c0a9f58 tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Lock "a0ad5b63-4c93-4d82-8f1d-3dc851c1de49-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:06:55 user nova-compute[72239]: INFO nova.compute.manager [None req-cdaf362b-7f7b-4a13-aeae-3ea78c0a9f58 tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Terminating instance
Jul 31 15:06:55 user nova-compute[72239]: DEBUG nova.compute.manager [None req-cdaf362b-7f7b-4a13-aeae-3ea78c0a9f58 tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 15:06:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:06:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:06:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:06:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:06:56 user nova-compute[72239]: DEBUG nova.compute.manager [req-f76cd95a-e292-4a12-98a1-552cab1e3507 req-cc48b2f4-eb3b-4a81-8253-f63a60bf6814 service nova] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Received event network-vif-unplugged-145c1a27-3d11-4494-bcd6-6127430af85f {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:06:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-f76cd95a-e292-4a12-98a1-552cab1e3507 req-cc48b2f4-eb3b-4a81-8253-f63a60bf6814 service nova] Acquiring lock "a0ad5b63-4c93-4d82-8f1d-3dc851c1de49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:06:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-f76cd95a-e292-4a12-98a1-552cab1e3507 req-cc48b2f4-eb3b-4a81-8253-f63a60bf6814 service nova] Lock "a0ad5b63-4c93-4d82-8f1d-3dc851c1de49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:06:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-f76cd95a-e292-4a12-98a1-552cab1e3507 req-cc48b2f4-eb3b-4a81-8253-f63a60bf6814 service nova] Lock "a0ad5b63-4c93-4d82-8f1d-3dc851c1de49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:06:56 user nova-compute[72239]: DEBUG nova.compute.manager [req-f76cd95a-e292-4a12-98a1-552cab1e3507 req-cc48b2f4-eb3b-4a81-8253-f63a60bf6814 service nova] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] No waiting events found dispatching network-vif-unplugged-145c1a27-3d11-4494-bcd6-6127430af85f {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:06:56 user nova-compute[72239]: DEBUG nova.compute.manager [req-f76cd95a-e292-4a12-98a1-552cab1e3507 req-cc48b2f4-eb3b-4a81-8253-f63a60bf6814 service nova] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Received event network-vif-unplugged-145c1a27-3d11-4494-bcd6-6127430af85f for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 15:06:56 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Instance destroyed successfully.
Jul 31 15:06:56 user nova-compute[72239]: DEBUG nova.objects.instance [None req-cdaf362b-7f7b-4a13-aeae-3ea78c0a9f58 tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Lazy-loading 'resources' on Instance uuid a0ad5b63-4c93-4d82-8f1d-3dc851c1de49 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:06:56 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-cdaf362b-7f7b-4a13-aeae-3ea78c0a9f58 tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:04:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1724598213',display_name='tempest-VolumesActionsTest-instance-1724598213',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1724598213',id=41,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T15:04:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='92ffcf9b2b124aaeb786147058bfe5ca',ramdisk_id='',reservation_id='r-jrfie8rf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-251272510',owner_user_name='tempest-VolumesActionsTest-251272510-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T15:04:56Z,user_data=None,user_id='d586e37da55746eb89ac48d602f85a88',uuid=a0ad5b63-4c93-4d82-8f1d-3dc851c1de49,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "145c1a27-3d11-4494-bcd6-6127430af85f", "address": "fa:16:3e:a8:8c:a8", "network": {"id": "ee08e64c-9a31-4b92-aa9e-08bcf26fa155", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1612671911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ffcf9b2b124aaeb786147058bfe5ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap145c1a27-3d", "ovs_interfaceid": "145c1a27-3d11-4494-bcd6-6127430af85f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 15:06:56 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-cdaf362b-7f7b-4a13-aeae-3ea78c0a9f58 tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Converting VIF {"id": "145c1a27-3d11-4494-bcd6-6127430af85f", "address": "fa:16:3e:a8:8c:a8", "network": {"id": "ee08e64c-9a31-4b92-aa9e-08bcf26fa155", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1612671911-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "92ffcf9b2b124aaeb786147058bfe5ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap145c1a27-3d", "ovs_interfaceid": "145c1a27-3d11-4494-bcd6-6127430af85f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:06:56 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-cdaf362b-7f7b-4a13-aeae-3ea78c0a9f58 tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:8c:a8,bridge_name='br-int',has_traffic_filtering=True,id=145c1a27-3d11-4494-bcd6-6127430af85f,network=Network(ee08e64c-9a31-4b92-aa9e-08bcf26fa155),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap145c1a27-3d') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:06:56 user nova-compute[72239]: DEBUG os_vif [None req-cdaf362b-7f7b-4a13-aeae-3ea78c0a9f58 tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:8c:a8,bridge_name='br-int',has_traffic_filtering=True,id=145c1a27-3d11-4494-bcd6-6127430af85f,network=Network(ee08e64c-9a31-4b92-aa9e-08bcf26fa155),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap145c1a27-3d') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 15:06:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:06:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap145c1a27-3d, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:06:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:06:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:06:56 user nova-compute[72239]: INFO os_vif [None req-cdaf362b-7f7b-4a13-aeae-3ea78c0a9f58 tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:8c:a8,bridge_name='br-int',has_traffic_filtering=True,id=145c1a27-3d11-4494-bcd6-6127430af85f,network=Network(ee08e64c-9a31-4b92-aa9e-08bcf26fa155),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap145c1a27-3d')
Jul 31 15:06:56 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-cdaf362b-7f7b-4a13-aeae-3ea78c0a9f58 tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Deleting instance files /opt/stack/data/nova/instances/a0ad5b63-4c93-4d82-8f1d-3dc851c1de49_del
Jul 31 15:06:56 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-cdaf362b-7f7b-4a13-aeae-3ea78c0a9f58 tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Deletion of /opt/stack/data/nova/instances/a0ad5b63-4c93-4d82-8f1d-3dc851c1de49_del complete
Jul 31 15:06:56 user nova-compute[72239]: INFO nova.compute.manager [None req-cdaf362b-7f7b-4a13-aeae-3ea78c0a9f58 tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 31 15:06:56 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-cdaf362b-7f7b-4a13-aeae-3ea78c0a9f58 tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 15:06:56 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 15:06:56 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 15:06:57 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:06:57 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Took 0.71 seconds to deallocate network for instance.
Jul 31 15:06:57 user nova-compute[72239]: DEBUG nova.compute.manager [req-4b6214c9-9df1-4644-b64e-8a6c8e822b5a req-9a3d540d-82f6-4751-8dc1-1df2b2dc88f9 service nova] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Received event network-vif-deleted-145c1a27-3d11-4494-bcd6-6127430af85f {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:06:57 user nova-compute[72239]: INFO nova.compute.manager [req-4b6214c9-9df1-4644-b64e-8a6c8e822b5a req-9a3d540d-82f6-4751-8dc1-1df2b2dc88f9 service nova] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Neutron deleted interface 145c1a27-3d11-4494-bcd6-6127430af85f; detaching it from the instance and deleting it from the info cache
Jul 31 15:06:57 user nova-compute[72239]: DEBUG nova.network.neutron [req-4b6214c9-9df1-4644-b64e-8a6c8e822b5a req-9a3d540d-82f6-4751-8dc1-1df2b2dc88f9 service nova] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:06:57 user nova-compute[72239]: DEBUG nova.compute.manager [req-4b6214c9-9df1-4644-b64e-8a6c8e822b5a req-9a3d540d-82f6-4751-8dc1-1df2b2dc88f9 service nova] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Detach interface failed, port_id=145c1a27-3d11-4494-bcd6-6127430af85f, reason: Instance a0ad5b63-4c93-4d82-8f1d-3dc851c1de49 could not be found. {{(pid=72239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 15:06:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-cdaf362b-7f7b-4a13-aeae-3ea78c0a9f58 tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:06:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-cdaf362b-7f7b-4a13-aeae-3ea78c0a9f58 tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:06:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:06:57 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-cdaf362b-7f7b-4a13-aeae-3ea78c0a9f58 tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:06:57 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-cdaf362b-7f7b-4a13-aeae-3ea78c0a9f58 tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:06:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-cdaf362b-7f7b-4a13-aeae-3ea78c0a9f58 tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:06:57 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-cdaf362b-7f7b-4a13-aeae-3ea78c0a9f58 tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Deleted allocations for instance a0ad5b63-4c93-4d82-8f1d-3dc851c1de49
Jul 31 15:06:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-cdaf362b-7f7b-4a13-aeae-3ea78c0a9f58 tempest-VolumesActionsTest-251272510 tempest-VolumesActionsTest-251272510-project-member] Lock "a0ad5b63-4c93-4d82-8f1d-3dc851c1de49" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.143s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:06:58 user nova-compute[72239]: DEBUG nova.compute.manager [req-98926145-e054-4e64-9f8f-0fb0a7e6fbf0 req-e33b7dca-c545-4675-95ac-42c4796ecfb2 service nova] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Received event network-vif-plugged-145c1a27-3d11-4494-bcd6-6127430af85f {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:06:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-98926145-e054-4e64-9f8f-0fb0a7e6fbf0 req-e33b7dca-c545-4675-95ac-42c4796ecfb2 service nova] Acquiring lock "a0ad5b63-4c93-4d82-8f1d-3dc851c1de49-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:06:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-98926145-e054-4e64-9f8f-0fb0a7e6fbf0 req-e33b7dca-c545-4675-95ac-42c4796ecfb2 service nova] Lock "a0ad5b63-4c93-4d82-8f1d-3dc851c1de49-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:06:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-98926145-e054-4e64-9f8f-0fb0a7e6fbf0 req-e33b7dca-c545-4675-95ac-42c4796ecfb2 service nova] Lock "a0ad5b63-4c93-4d82-8f1d-3dc851c1de49-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:06:58 user nova-compute[72239]: DEBUG nova.compute.manager [req-98926145-e054-4e64-9f8f-0fb0a7e6fbf0 req-e33b7dca-c545-4675-95ac-42c4796ecfb2 service nova] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] No waiting events found dispatching network-vif-plugged-145c1a27-3d11-4494-bcd6-6127430af85f {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:06:58 user nova-compute[72239]: WARNING nova.compute.manager [req-98926145-e054-4e64-9f8f-0fb0a7e6fbf0 req-e33b7dca-c545-4675-95ac-42c4796ecfb2 service nova] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Received unexpected event network-vif-plugged-145c1a27-3d11-4494-bcd6-6127430af85f for instance with vm_state deleted and task_state None.
Jul 31 15:06:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:06 user nova-compute[72239]: DEBUG nova.compute.manager [req-bd51669d-d159-4408-945b-9b9973bc63d1 req-e63cb8e9-23d1-44d9-87f3-f35b31f05cc0 service nova] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Received event network-changed-8422c73f-f89d-4170-b460-a31f0e8fe9ad {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:07:06 user nova-compute[72239]: DEBUG nova.compute.manager [req-bd51669d-d159-4408-945b-9b9973bc63d1 req-e63cb8e9-23d1-44d9-87f3-f35b31f05cc0 service nova] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Refreshing instance network info cache due to event network-changed-8422c73f-f89d-4170-b460-a31f0e8fe9ad. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:07:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-bd51669d-d159-4408-945b-9b9973bc63d1 req-e63cb8e9-23d1-44d9-87f3-f35b31f05cc0 service nova] Acquiring lock "refresh_cache-95c53d76-a495-4922-a7af-fcbf8321f19b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:07:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-bd51669d-d159-4408-945b-9b9973bc63d1 req-e63cb8e9-23d1-44d9-87f3-f35b31f05cc0 service nova] Acquired lock "refresh_cache-95c53d76-a495-4922-a7af-fcbf8321f19b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:07:06 user nova-compute[72239]: DEBUG nova.network.neutron [req-bd51669d-d159-4408-945b-9b9973bc63d1 req-e63cb8e9-23d1-44d9-87f3-f35b31f05cc0 service nova] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Refreshing network info cache for port 8422c73f-f89d-4170-b460-a31f0e8fe9ad {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:07:06 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e3f97785-63ea-44a5-bf5d-908964e64ca5 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Acquiring lock "95c53d76-a495-4922-a7af-fcbf8321f19b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:07:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e3f97785-63ea-44a5-bf5d-908964e64ca5 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "95c53d76-a495-4922-a7af-fcbf8321f19b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:07:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e3f97785-63ea-44a5-bf5d-908964e64ca5 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Acquiring lock "95c53d76-a495-4922-a7af-fcbf8321f19b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:07:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e3f97785-63ea-44a5-bf5d-908964e64ca5 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "95c53d76-a495-4922-a7af-fcbf8321f19b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:07:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e3f97785-63ea-44a5-bf5d-908964e64ca5 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "95c53d76-a495-4922-a7af-fcbf8321f19b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:07:06 user nova-compute[72239]: INFO nova.compute.manager [None req-e3f97785-63ea-44a5-bf5d-908964e64ca5 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Terminating instance
Jul 31 15:07:06 user nova-compute[72239]: DEBUG nova.compute.manager [None req-e3f97785-63ea-44a5-bf5d-908964e64ca5 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 15:07:06 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:06 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:06 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:06 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:07 user nova-compute[72239]: DEBUG nova.compute.manager [req-c74b15a6-8c89-4c5e-8ec7-99b6173a5111 req-135efe63-cd45-4c6d-a879-c97586c4fa2e service nova] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Received event network-vif-unplugged-8422c73f-f89d-4170-b460-a31f0e8fe9ad {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:07:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-c74b15a6-8c89-4c5e-8ec7-99b6173a5111 req-135efe63-cd45-4c6d-a879-c97586c4fa2e service nova] Acquiring lock "95c53d76-a495-4922-a7af-fcbf8321f19b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:07:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-c74b15a6-8c89-4c5e-8ec7-99b6173a5111 req-135efe63-cd45-4c6d-a879-c97586c4fa2e service nova] Lock "95c53d76-a495-4922-a7af-fcbf8321f19b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:07:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-c74b15a6-8c89-4c5e-8ec7-99b6173a5111 req-135efe63-cd45-4c6d-a879-c97586c4fa2e service nova] Lock "95c53d76-a495-4922-a7af-fcbf8321f19b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:07:07 user nova-compute[72239]: DEBUG nova.compute.manager [req-c74b15a6-8c89-4c5e-8ec7-99b6173a5111 req-135efe63-cd45-4c6d-a879-c97586c4fa2e service nova] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] No waiting events found dispatching network-vif-unplugged-8422c73f-f89d-4170-b460-a31f0e8fe9ad {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:07:07 user nova-compute[72239]: DEBUG nova.compute.manager [req-c74b15a6-8c89-4c5e-8ec7-99b6173a5111 req-135efe63-cd45-4c6d-a879-c97586c4fa2e service nova] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Received event network-vif-unplugged-8422c73f-f89d-4170-b460-a31f0e8fe9ad for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 15:07:07 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Instance destroyed successfully.
Jul 31 15:07:07 user nova-compute[72239]: DEBUG nova.objects.instance [None req-e3f97785-63ea-44a5-bf5d-908964e64ca5 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lazy-loading 'resources' on Instance uuid 95c53d76-a495-4922-a7af-fcbf8321f19b {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:07:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-e3f97785-63ea-44a5-bf5d-908964e64ca5 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:04:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-981630035',display_name='tempest-TestStampPattern-server-981630035',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-981630035',id=40,image_ref='87a24c01-7f66-4f70-af50-d5c9b09045dc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtzUkuhD+wwUbFtr7G/xwzzWTycEUmu5aFIujMoqcCgETcqAHEigBAjoG6HJEMVeMKVtot/DjyoIAoKu2HGxjf4jAREiiEvxQvonoCgtEXCLIHvDszAezjEtchB2nDfpg==',key_name='tempest-TestStampPattern-1537860596',keypairs=<?>,launch_index=0,launched_at=2023-07-31T15:04:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4228abbe80ac416fbcc6013767ca9384',ramdisk_id='',reservation_id='r-i1pe7yqx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='0a89aa93-374f-4487-893b-58c15d42c84c',image_min_disk='1',image_min_ram='0',image_owner_id='4228abbe80ac416fbcc6013767ca9384',image_owner_project_name='tempest-TestStampPattern-1615288352',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1615288352-project-member',image_user_id='fc15f7d4660746f59b6a8fb70f729521',owner_project_name='tempest-TestStampPattern-1615288352',owner_user_name='tempest-TestStampPattern-1615288352-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T15:04:19Z,user_data=None,user_id='fc15f7d4660746f59b6a8fb70f729521',uuid=95c53d76-a495-4922-a7af-fcbf8321f19b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8422c73f-f89d-4170-b460-a31f0e8fe9ad", "address": "fa:16:3e:4d:1c:7f", "network": {"id": "39af8721-7023-4cb5-9e06-293f319d5d93", "bridge": "br-int", "label": "tempest-TestStampPattern-549999556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228abbe80ac416fbcc6013767ca9384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8422c73f-f8", "ovs_interfaceid": "8422c73f-f89d-4170-b460-a31f0e8fe9ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 15:07:07 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-e3f97785-63ea-44a5-bf5d-908964e64ca5 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Converting VIF {"id": "8422c73f-f89d-4170-b460-a31f0e8fe9ad", "address": "fa:16:3e:4d:1c:7f", "network": {"id": "39af8721-7023-4cb5-9e06-293f319d5d93", "bridge": "br-int", "label": "tempest-TestStampPattern-549999556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.120", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228abbe80ac416fbcc6013767ca9384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8422c73f-f8", "ovs_interfaceid": "8422c73f-f89d-4170-b460-a31f0e8fe9ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:07:07 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-e3f97785-63ea-44a5-bf5d-908964e64ca5 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:1c:7f,bridge_name='br-int',has_traffic_filtering=True,id=8422c73f-f89d-4170-b460-a31f0e8fe9ad,network=Network(39af8721-7023-4cb5-9e06-293f319d5d93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8422c73f-f8') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:07:07 user nova-compute[72239]: DEBUG os_vif [None req-e3f97785-63ea-44a5-bf5d-908964e64ca5 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:1c:7f,bridge_name='br-int',has_traffic_filtering=True,id=8422c73f-f89d-4170-b460-a31f0e8fe9ad,network=Network(39af8721-7023-4cb5-9e06-293f319d5d93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8422c73f-f8') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 15:07:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8422c73f-f8, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:07:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:07:07 user nova-compute[72239]: INFO os_vif [None req-e3f97785-63ea-44a5-bf5d-908964e64ca5 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:1c:7f,bridge_name='br-int',has_traffic_filtering=True,id=8422c73f-f89d-4170-b460-a31f0e8fe9ad,network=Network(39af8721-7023-4cb5-9e06-293f319d5d93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8422c73f-f8')
Jul 31 15:07:07 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-e3f97785-63ea-44a5-bf5d-908964e64ca5 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Deleting instance files /opt/stack/data/nova/instances/95c53d76-a495-4922-a7af-fcbf8321f19b_del
Jul 31 15:07:07 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-e3f97785-63ea-44a5-bf5d-908964e64ca5 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Deletion of /opt/stack/data/nova/instances/95c53d76-a495-4922-a7af-fcbf8321f19b_del complete
Jul 31 15:07:07 user nova-compute[72239]: INFO nova.compute.manager [None req-e3f97785-63ea-44a5-bf5d-908964e64ca5 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Took 0.94 seconds to destroy the instance on the hypervisor.
Jul 31 15:07:07 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-e3f97785-63ea-44a5-bf5d-908964e64ca5 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 15:07:07 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 15:07:07 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 15:07:07 user nova-compute[72239]: DEBUG nova.network.neutron [req-bd51669d-d159-4408-945b-9b9973bc63d1 req-e63cb8e9-23d1-44d9-87f3-f35b31f05cc0 service nova] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Updated VIF entry in instance network info cache for port 8422c73f-f89d-4170-b460-a31f0e8fe9ad. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:07:07 user nova-compute[72239]: DEBUG nova.network.neutron [req-bd51669d-d159-4408-945b-9b9973bc63d1 req-e63cb8e9-23d1-44d9-87f3-f35b31f05cc0 service nova] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Updating instance_info_cache with network_info: [{"id": "8422c73f-f89d-4170-b460-a31f0e8fe9ad", "address": "fa:16:3e:4d:1c:7f", "network": {"id": "39af8721-7023-4cb5-9e06-293f319d5d93", "bridge": "br-int", "label": "tempest-TestStampPattern-549999556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228abbe80ac416fbcc6013767ca9384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8422c73f-f8", "ovs_interfaceid": "8422c73f-f89d-4170-b460-a31f0e8fe9ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:07:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-bd51669d-d159-4408-945b-9b9973bc63d1 req-e63cb8e9-23d1-44d9-87f3-f35b31f05cc0 service nova] Releasing lock "refresh_cache-95c53d76-a495-4922-a7af-fcbf8321f19b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:07:08 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:07:08 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Took 0.75 seconds to deallocate network for instance.
Jul 31 15:07:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e3f97785-63ea-44a5-bf5d-908964e64ca5 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:07:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e3f97785-63ea-44a5-bf5d-908964e64ca5 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:07:08 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-e3f97785-63ea-44a5-bf5d-908964e64ca5 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:07:08 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-e3f97785-63ea-44a5-bf5d-908964e64ca5 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:07:08 user nova-compute[72239]: DEBUG nova.compute.manager [req-891df78f-5174-4aa5-85e6-55a42b331ecc req-ef08d7d6-e5bb-492c-8152-e5e7621c6a16 service nova] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Received event network-vif-deleted-8422c73f-f89d-4170-b460-a31f0e8fe9ad {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:07:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e3f97785-63ea-44a5-bf5d-908964e64ca5 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.230s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:07:08 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-e3f97785-63ea-44a5-bf5d-908964e64ca5 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Deleted allocations for instance 95c53d76-a495-4922-a7af-fcbf8321f19b
Jul 31 15:07:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-e3f97785-63ea-44a5-bf5d-908964e64ca5 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "95c53d76-a495-4922-a7af-fcbf8321f19b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.136s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:07:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:09 user nova-compute[72239]: DEBUG nova.compute.manager [req-b738fca4-a973-427d-a8ff-0df7f046ccf9 req-1709a6b3-32b5-4a4c-8cc9-b1a77f6114be service nova] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Received event network-vif-plugged-8422c73f-f89d-4170-b460-a31f0e8fe9ad {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:07:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b738fca4-a973-427d-a8ff-0df7f046ccf9 req-1709a6b3-32b5-4a4c-8cc9-b1a77f6114be service nova] Acquiring lock "95c53d76-a495-4922-a7af-fcbf8321f19b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:07:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b738fca4-a973-427d-a8ff-0df7f046ccf9 req-1709a6b3-32b5-4a4c-8cc9-b1a77f6114be service nova] Lock "95c53d76-a495-4922-a7af-fcbf8321f19b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:07:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b738fca4-a973-427d-a8ff-0df7f046ccf9 req-1709a6b3-32b5-4a4c-8cc9-b1a77f6114be service nova] Lock "95c53d76-a495-4922-a7af-fcbf8321f19b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:07:09 user nova-compute[72239]: DEBUG nova.compute.manager [req-b738fca4-a973-427d-a8ff-0df7f046ccf9 req-1709a6b3-32b5-4a4c-8cc9-b1a77f6114be service nova] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] No waiting events found dispatching network-vif-plugged-8422c73f-f89d-4170-b460-a31f0e8fe9ad {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:07:09 user nova-compute[72239]: WARNING nova.compute.manager [req-b738fca4-a973-427d-a8ff-0df7f046ccf9 req-1709a6b3-32b5-4a4c-8cc9-b1a77f6114be service nova] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Received unexpected event network-vif-plugged-8422c73f-f89d-4170-b460-a31f0e8fe9ad for instance with vm_state deleted and task_state None.
Jul 31 15:07:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:11 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690816016.4851732, a0ad5b63-4c93-4d82-8f1d-3dc851c1de49 => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:07:11 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] VM Stopped (Lifecycle Event)
Jul 31 15:07:11 user nova-compute[72239]: DEBUG nova.compute.manager [None req-a25c1fda-876d-4ed0-af57-db434f686588 None None] [instance: a0ad5b63-4c93-4d82-8f1d-3dc851c1de49] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:07:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:13 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:07:13 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:07:13 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:07:14 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:07:14 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 15:07:14 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Didn't find any instances for network info cache update. {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 15:07:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:16 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:07:17 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:07:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:18 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:07:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "60a6975d-7c9a-4194-895f-4f66655b0e12" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:07:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "60a6975d-7c9a-4194-895f-4f66655b0e12" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:07:22 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690816027.4110765, 95c53d76-a495-4922-a7af-fcbf8321f19b => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:07:22 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] VM Stopped (Lifecycle Event)
Jul 31 15:07:22 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 15:07:22 user nova-compute[72239]: DEBUG nova.compute.manager [None req-02c9e188-8086-46d3-b1ee-cd20bdc07683 None None] [instance: 95c53d76-a495-4922-a7af-fcbf8321f19b] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:07:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:07:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:07:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:07:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:07:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:07:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:07:22 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 15:07:22 user nova-compute[72239]: INFO nova.compute.claims [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Claim successful on node user
Jul 31 15:07:22 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:07:22 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:07:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.292s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:07:22 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 15:07:22 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 15:07:22 user nova-compute[72239]: DEBUG nova.network.neutron [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 15:07:22 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 15:07:22 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 15:07:22 user nova-compute[72239]: INFO nova.virt.block_device [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Booting with volume snapshot 481e24a4-44aa-49ec-b4fd-b1c7661caae8 at /dev/vda
Jul 31 15:07:22 user nova-compute[72239]: DEBUG nova.policy [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a73969a32be54c8caf621290e8823134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aaefdc03aa4e43b4ba435eea373cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 15:07:23 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:07:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:07:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:07:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:07:23 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 15:07:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:07:23 user nova-compute[72239]: DEBUG nova.network.neutron [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Successfully created port: 1d212810-1a98-48a8-800d-a1ef4da2900b {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 15:07:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:07:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:07:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:07:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:07:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:07:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:07:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:07:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ba7bc46-392d-4fd7-a85e-84b728d34d2e/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:07:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ba7bc46-392d-4fd7-a85e-84b728d34d2e/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:07:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ba7bc46-392d-4fd7-a85e-84b728d34d2e/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:07:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ba7bc46-392d-4fd7-a85e-84b728d34d2e/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:07:25 user nova-compute[72239]: DEBUG nova.network.neutron [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Successfully updated port: 1d212810-1a98-48a8-800d-a1ef4da2900b {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 15:07:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:25 user nova-compute[72239]: DEBUG nova.compute.manager [req-cad2a2e5-ffa0-4f77-bc47-e779bde99899 req-3636af26-dae4-45d1-8843-9d50674764c5 service nova] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Received event network-changed-1d212810-1a98-48a8-800d-a1ef4da2900b {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:07:25 user nova-compute[72239]: DEBUG nova.compute.manager [req-cad2a2e5-ffa0-4f77-bc47-e779bde99899 req-3636af26-dae4-45d1-8843-9d50674764c5 service nova] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Refreshing instance network info cache due to event network-changed-1d212810-1a98-48a8-800d-a1ef4da2900b. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:07:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-cad2a2e5-ffa0-4f77-bc47-e779bde99899 req-3636af26-dae4-45d1-8843-9d50674764c5 service nova] Acquiring lock "refresh_cache-60a6975d-7c9a-4194-895f-4f66655b0e12" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:07:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-cad2a2e5-ffa0-4f77-bc47-e779bde99899 req-3636af26-dae4-45d1-8843-9d50674764c5 service nova] Acquired lock "refresh_cache-60a6975d-7c9a-4194-895f-4f66655b0e12" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:07:25 user nova-compute[72239]: DEBUG nova.network.neutron [req-cad2a2e5-ffa0-4f77-bc47-e779bde99899 req-3636af26-dae4-45d1-8843-9d50674764c5 service nova] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Refreshing network info cache for port 1d212810-1a98-48a8-800d-a1ef4da2900b {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:07:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "refresh_cache-60a6975d-7c9a-4194-895f-4f66655b0e12" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:07:25 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:07:25 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:07:25 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=8252MB free_disk=25.118968963623047GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 15:07:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:07:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:07:25 user nova-compute[72239]: DEBUG nova.network.neutron [req-cad2a2e5-ffa0-4f77-bc47-e779bde99899 req-3636af26-dae4-45d1-8843-9d50674764c5 service nova] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 15:07:25 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 0a89aa93-374f-4487-893b-58c15d42c84c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:07:25 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance f98cea94-e905-47c5-bf88-5f5694934966 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:07:25 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 9ba7bc46-392d-4fd7-a85e-84b728d34d2e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:07:25 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 60a6975d-7c9a-4194-895f-4f66655b0e12 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:07:25 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 15:07:25 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 15:07:25 user nova-compute[72239]: DEBUG nova.network.neutron [req-cad2a2e5-ffa0-4f77-bc47-e779bde99899 req-3636af26-dae4-45d1-8843-9d50674764c5 service nova] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:07:25 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:07:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-cad2a2e5-ffa0-4f77-bc47-e779bde99899 req-3636af26-dae4-45d1-8843-9d50674764c5 service nova] Releasing lock "refresh_cache-60a6975d-7c9a-4194-895f-4f66655b0e12" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:07:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquired lock "refresh_cache-60a6975d-7c9a-4194-895f-4f66655b0e12" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:07:25 user nova-compute[72239]: DEBUG nova.network.neutron [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 15:07:25 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:07:25 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 15:07:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.299s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:07:25 user nova-compute[72239]: DEBUG nova.network.neutron [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 15:07:25 user nova-compute[72239]: DEBUG nova.network.neutron [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Updating instance_info_cache with network_info: [{"id": "1d212810-1a98-48a8-800d-a1ef4da2900b", "address": "fa:16:3e:1a:7f:3b", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d212810-1a", "ovs_interfaceid": "1d212810-1a98-48a8-800d-a1ef4da2900b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:07:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Releasing lock "refresh_cache-60a6975d-7c9a-4194-895f-4f66655b0e12" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:07:25 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Instance network_info: |[{"id": "1d212810-1a98-48a8-800d-a1ef4da2900b", "address": "fa:16:3e:1a:7f:3b", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d212810-1a", "ovs_interfaceid": "1d212810-1a98-48a8-800d-a1ef4da2900b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 15:07:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:27 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:07:27 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 15:07:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:28 user nova-compute[72239]: DEBUG os_brick.utils [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:07:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:07:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:07:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e9ad8f-67b5-424e-a2be-414cb6bfdf6a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:07:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:07:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:07:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[79780721-3b93-4407-9ea6-9da80afd5a87]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:07:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:07:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:07:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd01fa74-0ab1-4a40-abb5-80a2ac62d3e3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:07:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2813c05f-aafb-458f-b1e7-6d3b33103cf6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:07:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:07:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:07:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 15:07:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:07:28 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:07:28 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 15:07:28 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa056aa-be19-479b-b744-d0b498b6b33f]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:07:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 15:07:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 15:07:28 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 15:07:28 user nova-compute[72239]: DEBUG os_brick.utils [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:07:28 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Updating existing volume attachment record: da30ad23-32e7-4237-bb26-51ed47b0c92b {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 15:07:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:32 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 15:07:36 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Creating image(s)
Jul 31 15:07:36 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Did not create local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Ensure instance console log exists: /opt/stack/data/nova/instances/60a6975d-7c9a-4194-895f-4f66655b0e12/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Start _get_guest_xml network_info=[{"id": "1d212810-1a98-48a8-800d-a1ef4da2900b", "address": "fa:16:3e:1a:7f:3b", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d212810-1a", "ovs_interfaceid": "1d212810-1a98-48a8-800d-a1ef4da2900b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'da30ad23-32e7-4237-bb26-51ed47b0c92b', 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RMvoIQPp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '60a6975d-7c9a-4194-895f-4f66655b0e12', 'attached_at': '', 'detached_at': '', 'volume_id': 'e3db768d-7ca8-4618-8dec-761d36e05a25', 'serial': 'e3db768d-7ca8-4618-8dec-761d36e05a25'}, 'delete_on_termination': True, 'guest_format': None, 'volume_type': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 15:07:36 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:07:36 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:07:36 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RMvoIQPp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:07:36 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:07:36 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:07:36 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:07:36 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:07:36 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 15:07:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa660117-9fd2-4d30-af02-8559707ff381]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 15:07:36 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[046801bd-a6ee-4306-bf0b-8cd67863acf3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25] added
Jul 31 15:07:36 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e66faf5-79f6-486d-aba6-220c4e1a7e35]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c884ddf-b6c2-436b-8008-e9d03b0eed4b]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RMvoIQPp {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RMvoIQPp" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[838a1fec-849d-44a8-beae-db5daa728640]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RMvoIQPp'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f1d629-fa57-4b0d-bccc-929903b7f045]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb1b33b-eeaf-4bd9-b9fc-1254238ac543]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 15:07:36 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 15:07:36 user nova-compute[72239]:  {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:07:36 user nova-compute[72239]: WARNING os_brick.initiator.connectors.iscsi [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 15:07:36 user nova-compute[72239]: 
Jul 31 15:07:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[633c81c2-ad96-4ee1-a1a0-33f070e3eb7f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25, portal: 172.16.0.220,3260]
Jul 31 15:07:36 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25, portal: 172.16.0.220,3260] successful.
Jul 31 15:07:36 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da529d0-d0d5-4c96-9b3f-3706682975e3]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aff1740-c0d5-4136-abb6-9a0fc97f0ff6]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 (non-flash)
Jul 31 15:07:36 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 (non-flash)
Jul 31 15:07:36 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.029s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cd3566-5faf-4b97-a632-9328d21026a7]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 15:07:36 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RMvoIQPp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 15:07:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:37 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:07:37 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '26233396631373933', 'path': '/dev/sdb'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:07:37 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233396631373933', 'path': '/dev/sdb'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 15:07:37 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:07:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1495716642',display_name='tempest-TestVolumeBootPattern-server-1495716642',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1495716642',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35aaefdc03aa4e43b4ba435eea373cc4',ramdisk_id='',reservation_id='r-n2dm1ivw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1903261024',owner_user_name='tempest-TestVolumeBootPattern-1903261024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T15:07:23Z,user_data=None,user_id='a73969a32be54c8caf621290e8823134',uuid=60a6975d-7c9a-4194-895f-4f66655b0e12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d212810-1a98-48a8-800d-a1ef4da2900b", "address": "fa:16:3e:1a:7f:3b", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d212810-1a", "ovs_interfaceid": "1d212810-1a98-48a8-800d-a1ef4da2900b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 15:07:37 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Converting VIF {"id": "1d212810-1a98-48a8-800d-a1ef4da2900b", "address": "fa:16:3e:1a:7f:3b", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d212810-1a", "ovs_interfaceid": "1d212810-1a98-48a8-800d-a1ef4da2900b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:07:37 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:7f:3b,bridge_name='br-int',has_traffic_filtering=True,id=1d212810-1a98-48a8-800d-a1ef4da2900b,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d212810-1a') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:07:37 user nova-compute[72239]: DEBUG nova.objects.instance [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lazy-loading 'pci_devices' on Instance uuid 60a6975d-7c9a-4194-895f-4f66655b0e12 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:07:37 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] End _get_guest_xml xml=<domain type="kvm">
Jul 31 15:07:37 user nova-compute[72239]:   <uuid>60a6975d-7c9a-4194-895f-4f66655b0e12</uuid>
Jul 31 15:07:37 user nova-compute[72239]:   <name>instance-0000002b</name>
Jul 31 15:07:37 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 15:07:37 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 15:07:37 user nova-compute[72239]:   <metadata>
Jul 31 15:07:37 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 15:07:37 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 15:07:37 user nova-compute[72239]:       <nova:name>tempest-TestVolumeBootPattern-server-1495716642</nova:name>
Jul 31 15:07:37 user nova-compute[72239]:       <nova:creationTime>2023-07-31 15:07:36</nova:creationTime>
Jul 31 15:07:37 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 15:07:37 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 15:07:37 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 15:07:37 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 15:07:37 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 15:07:37 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 15:07:37 user nova-compute[72239]:       </nova:flavor>
Jul 31 15:07:37 user nova-compute[72239]:       <nova:owner>
Jul 31 15:07:37 user nova-compute[72239]:         <nova:user uuid="a73969a32be54c8caf621290e8823134">tempest-TestVolumeBootPattern-1903261024-project-member</nova:user>
Jul 31 15:07:37 user nova-compute[72239]:         <nova:project uuid="35aaefdc03aa4e43b4ba435eea373cc4">tempest-TestVolumeBootPattern-1903261024</nova:project>
Jul 31 15:07:37 user nova-compute[72239]:       </nova:owner>
Jul 31 15:07:37 user nova-compute[72239]:       <nova:ports>
Jul 31 15:07:37 user nova-compute[72239]:         <nova:port uuid="1d212810-1a98-48a8-800d-a1ef4da2900b">
Jul 31 15:07:37 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 31 15:07:37 user nova-compute[72239]:         </nova:port>
Jul 31 15:07:37 user nova-compute[72239]:       </nova:ports>
Jul 31 15:07:37 user nova-compute[72239]:     </nova:instance>
Jul 31 15:07:37 user nova-compute[72239]:   </metadata>
Jul 31 15:07:37 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 15:07:37 user nova-compute[72239]:     <system>
Jul 31 15:07:37 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 15:07:37 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 15:07:37 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 15:07:37 user nova-compute[72239]:       <entry name="serial">60a6975d-7c9a-4194-895f-4f66655b0e12</entry>
Jul 31 15:07:37 user nova-compute[72239]:       <entry name="uuid">60a6975d-7c9a-4194-895f-4f66655b0e12</entry>
Jul 31 15:07:37 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 15:07:37 user nova-compute[72239]:     </system>
Jul 31 15:07:37 user nova-compute[72239]:   </sysinfo>
Jul 31 15:07:37 user nova-compute[72239]:   <os>
Jul 31 15:07:37 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 15:07:37 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 15:07:37 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 15:07:37 user nova-compute[72239]:   </os>
Jul 31 15:07:37 user nova-compute[72239]:   <features>
Jul 31 15:07:37 user nova-compute[72239]:     <acpi/>
Jul 31 15:07:37 user nova-compute[72239]:     <apic/>
Jul 31 15:07:37 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 15:07:37 user nova-compute[72239]:   </features>
Jul 31 15:07:37 user nova-compute[72239]:   <clock offset="utc">
Jul 31 15:07:37 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 15:07:37 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 15:07:37 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 15:07:37 user nova-compute[72239]:   </clock>
Jul 31 15:07:37 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 15:07:37 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 15:07:37 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 15:07:37 user nova-compute[72239]:   </cpu>
Jul 31 15:07:37 user nova-compute[72239]:   <devices>
Jul 31 15:07:37 user nova-compute[72239]:     <disk type="block" device="disk">
Jul 31 15:07:37 user nova-compute[72239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:07:37 user nova-compute[72239]:       <source dev="/dev/sdb"/>
Jul 31 15:07:37 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 15:07:37 user nova-compute[72239]:       <serial>e3db768d-7ca8-4618-8dec-761d36e05a25</serial>
Jul 31 15:07:37 user nova-compute[72239]:     </disk>
Jul 31 15:07:37 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 15:07:37 user nova-compute[72239]:       <mac address="fa:16:3e:1a:7f:3b"/>
Jul 31 15:07:37 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:07:37 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 15:07:37 user nova-compute[72239]:       <target dev="tap1d212810-1a"/>
Jul 31 15:07:37 user nova-compute[72239]:     </interface>
Jul 31 15:07:37 user nova-compute[72239]:     <serial type="pty">
Jul 31 15:07:37 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/60a6975d-7c9a-4194-895f-4f66655b0e12/console.log" append="off"/>
Jul 31 15:07:37 user nova-compute[72239]:     </serial>
Jul 31 15:07:37 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 15:07:37 user nova-compute[72239]:     <video>
Jul 31 15:07:37 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:07:37 user nova-compute[72239]:     </video>
Jul 31 15:07:37 user nova-compute[72239]:     <rng model="virtio">
Jul 31 15:07:37 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 15:07:37 user nova-compute[72239]:     </rng>
Jul 31 15:07:37 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 15:07:37 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 15:07:37 user nova-compute[72239]:       <stats period="10"/>
Jul 31 15:07:37 user nova-compute[72239]:     </memballoon>
Jul 31 15:07:37 user nova-compute[72239]:   </devices>
Jul 31 15:07:37 user nova-compute[72239]: </domain>
Jul 31 15:07:37 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 15:07:37 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:07:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1495716642',display_name='tempest-TestVolumeBootPattern-server-1495716642',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1495716642',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35aaefdc03aa4e43b4ba435eea373cc4',ramdisk_id='',reservation_id='r-n2dm1ivw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1903261024',owner_user_name='tempest-TestVolumeBootPattern-1903261024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T15:07:23Z,user_data=None,user_id='a73969a32be54c8caf621290e8823134',uuid=60a6975d-7c9a-4194-895f-4f66655b0e12,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1d212810-1a98-48a8-800d-a1ef4da2900b", "address": "fa:16:3e:1a:7f:3b", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d212810-1a", "ovs_interfaceid": "1d212810-1a98-48a8-800d-a1ef4da2900b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 15:07:37 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Converting VIF {"id": "1d212810-1a98-48a8-800d-a1ef4da2900b", "address": "fa:16:3e:1a:7f:3b", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d212810-1a", "ovs_interfaceid": "1d212810-1a98-48a8-800d-a1ef4da2900b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:07:37 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:7f:3b,bridge_name='br-int',has_traffic_filtering=True,id=1d212810-1a98-48a8-800d-a1ef4da2900b,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d212810-1a') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:07:37 user nova-compute[72239]: DEBUG os_vif [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:7f:3b,bridge_name='br-int',has_traffic_filtering=True,id=1d212810-1a98-48a8-800d-a1ef4da2900b,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d212810-1a') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 15:07:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:07:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 15:07:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1d212810-1a, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:07:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap1d212810-1a, col_values=(('external_ids', {'iface-id': '1d212810-1a98-48a8-800d-a1ef4da2900b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:7f:3b', 'vm-uuid': '60a6975d-7c9a-4194-895f-4f66655b0e12'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:07:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:37 user nova-compute[72239]: INFO os_vif [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:7f:3b,bridge_name='br-int',has_traffic_filtering=True,id=1d212810-1a98-48a8-800d-a1ef4da2900b,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d212810-1a')
Jul 31 15:07:37 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:07:37 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] No VIF found with MAC fa:16:3e:1a:7f:3b, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 15:07:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:39 user nova-compute[72239]: DEBUG nova.compute.manager [req-d6c2e5b0-42f8-486f-adbc-c14840dfbd0b req-83325cdf-61c3-4731-b8fa-daa22ba3c585 service nova] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Received event network-vif-plugged-1d212810-1a98-48a8-800d-a1ef4da2900b {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:07:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d6c2e5b0-42f8-486f-adbc-c14840dfbd0b req-83325cdf-61c3-4731-b8fa-daa22ba3c585 service nova] Acquiring lock "60a6975d-7c9a-4194-895f-4f66655b0e12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:07:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d6c2e5b0-42f8-486f-adbc-c14840dfbd0b req-83325cdf-61c3-4731-b8fa-daa22ba3c585 service nova] Lock "60a6975d-7c9a-4194-895f-4f66655b0e12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:07:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d6c2e5b0-42f8-486f-adbc-c14840dfbd0b req-83325cdf-61c3-4731-b8fa-daa22ba3c585 service nova] Lock "60a6975d-7c9a-4194-895f-4f66655b0e12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:07:39 user nova-compute[72239]: DEBUG nova.compute.manager [req-d6c2e5b0-42f8-486f-adbc-c14840dfbd0b req-83325cdf-61c3-4731-b8fa-daa22ba3c585 service nova] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] No waiting events found dispatching network-vif-plugged-1d212810-1a98-48a8-800d-a1ef4da2900b {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:07:39 user nova-compute[72239]: WARNING nova.compute.manager [req-d6c2e5b0-42f8-486f-adbc-c14840dfbd0b req-83325cdf-61c3-4731-b8fa-daa22ba3c585 service nova] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Received unexpected event network-vif-plugged-1d212810-1a98-48a8-800d-a1ef4da2900b for instance with vm_state building and task_state spawning.
Jul 31 15:07:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:41 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690816061.318721, 60a6975d-7c9a-4194-895f-4f66655b0e12 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:07:41 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] VM Resumed (Lifecycle Event)
Jul 31 15:07:41 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 15:07:41 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 15:07:41 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Instance spawned successfully.
Jul 31 15:07:41 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 15:07:41 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:07:41 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:07:41 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:07:41 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:07:41 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:07:41 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:07:41 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:07:41 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:07:41 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 15:07:41 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690816061.3244433, 60a6975d-7c9a-4194-895f-4f66655b0e12 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:07:41 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] VM Started (Lifecycle Event)
Jul 31 15:07:41 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:07:41 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:07:41 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 15:07:41 user nova-compute[72239]: INFO nova.compute.manager [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Took 5.27 seconds to spawn the instance on the hypervisor.
Jul 31 15:07:41 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:07:41 user nova-compute[72239]: DEBUG nova.compute.manager [req-578c8710-e9fc-4851-91b0-4e5226c1c405 req-fa03cb8d-e907-4d3f-9cb4-c4929b342412 service nova] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Received event network-vif-plugged-1d212810-1a98-48a8-800d-a1ef4da2900b {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:07:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-578c8710-e9fc-4851-91b0-4e5226c1c405 req-fa03cb8d-e907-4d3f-9cb4-c4929b342412 service nova] Acquiring lock "60a6975d-7c9a-4194-895f-4f66655b0e12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:07:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-578c8710-e9fc-4851-91b0-4e5226c1c405 req-fa03cb8d-e907-4d3f-9cb4-c4929b342412 service nova] Lock "60a6975d-7c9a-4194-895f-4f66655b0e12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:07:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-578c8710-e9fc-4851-91b0-4e5226c1c405 req-fa03cb8d-e907-4d3f-9cb4-c4929b342412 service nova] Lock "60a6975d-7c9a-4194-895f-4f66655b0e12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:07:41 user nova-compute[72239]: DEBUG nova.compute.manager [req-578c8710-e9fc-4851-91b0-4e5226c1c405 req-fa03cb8d-e907-4d3f-9cb4-c4929b342412 service nova] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] No waiting events found dispatching network-vif-plugged-1d212810-1a98-48a8-800d-a1ef4da2900b {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:07:41 user nova-compute[72239]: WARNING nova.compute.manager [req-578c8710-e9fc-4851-91b0-4e5226c1c405 req-fa03cb8d-e907-4d3f-9cb4-c4929b342412 service nova] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Received unexpected event network-vif-plugged-1d212810-1a98-48a8-800d-a1ef4da2900b for instance with vm_state building and task_state spawning.
Jul 31 15:07:41 user nova-compute[72239]: INFO nova.compute.manager [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Took 19.06 seconds to build instance.
Jul 31 15:07:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1eb08883-0591-4d8b-82e7-7d53c1144209 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "60a6975d-7c9a-4194-895f-4f66655b0e12" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.447s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:07:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:43 user nova-compute[72239]: DEBUG nova.compute.manager [req-c3d420de-6f5e-477a-a8af-fe7d6094dbee req-21f01d89-dba1-4e67-80c1-31336e59e9f7 service nova] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Received event network-changed-38b94412-ebcb-4c39-9856-d328dac47a43 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:07:43 user nova-compute[72239]: DEBUG nova.compute.manager [req-c3d420de-6f5e-477a-a8af-fe7d6094dbee req-21f01d89-dba1-4e67-80c1-31336e59e9f7 service nova] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Refreshing instance network info cache due to event network-changed-38b94412-ebcb-4c39-9856-d328dac47a43. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:07:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-c3d420de-6f5e-477a-a8af-fe7d6094dbee req-21f01d89-dba1-4e67-80c1-31336e59e9f7 service nova] Acquiring lock "refresh_cache-9ba7bc46-392d-4fd7-a85e-84b728d34d2e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:07:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-c3d420de-6f5e-477a-a8af-fe7d6094dbee req-21f01d89-dba1-4e67-80c1-31336e59e9f7 service nova] Acquired lock "refresh_cache-9ba7bc46-392d-4fd7-a85e-84b728d34d2e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:07:43 user nova-compute[72239]: DEBUG nova.network.neutron [req-c3d420de-6f5e-477a-a8af-fe7d6094dbee req-21f01d89-dba1-4e67-80c1-31336e59e9f7 service nova] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Refreshing network info cache for port 38b94412-ebcb-4c39-9856-d328dac47a43 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:07:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Acquiring lock "9ba7bc46-392d-4fd7-a85e-84b728d34d2e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:07:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lock "9ba7bc46-392d-4fd7-a85e-84b728d34d2e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:07:43 user nova-compute[72239]: DEBUG nova.objects.instance [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lazy-loading 'flavor' on Instance uuid 9ba7bc46-392d-4fd7-a85e-84b728d34d2e {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:07:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lock "9ba7bc46-392d-4fd7-a85e-84b728d34d2e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:07:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Acquiring lock "9ba7bc46-392d-4fd7-a85e-84b728d34d2e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:07:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lock "9ba7bc46-392d-4fd7-a85e-84b728d34d2e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:07:44 user nova-compute[72239]: INFO nova.compute.manager [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Attaching volume 62ea7af2-18de-4bdf-b567-1552fc153220 to /dev/vdb
Jul 31 15:07:44 user nova-compute[72239]: DEBUG os_brick.utils [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:07:44 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:07:44 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.066s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:07:44 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b46345f-60c1-4b0d-8b27-f3fce1997cb4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:07:44 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:07:44 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:07:44 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c982cc9-6180-4766-8b43-b5a4cd710512]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:07:44 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:07:44 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:07:44 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e948c2-2e08-4ff3-8d5b-65e1f9357ec2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:07:44 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[15e0d19e-ab3a-40d6-8f75-3c3eaade0b1d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:07:44 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:07:44 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:07:44 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 15:07:44 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:07:44 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:07:44 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 15:07:44 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca6e3c0-25f0-45cf-9c53-e6c8dfd98b02]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:07:44 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 15:07:44 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 15:07:44 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 15:07:44 user nova-compute[72239]: DEBUG os_brick.utils [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] <== get_connector_properties: return (206ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:07:44 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Updating existing volume attachment record: f72ec91e-f9c2-460f-9c84-91f3f0b22d12 {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 15:07:44 user nova-compute[72239]: DEBUG nova.network.neutron [req-c3d420de-6f5e-477a-a8af-fe7d6094dbee req-21f01d89-dba1-4e67-80c1-31336e59e9f7 service nova] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Updated VIF entry in instance network info cache for port 38b94412-ebcb-4c39-9856-d328dac47a43. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:07:44 user nova-compute[72239]: DEBUG nova.network.neutron [req-c3d420de-6f5e-477a-a8af-fe7d6094dbee req-21f01d89-dba1-4e67-80c1-31336e59e9f7 service nova] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Updating instance_info_cache with network_info: [{"id": "38b94412-ebcb-4c39-9856-d328dac47a43", "address": "fa:16:3e:16:9d:79", "network": {"id": "982c660e-02ba-428c-93d9-774e0c381aba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-768235194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "680110c45b9b4484ac099c9389ebe1ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b94412-eb", "ovs_interfaceid": "38b94412-ebcb-4c39-9856-d328dac47a43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:07:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-c3d420de-6f5e-477a-a8af-fe7d6094dbee req-21f01d89-dba1-4e67-80c1-31336e59e9f7 service nova] Releasing lock "refresh_cache-9ba7bc46-392d-4fd7-a85e-84b728d34d2e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:07:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:52 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 15:07:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ubqRxkJm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:07:52 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:07:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:07:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:07:52 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:07:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:07:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:07:52 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 15:07:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220 -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:07:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220 -p 172.16.0.220:3260" returned: 21 in 0.031s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:07:52 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cd1cb6-454d-407f-bac3-efbe20b823f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:07:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 15:07:52 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:07:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220 -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:07:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:07:52 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[10fff51d-484e-4d9c-9064-50ff0614c739]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:07:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220] added
Jul 31 15:07:52 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:07:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:07:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:07:52 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c843af8-9c2b-4f10-b389-8e9e08c64190]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:07:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:07:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:07:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:07:52 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1891e7-902d-4c10-a0c9-85150e618eec]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:07:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:07:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ubqRxkJm {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:07:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ubqRxkJm" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:07:52 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[23dcc25c-72df-4e73-9c72-8c260b939b47]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:07:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ubqRxkJm'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:07:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:07:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:07:52 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d58a6c5-90ba-48ac-9641-55d940c5a39f]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:07:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:07:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:07:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:07:52 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[854fd371-4157-4a17-935a-7fea13997d6b]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:07:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 (non-flash)
Jul 31 15:07:52 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:07:52 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 (non-flash)
Jul 31 15:07:52 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:07:52 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220 -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:07:53 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:07:53 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cf5b34-e8f4-4c39-a11d-6e0ab2a7af10]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:07:53 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220, portal: 172.16.0.220,3260]
Jul 31 15:07:53 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220, portal: 172.16.0.220,3260] successful.
Jul 31 15:07:53 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:07:53 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:07:53 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:07:53 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[070fee18-1237-4f65-b516-36fba86d6fd1]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:07:53 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:07:53 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:07:53 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:07:53 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ababc85c-150a-4043-a6df-1e7a1debacc8]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:07:53 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 (non-flash)
Jul 31 15:07:53 user nova-compute[72239]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220 (non-flash)
Jul 31 15:07:53 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:07:53 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 (non-flash)
Jul 31 15:07:53 user nova-compute[72239]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220 (non-flash)
Jul 31 15:07:53 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:07:53 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:07:53 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 15:07:53 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 15:07:53 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 15:07:53 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:07:53 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:07:53 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba849ee-e860-49cc-b2d2-ebe6dd16b4b0]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:07:53 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 15:07:53 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ubqRxkJm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 15:07:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:54 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:07:54 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] <== connect_volume: return (1392ms) {'type': 'block', 'scsi_wwn': '23037613738323135', 'path': '/dev/sdc'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:07:54 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037613738323135', 'path': '/dev/sdc'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 15:07:54 user nova-compute[72239]: DEBUG nova.objects.instance [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lazy-loading 'flavor' on Instance uuid 9ba7bc46-392d-4fd7-a85e-84b728d34d2e {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:07:54 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 15:07:54 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:07:54 user nova-compute[72239]:   <source dev="/dev/sdc"/>
Jul 31 15:07:54 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 15:07:54 user nova-compute[72239]:   <serial>62ea7af2-18de-4bdf-b567-1552fc153220</serial>
Jul 31 15:07:54 user nova-compute[72239]: </disk>
Jul 31 15:07:54 user nova-compute[72239]:  {{(pid=72239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 15:07:54 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:07:54 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:07:54 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] No VIF found with MAC fa:16:3e:16:9d:79, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 15:07:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-bfd741c1-748a-47bb-b724-4c2139c2ea81 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lock "9ba7bc46-392d-4fd7-a85e-84b728d34d2e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.694s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:07:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:07:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Acquiring lock "9ba7bc46-392d-4fd7-a85e-84b728d34d2e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:08:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lock "9ba7bc46-392d-4fd7-a85e-84b728d34d2e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:08:00 user nova-compute[72239]: DEBUG nova.objects.instance [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lazy-loading 'flavor' on Instance uuid 9ba7bc46-392d-4fd7-a85e-84b728d34d2e {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:08:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lock "9ba7bc46-392d-4fd7-a85e-84b728d34d2e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:08:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Acquiring lock "9ba7bc46-392d-4fd7-a85e-84b728d34d2e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:08:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lock "9ba7bc46-392d-4fd7-a85e-84b728d34d2e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:08:00 user nova-compute[72239]: INFO nova.compute.manager [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Attaching volume 8bcbfc98-610f-415f-b06a-a91b5c21539a to /dev/vdc
Jul 31 15:08:00 user nova-compute[72239]: DEBUG os_brick.utils [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:08:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:08:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:08:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d2a5d7-c9c2-4c59-a2da-83b7ac83cae1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:08:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:08:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:08:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d52a2b95-b814-4904-ad0e-863fbb867f78]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:08:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:08:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:08:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4d08ec-6fec-4c9d-8bbc-239f2afdb2be]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:08:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bb70c4-421f-4640-98a4-44238c0104a4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:08:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:08:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:08:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 15:08:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:08:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:08:00 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 15:08:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b5a217-7f83-4332-9a13-596f41893f5a]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:08:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 15:08:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 15:08:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 15:08:00 user nova-compute[72239]: DEBUG os_brick.utils [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:08:00 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Updating existing volume attachment record: 950bf474-0770-4f08-bd33-b35a43680da2 {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 15:08:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:08 user nova-compute[72239]: DEBUG nova.compute.manager [req-f5082bd3-c659-4dc7-a52d-407fc45c3a84 req-f124357b-e836-4b43-ba05-7cbfd8ec7d80 service nova] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Received event network-changed-73d584f4-4986-4f0c-8483-18ef254a21f4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:08:08 user nova-compute[72239]: DEBUG nova.compute.manager [req-f5082bd3-c659-4dc7-a52d-407fc45c3a84 req-f124357b-e836-4b43-ba05-7cbfd8ec7d80 service nova] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Refreshing instance network info cache due to event network-changed-73d584f4-4986-4f0c-8483-18ef254a21f4. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:08:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-f5082bd3-c659-4dc7-a52d-407fc45c3a84 req-f124357b-e836-4b43-ba05-7cbfd8ec7d80 service nova] Acquiring lock "refresh_cache-0a89aa93-374f-4487-893b-58c15d42c84c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:08:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-f5082bd3-c659-4dc7-a52d-407fc45c3a84 req-f124357b-e836-4b43-ba05-7cbfd8ec7d80 service nova] Acquired lock "refresh_cache-0a89aa93-374f-4487-893b-58c15d42c84c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:08:08 user nova-compute[72239]: DEBUG nova.network.neutron [req-f5082bd3-c659-4dc7-a52d-407fc45c3a84 req-f124357b-e836-4b43-ba05-7cbfd8ec7d80 service nova] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Refreshing network info cache for port 73d584f4-4986-4f0c-8483-18ef254a21f4 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:08:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2752e7de-36d5-486b-8b07-52db5aa31873 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Acquiring lock "0a89aa93-374f-4487-893b-58c15d42c84c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:08:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2752e7de-36d5-486b-8b07-52db5aa31873 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "0a89aa93-374f-4487-893b-58c15d42c84c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:08:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2752e7de-36d5-486b-8b07-52db5aa31873 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Acquiring lock "0a89aa93-374f-4487-893b-58c15d42c84c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:08:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2752e7de-36d5-486b-8b07-52db5aa31873 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "0a89aa93-374f-4487-893b-58c15d42c84c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:08:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2752e7de-36d5-486b-8b07-52db5aa31873 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "0a89aa93-374f-4487-893b-58c15d42c84c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:08:08 user nova-compute[72239]: INFO nova.compute.manager [None req-2752e7de-36d5-486b-8b07-52db5aa31873 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Terminating instance
Jul 31 15:08:08 user nova-compute[72239]: DEBUG nova.compute.manager [None req-2752e7de-36d5-486b-8b07-52db5aa31873 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 15:08:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:09 user nova-compute[72239]: DEBUG nova.compute.manager [req-5ff75c84-ea14-440f-ac28-0d75513501c9 req-2bbc476e-4bbb-486a-a4df-d074fc7288d0 service nova] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Received event network-vif-unplugged-73d584f4-4986-4f0c-8483-18ef254a21f4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:08:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5ff75c84-ea14-440f-ac28-0d75513501c9 req-2bbc476e-4bbb-486a-a4df-d074fc7288d0 service nova] Acquiring lock "0a89aa93-374f-4487-893b-58c15d42c84c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:08:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5ff75c84-ea14-440f-ac28-0d75513501c9 req-2bbc476e-4bbb-486a-a4df-d074fc7288d0 service nova] Lock "0a89aa93-374f-4487-893b-58c15d42c84c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:08:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5ff75c84-ea14-440f-ac28-0d75513501c9 req-2bbc476e-4bbb-486a-a4df-d074fc7288d0 service nova] Lock "0a89aa93-374f-4487-893b-58c15d42c84c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:08:09 user nova-compute[72239]: DEBUG nova.compute.manager [req-5ff75c84-ea14-440f-ac28-0d75513501c9 req-2bbc476e-4bbb-486a-a4df-d074fc7288d0 service nova] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] No waiting events found dispatching network-vif-unplugged-73d584f4-4986-4f0c-8483-18ef254a21f4 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:08:09 user nova-compute[72239]: DEBUG nova.compute.manager [req-5ff75c84-ea14-440f-ac28-0d75513501c9 req-2bbc476e-4bbb-486a-a4df-d074fc7288d0 service nova] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Received event network-vif-unplugged-73d584f4-4986-4f0c-8483-18ef254a21f4 for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 15:08:09 user nova-compute[72239]: DEBUG nova.network.neutron [req-f5082bd3-c659-4dc7-a52d-407fc45c3a84 req-f124357b-e836-4b43-ba05-7cbfd8ec7d80 service nova] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Updated VIF entry in instance network info cache for port 73d584f4-4986-4f0c-8483-18ef254a21f4. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:08:09 user nova-compute[72239]: DEBUG nova.network.neutron [req-f5082bd3-c659-4dc7-a52d-407fc45c3a84 req-f124357b-e836-4b43-ba05-7cbfd8ec7d80 service nova] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Updating instance_info_cache with network_info: [{"id": "73d584f4-4986-4f0c-8483-18ef254a21f4", "address": "fa:16:3e:22:aa:8c", "network": {"id": "39af8721-7023-4cb5-9e06-293f319d5d93", "bridge": "br-int", "label": "tempest-TestStampPattern-549999556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228abbe80ac416fbcc6013767ca9384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73d584f4-49", "ovs_interfaceid": "73d584f4-4986-4f0c-8483-18ef254a21f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:08:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-f5082bd3-c659-4dc7-a52d-407fc45c3a84 req-f124357b-e836-4b43-ba05-7cbfd8ec7d80 service nova] Releasing lock "refresh_cache-0a89aa93-374f-4487-893b-58c15d42c84c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:08:09 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Instance destroyed successfully.
Jul 31 15:08:09 user nova-compute[72239]: DEBUG nova.objects.instance [None req-2752e7de-36d5-486b-8b07-52db5aa31873 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lazy-loading 'resources' on Instance uuid 0a89aa93-374f-4487-893b-58c15d42c84c {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:08:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-2752e7de-36d5-486b-8b07-52db5aa31873 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:01:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1115374225',display_name='tempest-TestStampPattern-server-1115374225',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1115374225',id=35,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtzUkuhD+wwUbFtr7G/xwzzWTycEUmu5aFIujMoqcCgETcqAHEigBAjoG6HJEMVeMKVtot/DjyoIAoKu2HGxjf4jAREiiEvxQvonoCgtEXCLIHvDszAezjEtchB2nDfpg==',key_name='tempest-TestStampPattern-1537860596',keypairs=<?>,launch_index=0,launched_at=2023-07-31T15:01:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4228abbe80ac416fbcc6013767ca9384',ramdisk_id='',reservation_id='r-mk53kv0t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1615288352',owner_user_name='tempest-TestStampPattern-1615288352-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T15:04:09Z,user_data=None,user_id='fc15f7d4660746f59b6a8fb70f729521',uuid=0a89aa93-374f-4487-893b-58c15d42c84c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73d584f4-4986-4f0c-8483-18ef254a21f4", "address": "fa:16:3e:22:aa:8c", "network": {"id": "39af8721-7023-4cb5-9e06-293f319d5d93", "bridge": "br-int", "label": "tempest-TestStampPattern-549999556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228abbe80ac416fbcc6013767ca9384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73d584f4-49", "ovs_interfaceid": "73d584f4-4986-4f0c-8483-18ef254a21f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 15:08:09 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-2752e7de-36d5-486b-8b07-52db5aa31873 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Converting VIF {"id": "73d584f4-4986-4f0c-8483-18ef254a21f4", "address": "fa:16:3e:22:aa:8c", "network": {"id": "39af8721-7023-4cb5-9e06-293f319d5d93", "bridge": "br-int", "label": "tempest-TestStampPattern-549999556-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4228abbe80ac416fbcc6013767ca9384", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73d584f4-49", "ovs_interfaceid": "73d584f4-4986-4f0c-8483-18ef254a21f4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:08:09 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-2752e7de-36d5-486b-8b07-52db5aa31873 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:aa:8c,bridge_name='br-int',has_traffic_filtering=True,id=73d584f4-4986-4f0c-8483-18ef254a21f4,network=Network(39af8721-7023-4cb5-9e06-293f319d5d93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73d584f4-49') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:08:09 user nova-compute[72239]: DEBUG os_vif [None req-2752e7de-36d5-486b-8b07-52db5aa31873 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:aa:8c,bridge_name='br-int',has_traffic_filtering=True,id=73d584f4-4986-4f0c-8483-18ef254a21f4,network=Network(39af8721-7023-4cb5-9e06-293f319d5d93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73d584f4-49') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 15:08:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73d584f4-49, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:08:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:09 user nova-compute[72239]: INFO os_vif [None req-2752e7de-36d5-486b-8b07-52db5aa31873 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:aa:8c,bridge_name='br-int',has_traffic_filtering=True,id=73d584f4-4986-4f0c-8483-18ef254a21f4,network=Network(39af8721-7023-4cb5-9e06-293f319d5d93),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73d584f4-49')
Jul 31 15:08:09 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-2752e7de-36d5-486b-8b07-52db5aa31873 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Deleting instance files /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c_del
Jul 31 15:08:09 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-2752e7de-36d5-486b-8b07-52db5aa31873 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Deletion of /opt/stack/data/nova/instances/0a89aa93-374f-4487-893b-58c15d42c84c_del complete
Jul 31 15:08:09 user nova-compute[72239]: INFO nova.compute.manager [None req-2752e7de-36d5-486b-8b07-52db5aa31873 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Took 0.95 seconds to destroy the instance on the hypervisor.
Jul 31 15:08:09 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-2752e7de-36d5-486b-8b07-52db5aa31873 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 15:08:09 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 15:08:09 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 15:08:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 15:08:09 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kizCUBAL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:08:09 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:08:09 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:08:09 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:08:09 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:08:09 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:08:09 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:08:09 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 15:08:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:08:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:08:09 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[46cdedc0-a74d-4419-9168-3a2b2a826882]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:08:09 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 15:08:09 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:08:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:08:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:08:09 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc54fb67-ed1c-46ce-b70f-296b1dc89920]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:08:09 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a] added
Jul 31 15:08:09 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7128fef-0685-4acf-b690-516aa48d5292]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a172d1d5-fc3d-470c-a058-1aca51fb2bfa]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kizCUBAL {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kizCUBAL" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3653519-b285-46ca-ac65-8ad1f4d18218]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kizCUBAL'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51b1a26-08ff-44a3-acb7-a3db852e9ea6]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d63187-3f04-4a6f-b138-128b529397d9]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 (non-flash)
Jul 31 15:08:10 user nova-compute[72239]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220 (non-flash)
Jul 31 15:08:10 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 (non-flash)
Jul 31 15:08:10 user nova-compute[72239]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220 (non-flash)
Jul 31 15:08:10 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e2691a-c824-4e85-8daf-7300613f1a13]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a, portal: 172.16.0.220,3260]
Jul 31 15:08:10 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a, portal: 172.16.0.220,3260] successful.
Jul 31 15:08:10 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[67fb9871-7cb5-4c89-afd9-c96542d703bf]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[38889a39-ef20-45b0-adb8-2bbdacf14a2b]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 (non-flash)
Jul 31 15:08:10 user nova-compute[72239]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220 (non-flash)
Jul 31 15:08:10 user nova-compute[72239]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a (non-flash)
Jul 31 15:08:10 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 (non-flash)
Jul 31 15:08:10 user nova-compute[72239]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220 (non-flash)
Jul 31 15:08:10 user nova-compute[72239]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a (non-flash)
Jul 31 15:08:10 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] HCTL ('35', '-', '-', 0) found on session 49 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23b43da-933b-41c4-9131-7945852fd637]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Searching for a device in session 49 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kizCUBAL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:08:10 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Took 0.71 seconds to deallocate network for instance.
Jul 31 15:08:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2752e7de-36d5-486b-8b07-52db5aa31873 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2752e7de-36d5-486b-8b07-52db5aa31873 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-2752e7de-36d5-486b-8b07-52db5aa31873 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-2752e7de-36d5-486b-8b07-52db5aa31873 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:08:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2752e7de-36d5-486b-8b07-52db5aa31873 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.214s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:08:10 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-2752e7de-36d5-486b-8b07-52db5aa31873 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Deleted allocations for instance 0a89aa93-374f-4487-893b-58c15d42c84c
Jul 31 15:08:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-2752e7de-36d5-486b-8b07-52db5aa31873 tempest-TestStampPattern-1615288352 tempest-TestStampPattern-1615288352-project-member] Lock "0a89aa93-374f-4487-893b-58c15d42c84c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.139s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:08:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:08:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '26233393930656537', 'path': '/dev/sdd'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:08:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26233393930656537', 'path': '/dev/sdd'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 15:08:11 user nova-compute[72239]: DEBUG nova.objects.instance [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lazy-loading 'flavor' on Instance uuid 9ba7bc46-392d-4fd7-a85e-84b728d34d2e {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:08:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 15:08:11 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:08:11 user nova-compute[72239]:   <source dev="/dev/sdd"/>
Jul 31 15:08:11 user nova-compute[72239]:   <target dev="vdc" bus="virtio"/>
Jul 31 15:08:11 user nova-compute[72239]:   <serial>8bcbfc98-610f-415f-b06a-a91b5c21539a</serial>
Jul 31 15:08:11 user nova-compute[72239]: </disk>
Jul 31 15:08:11 user nova-compute[72239]:  {{(pid=72239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 15:08:11 user nova-compute[72239]: DEBUG nova.compute.manager [req-828a93ea-2f1f-48f8-baf5-7eeae1c30ebe req-e7507647-95ce-412a-9939-f0a875099ac2 service nova] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Received event network-vif-plugged-73d584f4-4986-4f0c-8483-18ef254a21f4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:08:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-828a93ea-2f1f-48f8-baf5-7eeae1c30ebe req-e7507647-95ce-412a-9939-f0a875099ac2 service nova] Acquiring lock "0a89aa93-374f-4487-893b-58c15d42c84c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:08:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-828a93ea-2f1f-48f8-baf5-7eeae1c30ebe req-e7507647-95ce-412a-9939-f0a875099ac2 service nova] Lock "0a89aa93-374f-4487-893b-58c15d42c84c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:08:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-828a93ea-2f1f-48f8-baf5-7eeae1c30ebe req-e7507647-95ce-412a-9939-f0a875099ac2 service nova] Lock "0a89aa93-374f-4487-893b-58c15d42c84c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:08:11 user nova-compute[72239]: DEBUG nova.compute.manager [req-828a93ea-2f1f-48f8-baf5-7eeae1c30ebe req-e7507647-95ce-412a-9939-f0a875099ac2 service nova] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] No waiting events found dispatching network-vif-plugged-73d584f4-4986-4f0c-8483-18ef254a21f4 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:08:11 user nova-compute[72239]: WARNING nova.compute.manager [req-828a93ea-2f1f-48f8-baf5-7eeae1c30ebe req-e7507647-95ce-412a-9939-f0a875099ac2 service nova] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Received unexpected event network-vif-plugged-73d584f4-4986-4f0c-8483-18ef254a21f4 for instance with vm_state deleted and task_state None.
Jul 31 15:08:11 user nova-compute[72239]: DEBUG nova.compute.manager [req-828a93ea-2f1f-48f8-baf5-7eeae1c30ebe req-e7507647-95ce-412a-9939-f0a875099ac2 service nova] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Received event network-vif-deleted-73d584f4-4986-4f0c-8483-18ef254a21f4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:08:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:08:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:08:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] No BDM found with device name vdc, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:08:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] No VIF found with MAC fa:16:3e:16:9d:79, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 15:08:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c9ee522e-1260-4926-a141-90d87999befa tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lock "9ba7bc46-392d-4fd7-a85e-84b728d34d2e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.274s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:08:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquiring lock "bf7b3a30-776f-406b-9e38-db804c098e93" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:08:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "bf7b3a30-776f-406b-9e38-db804c098e93" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:08:12 user nova-compute[72239]: DEBUG nova.compute.manager [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 15:08:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:08:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:08:12 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 15:08:12 user nova-compute[72239]: INFO nova.compute.claims [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Claim successful on node user
Jul 31 15:08:12 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:08:12 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:08:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.274s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:08:12 user nova-compute[72239]: DEBUG nova.compute.manager [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 15:08:12 user nova-compute[72239]: DEBUG nova.compute.manager [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 15:08:12 user nova-compute[72239]: DEBUG nova.network.neutron [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 15:08:12 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 15:08:12 user nova-compute[72239]: DEBUG nova.compute.manager [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 15:08:12 user nova-compute[72239]: DEBUG nova.policy [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd0a629efb75a463892b841e95f6d4acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f37ae523240a47bb936ef4b54994de61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 15:08:13 user nova-compute[72239]: DEBUG nova.compute.manager [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 15:08:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 15:08:13 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Creating image(s)
Jul 31 15:08:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquiring lock "/opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:08:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "/opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:08:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "/opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:08:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquiring lock "922ad16347e90ac9c087c8b5980cdced0efb6fd0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:08:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "922ad16347e90ac9c087c8b5980cdced0efb6fd0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:08:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-350ca557-ab23-4451-a07c-36a3d3109536 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Acquiring lock "9ba7bc46-392d-4fd7-a85e-84b728d34d2e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:08:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-350ca557-ab23-4451-a07c-36a3d3109536 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lock "9ba7bc46-392d-4fd7-a85e-84b728d34d2e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:08:13 user nova-compute[72239]: INFO nova.compute.manager [None req-350ca557-ab23-4451-a07c-36a3d3109536 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Detaching volume 8bcbfc98-610f-415f-b06a-a91b5c21539a
Jul 31 15:08:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/922ad16347e90ac9c087c8b5980cdced0efb6fd0.part --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:08:13 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:08:13 user nova-compute[72239]: INFO nova.virt.block_device [None req-350ca557-ab23-4451-a07c-36a3d3109536 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Attempting to driver detach volume 8bcbfc98-610f-415f-b06a-a91b5c21539a from mountpoint /dev/vdc
Jul 31 15:08:13 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:08:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-350ca557-ab23-4451-a07c-36a3d3109536 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Attempting to detach device vdc from instance 9ba7bc46-392d-4fd7-a85e-84b728d34d2e from the persistent domain config. {{(pid=72239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 15:08:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-350ca557-ab23-4451-a07c-36a3d3109536 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 15:08:13 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:08:13 user nova-compute[72239]:   <source dev="/dev/sdd"/>
Jul 31 15:08:13 user nova-compute[72239]:   <target dev="vdc" bus="virtio"/>
Jul 31 15:08:13 user nova-compute[72239]:   <serial>8bcbfc98-610f-415f-b06a-a91b5c21539a</serial>
Jul 31 15:08:13 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 31 15:08:13 user nova-compute[72239]: </disk>
Jul 31 15:08:13 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 15:08:13 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-350ca557-ab23-4451-a07c-36a3d3109536 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Successfully detached device vdc from instance 9ba7bc46-392d-4fd7-a85e-84b728d34d2e from the persistent domain config.
Jul 31 15:08:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-350ca557-ab23-4451-a07c-36a3d3109536 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 9ba7bc46-392d-4fd7-a85e-84b728d34d2e from the live domain config. {{(pid=72239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 15:08:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-350ca557-ab23-4451-a07c-36a3d3109536 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 15:08:13 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:08:13 user nova-compute[72239]:   <source dev="/dev/sdd"/>
Jul 31 15:08:13 user nova-compute[72239]:   <target dev="vdc" bus="virtio"/>
Jul 31 15:08:13 user nova-compute[72239]:   <serial>8bcbfc98-610f-415f-b06a-a91b5c21539a</serial>
Jul 31 15:08:13 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 31 15:08:13 user nova-compute[72239]: </disk>
Jul 31 15:08:13 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 15:08:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/922ad16347e90ac9c087c8b5980cdced0efb6fd0.part --force-share --output=json" returned: 0 in 0.178s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:08:13 user nova-compute[72239]: DEBUG nova.virt.images [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] 307af25b-1f52-4706-b31a-436ccc6613aa was qcow2, converting to raw {{(pid=72239) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 31 15:08:13 user nova-compute[72239]: DEBUG nova.privsep.utils [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72239) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 15:08:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/922ad16347e90ac9c087c8b5980cdced0efb6fd0.part /opt/stack/data/nova/instances/_base/922ad16347e90ac9c087c8b5980cdced0efb6fd0.converted {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:08:13 user nova-compute[72239]: DEBUG nova.network.neutron [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Successfully created port: 0fcc6557-b09c-4149-8458-ac4f1bf6ffcf {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Received event <DeviceRemovedEvent: 1690816094.1448498, 9ba7bc46-392d-4fd7-a85e-84b728d34d2e => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=72239) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-350ca557-ab23-4451-a07c-36a3d3109536 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 9ba7bc46-392d-4fd7-a85e-84b728d34d2e {{(pid=72239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 15:08:14 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-350ca557-ab23-4451-a07c-36a3d3109536 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Successfully detached device vdc from instance 9ba7bc46-392d-4fd7-a85e-84b728d34d2e from the live domain config.
Jul 31 15:08:14 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-350ca557-ab23-4451-a07c-36a3d3109536 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-350ca557-ab23-4451-a07c-36a3d3109536 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kizCUBAL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:08:14 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-350ca557-ab23-4451-a07c-36a3d3109536 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:08:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-350ca557-ab23-4451-a07c-36a3d3109536 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-350ca557-ab23-4451-a07c-36a3d3109536 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-350ca557-ab23-4451-a07c-36a3d3109536 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b181624-adfd-4fc7-8cae-ac86d8826bc7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/922ad16347e90ac9c087c8b5980cdced0efb6fd0.part /opt/stack/data/nova/instances/_base/922ad16347e90ac9c087c8b5980cdced0efb6fd0.converted" returned: 0 in 0.484s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/922ad16347e90ac9c087c8b5980cdced0efb6fd0.converted --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84812cb-5b07-43eb-b612-85a2bdb3bc6c]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-350ca557-ab23-4451-a07c-36a3d3109536 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 (non-flash)
Jul 31 15:08:14 user nova-compute[72239]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220 (non-flash)
Jul 31 15:08:14 user nova-compute[72239]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a (non-flash)
Jul 31 15:08:14 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-350ca557-ab23-4451-a07c-36a3d3109536 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 (non-flash)
Jul 31 15:08:14 user nova-compute[72239]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220 (non-flash)
Jul 31 15:08:14 user nova-compute[72239]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a (non-flash)
Jul 31 15:08:14 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-350ca557-ab23-4451-a07c-36a3d3109536 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41241c8040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a'): ({'sdd'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-350ca557-ab23-4451-a07c-36a3d3109536 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Removing single pathed devices sdd {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[52fef054-600b-4117-8f5c-78e66ea1dab3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f79dac-454c-4bae-88d1-1defd598af1c]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-350ca557-ab23-4451-a07c-36a3d3109536 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Flushing IO for device /dev/sdd {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04ed648-2570-40aa-8a80-3e5f515cb0a4]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-350ca557-ab23-4451-a07c-36a3d3109536 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e4e790-3f52-4050-ae36-0655dcd72941]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-350ca557-ab23-4451-a07c-36a3d3109536 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-350ca557-ab23-4451-a07c-36a3d3109536 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] SCSI volumes sdd have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-350ca557-ab23-4451-a07c-36a3d3109536 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/922ad16347e90ac9c087c8b5980cdced0efb6fd0.converted --force-share --output=json" returned: 0 in 0.164s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "922ad16347e90ac9c087c8b5980cdced0efb6fd0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.330s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/922ad16347e90ac9c087c8b5980cdced0efb6fd0 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf25fcd-b39b-4c37-9866-4eaeed41c41f]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-350ca557-ab23-4451-a07c-36a3d3109536 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5bdef1-45ff-4516-a8be-1ebfd9687a6d]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-350ca557-ab23-4451-a07c-36a3d3109536 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a, portal: 172.16.0.220,3260]
Jul 31 15:08:14 user nova-compute[72239]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a, portal: 172.16.0.220,3260] successful.
Jul 31 15:08:14 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8bcbfc98-610f-415f-b06a-a91b5c21539a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6398cb63-b33b-4ff8-be86-dc81bf7d2c9e]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-350ca557-ab23-4451-a07c-36a3d3109536 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-350ca557-ab23-4451-a07c-36a3d3109536 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-350ca557-ab23-4451-a07c-36a3d3109536 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] <== disconnect_volume: return (357ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-350ca557-ab23-4451-a07c-36a3d3109536 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/922ad16347e90ac9c087c8b5980cdced0efb6fd0 --force-share --output=json" returned: 0 in 0.154s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquiring lock "922ad16347e90ac9c087c8b5980cdced0efb6fd0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "922ad16347e90ac9c087c8b5980cdced0efb6fd0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/922ad16347e90ac9c087c8b5980cdced0efb6fd0 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/922ad16347e90ac9c087c8b5980cdced0efb6fd0 --force-share --output=json" returned: 0 in 0.140s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/922ad16347e90ac9c087c8b5980cdced0efb6fd0,backing_fmt=raw /opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG nova.network.neutron [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Successfully updated port: 0fcc6557-b09c-4149-8458-ac4f1bf6ffcf {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/922ad16347e90ac9c087c8b5980cdced0efb6fd0,backing_fmt=raw /opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/disk 1073741824" returned: 0 in 0.063s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "922ad16347e90ac9c087c8b5980cdced0efb6fd0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.207s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/922ad16347e90ac9c087c8b5980cdced0efb6fd0 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG nova.compute.manager [req-008e4782-0c95-4808-b218-5c18a20b9b27 req-b514bb58-26d4-4424-8e8c-7358a235ff5f service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Received event network-changed-0fcc6557-b09c-4149-8458-ac4f1bf6ffcf {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG nova.compute.manager [req-008e4782-0c95-4808-b218-5c18a20b9b27 req-b514bb58-26d4-4424-8e8c-7358a235ff5f service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Refreshing instance network info cache due to event network-changed-0fcc6557-b09c-4149-8458-ac4f1bf6ffcf. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-008e4782-0c95-4808-b218-5c18a20b9b27 req-b514bb58-26d4-4424-8e8c-7358a235ff5f service nova] Acquiring lock "refresh_cache-bf7b3a30-776f-406b-9e38-db804c098e93" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-008e4782-0c95-4808-b218-5c18a20b9b27 req-b514bb58-26d4-4424-8e8c-7358a235ff5f service nova] Acquired lock "refresh_cache-bf7b3a30-776f-406b-9e38-db804c098e93" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG nova.network.neutron [req-008e4782-0c95-4808-b218-5c18a20b9b27 req-b514bb58-26d4-4424-8e8c-7358a235ff5f service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Refreshing network info cache for port 0fcc6557-b09c-4149-8458-ac4f1bf6ffcf {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquiring lock "refresh_cache-bf7b3a30-776f-406b-9e38-db804c098e93" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG nova.network.neutron [req-008e4782-0c95-4808-b218-5c18a20b9b27 req-b514bb58-26d4-4424-8e8c-7358a235ff5f service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/922ad16347e90ac9c087c8b5980cdced0efb6fd0 --force-share --output=json" returned: 0 in 0.153s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:08:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Cannot resize image /opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG nova.objects.instance [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lazy-loading 'migration_context' on Instance uuid bf7b3a30-776f-406b-9e38-db804c098e93 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Ensure instance console log exists: /opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG nova.network.neutron [req-008e4782-0c95-4808-b218-5c18a20b9b27 req-b514bb58-26d4-4424-8e8c-7358a235ff5f service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-008e4782-0c95-4808-b218-5c18a20b9b27 req-b514bb58-26d4-4424-8e8c-7358a235ff5f service nova] Releasing lock "refresh_cache-bf7b3a30-776f-406b-9e38-db804c098e93" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquired lock "refresh_cache-bf7b3a30-776f-406b-9e38-db804c098e93" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG nova.network.neutron [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG nova.network.neutron [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG nova.objects.instance [None req-350ca557-ab23-4451-a07c-36a3d3109536 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lazy-loading 'flavor' on Instance uuid 9ba7bc46-392d-4fd7-a85e-84b728d34d2e {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-350ca557-ab23-4451-a07c-36a3d3109536 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lock "9ba7bc46-392d-4fd7-a85e-84b728d34d2e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.351s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG nova.network.neutron [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Updating instance_info_cache with network_info: [{"id": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "address": "fa:16:3e:a7:1b:0c", "network": {"id": "b9eb37b6-27e4-4d9e-bfb2-7e167766e547", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1162541993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37ae523240a47bb936ef4b54994de61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fcc6557-b0", "ovs_interfaceid": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Releasing lock "refresh_cache-bf7b3a30-776f-406b-9e38-db804c098e93" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG nova.compute.manager [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Instance network_info: |[{"id": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "address": "fa:16:3e:a7:1b:0c", "network": {"id": "b9eb37b6-27e4-4d9e-bfb2-7e167766e547", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1162541993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37ae523240a47bb936ef4b54994de61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fcc6557-b0", "ovs_interfaceid": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Start _get_guest_xml network_info=[{"id": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "address": "fa:16:3e:a7:1b:0c", "network": {"id": "b9eb37b6-27e4-4d9e-bfb2-7e167766e547", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1162541993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37ae523240a47bb936ef4b54994de61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fcc6557-b0", "ovs_interfaceid": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T15:08:09Z,direct_url=<?>,disk_format='qcow2',id=307af25b-1f52-4706-b31a-436ccc6613aa,min_disk=0,min_ram=0,name='tempest-scenario-img--1321070476',owner='f37ae523240a47bb936ef4b54994de61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T15:08:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '307af25b-1f52-4706-b31a-436ccc6613aa'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 15:08:15 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:08:15 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:08:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T15:08:09Z,direct_url=<?>,disk_format='qcow2',id=307af25b-1f52-4706-b31a-436ccc6613aa,min_disk=0,min_ram=0,name='tempest-scenario-img--1321070476',owner='f37ae523240a47bb936ef4b54994de61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T15:08:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:08:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1333595426',display_name='tempest-TestMinimumBasicScenario-server-1333595426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1333595426',id=44,image_ref='307af25b-1f52-4706-b31a-436ccc6613aa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2hXK+hMzIEO9mGtRj+Z4xkohPHcKxHoldVex8CDLHt4D6siIXOeWXD4ztrVYXKX/MNsxUzGh1XBckhFsDBgK6c8NC757TbUJBfOZYlgBPzRKUhs1zaTP6bKGWi3eIeLw==',key_name='tempest-TestMinimumBasicScenario-895895609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f37ae523240a47bb936ef4b54994de61',ramdisk_id='',reservation_id='r-otnsvvx6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='307af25b-1f52-4706-b31a-436ccc6613aa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-429761002',owner_user_name='tempest-TestMinimumBasicScenario-429761002-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T15:08:13Z,user_data=None,user_id='d0a629efb75a463892b841e95f6d4acf',uuid=bf7b3a30-776f-406b-9e38-db804c098e93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "address": "fa:16:3e:a7:1b:0c", "network": {"id": "b9eb37b6-27e4-4d9e-bfb2-7e167766e547", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1162541993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37ae523240a47bb936ef4b54994de61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fcc6557-b0", "ovs_interfaceid": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Converting VIF {"id": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "address": "fa:16:3e:a7:1b:0c", "network": {"id": "b9eb37b6-27e4-4d9e-bfb2-7e167766e547", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1162541993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37ae523240a47bb936ef4b54994de61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fcc6557-b0", "ovs_interfaceid": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:1b:0c,bridge_name='br-int',has_traffic_filtering=True,id=0fcc6557-b09c-4149-8458-ac4f1bf6ffcf,network=Network(b9eb37b6-27e4-4d9e-bfb2-7e167766e547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fcc6557-b0') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG nova.objects.instance [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lazy-loading 'pci_devices' on Instance uuid bf7b3a30-776f-406b-9e38-db804c098e93 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] End _get_guest_xml xml=<domain type="kvm">
Jul 31 15:08:15 user nova-compute[72239]:   <uuid>bf7b3a30-776f-406b-9e38-db804c098e93</uuid>
Jul 31 15:08:15 user nova-compute[72239]:   <name>instance-0000002c</name>
Jul 31 15:08:15 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 15:08:15 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 15:08:15 user nova-compute[72239]:   <metadata>
Jul 31 15:08:15 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 15:08:15 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 15:08:15 user nova-compute[72239]:       <nova:name>tempest-TestMinimumBasicScenario-server-1333595426</nova:name>
Jul 31 15:08:15 user nova-compute[72239]:       <nova:creationTime>2023-07-31 15:08:15</nova:creationTime>
Jul 31 15:08:15 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 15:08:15 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 15:08:15 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 15:08:15 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 15:08:15 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 15:08:15 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 15:08:15 user nova-compute[72239]:       </nova:flavor>
Jul 31 15:08:15 user nova-compute[72239]:       <nova:owner>
Jul 31 15:08:15 user nova-compute[72239]:         <nova:user uuid="d0a629efb75a463892b841e95f6d4acf">tempest-TestMinimumBasicScenario-429761002-project-member</nova:user>
Jul 31 15:08:15 user nova-compute[72239]:         <nova:project uuid="f37ae523240a47bb936ef4b54994de61">tempest-TestMinimumBasicScenario-429761002</nova:project>
Jul 31 15:08:15 user nova-compute[72239]:       </nova:owner>
Jul 31 15:08:15 user nova-compute[72239]:       <nova:root type="image" uuid="307af25b-1f52-4706-b31a-436ccc6613aa"/>
Jul 31 15:08:15 user nova-compute[72239]:       <nova:ports>
Jul 31 15:08:15 user nova-compute[72239]:         <nova:port uuid="0fcc6557-b09c-4149-8458-ac4f1bf6ffcf">
Jul 31 15:08:15 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 31 15:08:15 user nova-compute[72239]:         </nova:port>
Jul 31 15:08:15 user nova-compute[72239]:       </nova:ports>
Jul 31 15:08:15 user nova-compute[72239]:     </nova:instance>
Jul 31 15:08:15 user nova-compute[72239]:   </metadata>
Jul 31 15:08:15 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 15:08:15 user nova-compute[72239]:     <system>
Jul 31 15:08:15 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 15:08:15 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 15:08:15 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 15:08:15 user nova-compute[72239]:       <entry name="serial">bf7b3a30-776f-406b-9e38-db804c098e93</entry>
Jul 31 15:08:15 user nova-compute[72239]:       <entry name="uuid">bf7b3a30-776f-406b-9e38-db804c098e93</entry>
Jul 31 15:08:15 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 15:08:15 user nova-compute[72239]:     </system>
Jul 31 15:08:15 user nova-compute[72239]:   </sysinfo>
Jul 31 15:08:15 user nova-compute[72239]:   <os>
Jul 31 15:08:15 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 15:08:15 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 15:08:15 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 15:08:15 user nova-compute[72239]:   </os>
Jul 31 15:08:15 user nova-compute[72239]:   <features>
Jul 31 15:08:15 user nova-compute[72239]:     <acpi/>
Jul 31 15:08:15 user nova-compute[72239]:     <apic/>
Jul 31 15:08:15 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 15:08:15 user nova-compute[72239]:   </features>
Jul 31 15:08:15 user nova-compute[72239]:   <clock offset="utc">
Jul 31 15:08:15 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 15:08:15 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 15:08:15 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 15:08:15 user nova-compute[72239]:   </clock>
Jul 31 15:08:15 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 15:08:15 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 15:08:15 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 15:08:15 user nova-compute[72239]:   </cpu>
Jul 31 15:08:15 user nova-compute[72239]:   <devices>
Jul 31 15:08:15 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 15:08:15 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 15:08:15 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/disk"/>
Jul 31 15:08:15 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 15:08:15 user nova-compute[72239]:     </disk>
Jul 31 15:08:15 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 15:08:15 user nova-compute[72239]:       <mac address="fa:16:3e:a7:1b:0c"/>
Jul 31 15:08:15 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:08:15 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 15:08:15 user nova-compute[72239]:       <target dev="tap0fcc6557-b0"/>
Jul 31 15:08:15 user nova-compute[72239]:     </interface>
Jul 31 15:08:15 user nova-compute[72239]:     <serial type="pty">
Jul 31 15:08:15 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/console.log" append="off"/>
Jul 31 15:08:15 user nova-compute[72239]:     </serial>
Jul 31 15:08:15 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 15:08:15 user nova-compute[72239]:     <video>
Jul 31 15:08:15 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:08:15 user nova-compute[72239]:     </video>
Jul 31 15:08:15 user nova-compute[72239]:     <rng model="virtio">
Jul 31 15:08:15 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 15:08:15 user nova-compute[72239]:     </rng>
Jul 31 15:08:15 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 15:08:15 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 15:08:15 user nova-compute[72239]:       <stats period="10"/>
Jul 31 15:08:15 user nova-compute[72239]:     </memballoon>
Jul 31 15:08:15 user nova-compute[72239]:   </devices>
Jul 31 15:08:15 user nova-compute[72239]: </domain>
Jul 31 15:08:15 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:08:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1333595426',display_name='tempest-TestMinimumBasicScenario-server-1333595426',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1333595426',id=44,image_ref='307af25b-1f52-4706-b31a-436ccc6613aa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2hXK+hMzIEO9mGtRj+Z4xkohPHcKxHoldVex8CDLHt4D6siIXOeWXD4ztrVYXKX/MNsxUzGh1XBckhFsDBgK6c8NC757TbUJBfOZYlgBPzRKUhs1zaTP6bKGWi3eIeLw==',key_name='tempest-TestMinimumBasicScenario-895895609',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f37ae523240a47bb936ef4b54994de61',ramdisk_id='',reservation_id='r-otnsvvx6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='307af25b-1f52-4706-b31a-436ccc6613aa',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-429761002',owner_user_name='tempest-TestMinimumBasicScenario-429761002-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T15:08:13Z,user_data=None,user_id='d0a629efb75a463892b841e95f6d4acf',uuid=bf7b3a30-776f-406b-9e38-db804c098e93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "address": "fa:16:3e:a7:1b:0c", "network": {"id": "b9eb37b6-27e4-4d9e-bfb2-7e167766e547", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1162541993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37ae523240a47bb936ef4b54994de61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fcc6557-b0", "ovs_interfaceid": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Converting VIF {"id": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "address": "fa:16:3e:a7:1b:0c", "network": {"id": "b9eb37b6-27e4-4d9e-bfb2-7e167766e547", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1162541993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37ae523240a47bb936ef4b54994de61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fcc6557-b0", "ovs_interfaceid": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:1b:0c,bridge_name='br-int',has_traffic_filtering=True,id=0fcc6557-b09c-4149-8458-ac4f1bf6ffcf,network=Network(b9eb37b6-27e4-4d9e-bfb2-7e167766e547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fcc6557-b0') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG os_vif [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:1b:0c,bridge_name='br-int',has_traffic_filtering=True,id=0fcc6557-b09c-4149-8458-ac4f1bf6ffcf,network=Network(b9eb37b6-27e4-4d9e-bfb2-7e167766e547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fcc6557-b0') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0fcc6557-b0, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0fcc6557-b0, col_values=(('external_ids', {'iface-id': '0fcc6557-b09c-4149-8458-ac4f1bf6ffcf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:1b:0c', 'vm-uuid': 'bf7b3a30-776f-406b-9e38-db804c098e93'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:15 user nova-compute[72239]: INFO os_vif [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:1b:0c,bridge_name='br-int',has_traffic_filtering=True,id=0fcc6557-b09c-4149-8458-ac4f1bf6ffcf,network=Network(b9eb37b6-27e4-4d9e-bfb2-7e167766e547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fcc6557-b0')
Jul 31 15:08:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:08:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] No VIF found with MAC fa:16:3e:a7:1b:0c, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 15:08:16 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:08:16 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 15:08:16 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Rebuilding the list of instances to heal {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 15:08:16 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Skipping network cache update for instance because it is Building. {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Jul 31 15:08:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-f98cea94-e905-47c5-bf88-5f5694934966" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:08:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-f98cea94-e905-47c5-bf88-5f5694934966" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:08:16 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 15:08:16 user nova-compute[72239]: DEBUG nova.objects.instance [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lazy-loading 'info_cache' on Instance uuid f98cea94-e905-47c5-bf88-5f5694934966 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:08:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:17 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Updating instance_info_cache with network_info: [{"id": "d9134cdf-ef4b-442f-8a86-313a3a2d5fdf", "address": "fa:16:3e:ce:31:50", "network": {"id": "afcad268-9e48-452e-ae62-cbeaf3f538dd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-791822524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f4d01080114839b14b23997a4dc1f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9134cdf-ef", "ovs_interfaceid": "d9134cdf-ef4b-442f-8a86-313a3a2d5fdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:08:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-f98cea94-e905-47c5-bf88-5f5694934966" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:08:17 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 15:08:17 user nova-compute[72239]: DEBUG nova.compute.manager [req-e0c9e314-abd5-464b-b8a9-6bf660c0fa07 req-0bf845d3-ef11-4e7b-af56-794934405ef2 service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Received event network-vif-plugged-0fcc6557-b09c-4149-8458-ac4f1bf6ffcf {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:08:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e0c9e314-abd5-464b-b8a9-6bf660c0fa07 req-0bf845d3-ef11-4e7b-af56-794934405ef2 service nova] Acquiring lock "bf7b3a30-776f-406b-9e38-db804c098e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:08:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e0c9e314-abd5-464b-b8a9-6bf660c0fa07 req-0bf845d3-ef11-4e7b-af56-794934405ef2 service nova] Lock "bf7b3a30-776f-406b-9e38-db804c098e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:08:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e0c9e314-abd5-464b-b8a9-6bf660c0fa07 req-0bf845d3-ef11-4e7b-af56-794934405ef2 service nova] Lock "bf7b3a30-776f-406b-9e38-db804c098e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:08:17 user nova-compute[72239]: DEBUG nova.compute.manager [req-e0c9e314-abd5-464b-b8a9-6bf660c0fa07 req-0bf845d3-ef11-4e7b-af56-794934405ef2 service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] No waiting events found dispatching network-vif-plugged-0fcc6557-b09c-4149-8458-ac4f1bf6ffcf {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:08:17 user nova-compute[72239]: WARNING nova.compute.manager [req-e0c9e314-abd5-464b-b8a9-6bf660c0fa07 req-0bf845d3-ef11-4e7b-af56-794934405ef2 service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Received unexpected event network-vif-plugged-0fcc6557-b09c-4149-8458-ac4f1bf6ffcf for instance with vm_state building and task_state spawning.
Jul 31 15:08:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:18 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:08:18 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:08:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-8cca4115-8ea2-4f01-bba4-84055bd6e33b req-5b4a4054-aa30-43a0-ba74-a0100d8d3b5c service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Received event network-vif-plugged-0fcc6557-b09c-4149-8458-ac4f1bf6ffcf {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:08:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-8cca4115-8ea2-4f01-bba4-84055bd6e33b req-5b4a4054-aa30-43a0-ba74-a0100d8d3b5c service nova] Acquiring lock "bf7b3a30-776f-406b-9e38-db804c098e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:08:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-8cca4115-8ea2-4f01-bba4-84055bd6e33b req-5b4a4054-aa30-43a0-ba74-a0100d8d3b5c service nova] Lock "bf7b3a30-776f-406b-9e38-db804c098e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:08:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-8cca4115-8ea2-4f01-bba4-84055bd6e33b req-5b4a4054-aa30-43a0-ba74-a0100d8d3b5c service nova] Lock "bf7b3a30-776f-406b-9e38-db804c098e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:08:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-8cca4115-8ea2-4f01-bba4-84055bd6e33b req-5b4a4054-aa30-43a0-ba74-a0100d8d3b5c service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] No waiting events found dispatching network-vif-plugged-0fcc6557-b09c-4149-8458-ac4f1bf6ffcf {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:08:19 user nova-compute[72239]: WARNING nova.compute.manager [req-8cca4115-8ea2-4f01-bba4-84055bd6e33b req-5b4a4054-aa30-43a0-ba74-a0100d8d3b5c service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Received unexpected event network-vif-plugged-0fcc6557-b09c-4149-8458-ac4f1bf6ffcf for instance with vm_state building and task_state spawning.
Jul 31 15:08:19 user nova-compute[72239]: DEBUG nova.compute.manager [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 15:08:19 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 15:08:19 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690816099.4489326, bf7b3a30-776f-406b-9e38-db804c098e93 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:08:19 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] VM Resumed (Lifecycle Event)
Jul 31 15:08:19 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Instance spawned successfully.
Jul 31 15:08:19 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 15:08:19 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:08:19 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:08:19 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:08:19 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:08:19 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:08:19 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:08:19 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:08:19 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:08:19 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 15:08:19 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690816099.4492333, bf7b3a30-776f-406b-9e38-db804c098e93 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:08:19 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] VM Started (Lifecycle Event)
Jul 31 15:08:19 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:08:19 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:08:19 user nova-compute[72239]: INFO nova.compute.manager [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Took 6.54 seconds to spawn the instance on the hypervisor.
Jul 31 15:08:19 user nova-compute[72239]: DEBUG nova.compute.manager [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:08:19 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 15:08:19 user nova-compute[72239]: INFO nova.compute.manager [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Took 7.20 seconds to build instance.
Jul 31 15:08:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-21b1ba1b-2f5b-4cc2-b307-1ef66b0b7dfd tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "bf7b3a30-776f-406b-9e38-db804c098e93" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.308s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:08:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:20 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:08:20 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:08:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:23 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:08:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:08:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:08:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:08:23 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 15:08:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 15:08:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:08:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:08:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:08:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:08:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:08:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:08:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:08:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:08:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ba7bc46-392d-4fd7-a85e-84b728d34d2e/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:08:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ba7bc46-392d-4fd7-a85e-84b728d34d2e/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:08:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ba7bc46-392d-4fd7-a85e-84b728d34d2e/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:08:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ba7bc46-392d-4fd7-a85e-84b728d34d2e/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:08:24 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 15:08:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:25 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690816089.6534097, 0a89aa93-374f-4487-893b-58c15d42c84c => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:08:25 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] VM Stopped (Lifecycle Event)
Jul 31 15:08:25 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:08:25 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:08:25 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=8196MB free_disk=25.15115737915039GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 15:08:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:08:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:08:25 user nova-compute[72239]: DEBUG nova.compute.manager [None req-86d2a42e-741b-4fe2-ba68-7446389056d6 None None] [instance: 0a89aa93-374f-4487-893b-58c15d42c84c] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:08:25 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance f98cea94-e905-47c5-bf88-5f5694934966 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:08:25 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 9ba7bc46-392d-4fd7-a85e-84b728d34d2e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:08:25 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 60a6975d-7c9a-4194-895f-4f66655b0e12 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:08:25 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance bf7b3a30-776f-406b-9e38-db804c098e93 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:08:25 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 15:08:25 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 15:08:25 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:08:25 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:08:25 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 15:08:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.301s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:08:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:27 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:08:27 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 15:08:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:30 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:38 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:40 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:08:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:00 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:00 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6ccebb61-70f3-4919-ad70-fb5f90edd877 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Acquiring lock "9ba7bc46-392d-4fd7-a85e-84b728d34d2e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:09:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6ccebb61-70f3-4919-ad70-fb5f90edd877 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lock "9ba7bc46-392d-4fd7-a85e-84b728d34d2e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:09:03 user nova-compute[72239]: INFO nova.compute.manager [None req-6ccebb61-70f3-4919-ad70-fb5f90edd877 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Detaching volume 62ea7af2-18de-4bdf-b567-1552fc153220
Jul 31 15:09:03 user nova-compute[72239]: INFO nova.virt.block_device [None req-6ccebb61-70f3-4919-ad70-fb5f90edd877 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Attempting to driver detach volume 62ea7af2-18de-4bdf-b567-1552fc153220 from mountpoint /dev/vdb
Jul 31 15:09:03 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6ccebb61-70f3-4919-ad70-fb5f90edd877 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Attempting to detach device vdb from instance 9ba7bc46-392d-4fd7-a85e-84b728d34d2e from the persistent domain config. {{(pid=72239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 15:09:03 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-6ccebb61-70f3-4919-ad70-fb5f90edd877 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 15:09:03 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:09:03 user nova-compute[72239]:   <source dev="/dev/sdc"/>
Jul 31 15:09:03 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 15:09:03 user nova-compute[72239]:   <serial>62ea7af2-18de-4bdf-b567-1552fc153220</serial>
Jul 31 15:09:03 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 15:09:03 user nova-compute[72239]: </disk>
Jul 31 15:09:03 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 15:09:03 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-6ccebb61-70f3-4919-ad70-fb5f90edd877 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Successfully detached device vdb from instance 9ba7bc46-392d-4fd7-a85e-84b728d34d2e from the persistent domain config.
Jul 31 15:09:03 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6ccebb61-70f3-4919-ad70-fb5f90edd877 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9ba7bc46-392d-4fd7-a85e-84b728d34d2e from the live domain config. {{(pid=72239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 15:09:03 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-6ccebb61-70f3-4919-ad70-fb5f90edd877 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 15:09:03 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:09:03 user nova-compute[72239]:   <source dev="/dev/sdc"/>
Jul 31 15:09:03 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 15:09:03 user nova-compute[72239]:   <serial>62ea7af2-18de-4bdf-b567-1552fc153220</serial>
Jul 31 15:09:03 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 15:09:03 user nova-compute[72239]: </disk>
Jul 31 15:09:03 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Received event <DeviceRemovedEvent: 1690816144.2168365, 9ba7bc46-392d-4fd7-a85e-84b728d34d2e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72239) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-6ccebb61-70f3-4919-ad70-fb5f90edd877 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9ba7bc46-392d-4fd7-a85e-84b728d34d2e {{(pid=72239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 15:09:04 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-6ccebb61-70f3-4919-ad70-fb5f90edd877 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Successfully detached device vdb from instance 9ba7bc46-392d-4fd7-a85e-84b728d34d2e from the live domain config.
Jul 31 15:09:04 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ccebb61-70f3-4919-ad70-fb5f90edd877 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ccebb61-70f3-4919-ad70-fb5f90edd877 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ubqRxkJm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:09:04 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-6ccebb61-70f3-4919-ad70-fb5f90edd877 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:09:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-6ccebb61-70f3-4919-ad70-fb5f90edd877 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-6ccebb61-70f3-4919-ad70-fb5f90edd877 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ccebb61-70f3-4919-ad70-fb5f90edd877 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[43036ae2-8816-4525-8c21-a8d006abda75]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9925bbc2-7dfb-44bf-a602-2f3131bebf47\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e94a8e-772c-4f1d-9662-e6a1b3ab25e2]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9925bbc2-7dfb-44bf-a602-2f3131bebf47 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ccebb61-70f3-4919-ad70-fb5f90edd877 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 (non-flash)
Jul 31 15:09:04 user nova-compute[72239]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220 (non-flash)
Jul 31 15:09:04 user nova-compute[72239]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9925bbc2-7dfb-44bf-a602-2f3131bebf47 (non-flash)
Jul 31 15:09:04 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ccebb61-70f3-4919-ad70-fb5f90edd877 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 (non-flash)
Jul 31 15:09:04 user nova-compute[72239]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220 (non-flash)
Jul 31 15:09:04 user nova-compute[72239]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9925bbc2-7dfb-44bf-a602-2f3131bebf47 (non-flash)
Jul 31 15:09:04 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ccebb61-70f3-4919-ad70-fb5f90edd877 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41007d3f40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220'): ({'sdc'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-6ccebb61-70f3-4919-ad70-fb5f90edd877 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Removing single pathed devices sdc {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a9bca7-e223-479c-806a-b148215164ce]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1dff776-23b0-470c-85e7-4f4f94894fe8]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-6ccebb61-70f3-4919-ad70-fb5f90edd877 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Flushing IO for device /dev/sdc {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6ef779-388c-4ec4-b0cf-c6140c9fc4bc]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-6ccebb61-70f3-4919-ad70-fb5f90edd877 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[92253522-5cb5-492d-8b40-93362562fe13]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-6ccebb61-70f3-4919-ad70-fb5f90edd877 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-6ccebb61-70f3-4919-ad70-fb5f90edd877 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] SCSI volumes sdc have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ccebb61-70f3-4919-ad70-fb5f90edd877 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ecb5ce-45e5-4e63-90b0-e186ee2c933d]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ccebb61-70f3-4919-ad70-fb5f90edd877 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220 -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5932b80a-e5e6-4c1b-b635-680acfa6609d]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ccebb61-70f3-4919-ad70-fb5f90edd877 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220, portal: 172.16.0.220,3260]
Jul 31 15:09:04 user nova-compute[72239]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220, portal: 172.16.0.220,3260] successful.
Jul 31 15:09:04 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220 -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62ea7af2-18de-4bdf-b567-1552fc153220 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c18f7c-8015-4d9b-9471-ee8590cdca48]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ccebb61-70f3-4919-ad70-fb5f90edd877 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-6ccebb61-70f3-4919-ad70-fb5f90edd877 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ccebb61-70f3-4919-ad70-fb5f90edd877 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] <== disconnect_volume: return (312ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ccebb61-70f3-4919-ad70-fb5f90edd877 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Acquiring lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG nova.compute.manager [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:09:04 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 15:09:04 user nova-compute[72239]: INFO nova.compute.claims [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Claim successful on node user
Jul 31 15:09:05 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:09:05 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:09:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.300s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:09:05 user nova-compute[72239]: DEBUG nova.compute.manager [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 15:09:05 user nova-compute[72239]: DEBUG nova.compute.manager [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 15:09:05 user nova-compute[72239]: DEBUG nova.network.neutron [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 15:09:05 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 15:09:05 user nova-compute[72239]: DEBUG nova.compute.manager [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 15:09:05 user nova-compute[72239]: INFO nova.virt.block_device [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Booting with volume d7d836cb-af79-406d-8b9a-eadcda156723 at /dev/vda
Jul 31 15:09:05 user nova-compute[72239]: DEBUG nova.policy [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8138394ef7f641309224d84d8789c831', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ba645b8f83ca4a15a1a6659572778375', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 15:09:05 user nova-compute[72239]: DEBUG os_brick.utils [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:09:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:09:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:09:05 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef6eefc3-19e7-4f74-bd3a-8e92f5b2e489]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:09:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:09:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:09:05 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2c2774-6b88-4810-b9d8-f1796d16b5e0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:09:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:09:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:09:05 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0c1041-fe71-498b-b700-a982ce6b1bca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:09:05 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6f52486-c88b-485e-8c60-d7309d44631f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:09:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:09:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:09:05 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 15:09:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:09:05 user nova-compute[72239]: DEBUG nova.objects.instance [None req-6ccebb61-70f3-4919-ad70-fb5f90edd877 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lazy-loading 'flavor' on Instance uuid 9ba7bc46-392d-4fd7-a85e-84b728d34d2e {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:09:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:09:05 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 15:09:05 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[96019563-17d2-4e89-afb1-4af2ae64f2bc]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:09:05 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 15:09:05 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 15:09:05 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 15:09:05 user nova-compute[72239]: DEBUG os_brick.utils [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:09:05 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Updating existing volume attachment record: 0c2a1ba7-9f3e-4278-bc76-c4dfddda56ac {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 15:09:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-6ccebb61-70f3-4919-ad70-fb5f90edd877 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lock "9ba7bc46-392d-4fd7-a85e-84b728d34d2e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.867s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:09:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:09:05 user nova-compute[72239]: DEBUG nova.network.neutron [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Successfully created port: 64213693-d706-4784-81b5-74a181309dd4 {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 15:09:06 user nova-compute[72239]: DEBUG nova.network.neutron [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Successfully updated port: 64213693-d706-4784-81b5-74a181309dd4 {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 15:09:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Acquiring lock "refresh_cache-f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:09:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Acquired lock "refresh_cache-f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:09:06 user nova-compute[72239]: DEBUG nova.network.neutron [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 15:09:06 user nova-compute[72239]: DEBUG nova.compute.manager [req-727066fd-d4e7-4833-8514-4a6b0452ad98 req-2dfbd4f8-be23-4c45-9427-20861ed7b66d service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Received event network-changed-64213693-d706-4784-81b5-74a181309dd4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:09:06 user nova-compute[72239]: DEBUG nova.compute.manager [req-727066fd-d4e7-4833-8514-4a6b0452ad98 req-2dfbd4f8-be23-4c45-9427-20861ed7b66d service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Refreshing instance network info cache due to event network-changed-64213693-d706-4784-81b5-74a181309dd4. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:09:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-727066fd-d4e7-4833-8514-4a6b0452ad98 req-2dfbd4f8-be23-4c45-9427-20861ed7b66d service nova] Acquiring lock "refresh_cache-f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:09:06 user nova-compute[72239]: DEBUG nova.network.neutron [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 15:09:07 user nova-compute[72239]: DEBUG nova.network.neutron [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Updating instance_info_cache with network_info: [{"id": "64213693-d706-4784-81b5-74a181309dd4", "address": "fa:16:3e:b2:e3:7d", "network": {"id": "cbc10aaa-d0d9-4abe-bf51-17206a8f085a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1222279697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba645b8f83ca4a15a1a6659572778375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64213693-d7", "ovs_interfaceid": "64213693-d706-4784-81b5-74a181309dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:09:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Releasing lock "refresh_cache-f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:09:07 user nova-compute[72239]: DEBUG nova.compute.manager [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Instance network_info: |[{"id": "64213693-d706-4784-81b5-74a181309dd4", "address": "fa:16:3e:b2:e3:7d", "network": {"id": "cbc10aaa-d0d9-4abe-bf51-17206a8f085a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1222279697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba645b8f83ca4a15a1a6659572778375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64213693-d7", "ovs_interfaceid": "64213693-d706-4784-81b5-74a181309dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 15:09:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-727066fd-d4e7-4833-8514-4a6b0452ad98 req-2dfbd4f8-be23-4c45-9427-20861ed7b66d service nova] Acquired lock "refresh_cache-f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:09:07 user nova-compute[72239]: DEBUG nova.network.neutron [req-727066fd-d4e7-4833-8514-4a6b0452ad98 req-2dfbd4f8-be23-4c45-9427-20861ed7b66d service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Refreshing network info cache for port 64213693-d706-4784-81b5-74a181309dd4 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:09:07 user nova-compute[72239]: DEBUG nova.network.neutron [req-727066fd-d4e7-4833-8514-4a6b0452ad98 req-2dfbd4f8-be23-4c45-9427-20861ed7b66d service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Updated VIF entry in instance network info cache for port 64213693-d706-4784-81b5-74a181309dd4. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:09:07 user nova-compute[72239]: DEBUG nova.network.neutron [req-727066fd-d4e7-4833-8514-4a6b0452ad98 req-2dfbd4f8-be23-4c45-9427-20861ed7b66d service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Updating instance_info_cache with network_info: [{"id": "64213693-d706-4784-81b5-74a181309dd4", "address": "fa:16:3e:b2:e3:7d", "network": {"id": "cbc10aaa-d0d9-4abe-bf51-17206a8f085a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1222279697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba645b8f83ca4a15a1a6659572778375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64213693-d7", "ovs_interfaceid": "64213693-d706-4784-81b5-74a181309dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:09:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-727066fd-d4e7-4833-8514-4a6b0452ad98 req-2dfbd4f8-be23-4c45-9427-20861ed7b66d service nova] Releasing lock "refresh_cache-f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:09:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "60a6975d-7c9a-4194-895f-4f66655b0e12" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "60a6975d-7c9a-4194-895f-4f66655b0e12" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "60a6975d-7c9a-4194-895f-4f66655b0e12-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "60a6975d-7c9a-4194-895f-4f66655b0e12-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "60a6975d-7c9a-4194-895f-4f66655b0e12-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:09:13 user nova-compute[72239]: INFO nova.compute.manager [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Terminating instance
Jul 31 15:09:13 user nova-compute[72239]: DEBUG nova.compute.manager [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG nova.compute.manager [req-3437aebc-5a7a-41c4-a2ed-feafef57055c req-e8c1e39f-40fa-4a1c-935a-f08314550376 service nova] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Received event network-vif-unplugged-1d212810-1a98-48a8-800d-a1ef4da2900b {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-3437aebc-5a7a-41c4-a2ed-feafef57055c req-e8c1e39f-40fa-4a1c-935a-f08314550376 service nova] Acquiring lock "60a6975d-7c9a-4194-895f-4f66655b0e12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-3437aebc-5a7a-41c4-a2ed-feafef57055c req-e8c1e39f-40fa-4a1c-935a-f08314550376 service nova] Lock "60a6975d-7c9a-4194-895f-4f66655b0e12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-3437aebc-5a7a-41c4-a2ed-feafef57055c req-e8c1e39f-40fa-4a1c-935a-f08314550376 service nova] Lock "60a6975d-7c9a-4194-895f-4f66655b0e12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG nova.compute.manager [req-3437aebc-5a7a-41c4-a2ed-feafef57055c req-e8c1e39f-40fa-4a1c-935a-f08314550376 service nova] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] No waiting events found dispatching network-vif-unplugged-1d212810-1a98-48a8-800d-a1ef4da2900b {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG nova.compute.manager [req-3437aebc-5a7a-41c4-a2ed-feafef57055c req-e8c1e39f-40fa-4a1c-935a-f08314550376 service nova] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Received event network-vif-unplugged-1d212810-1a98-48a8-800d-a1ef4da2900b for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG nova.compute.manager [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 15:09:13 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Creating image(s)
Jul 31 15:09:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Did not create local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Ensure instance console log exists: /opt/stack/data/nova/instances/f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Start _get_guest_xml network_info=[{"id": "64213693-d706-4784-81b5-74a181309dd4", "address": "fa:16:3e:b2:e3:7d", "network": {"id": "cbc10aaa-d0d9-4abe-bf51-17206a8f085a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1222279697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba645b8f83ca4a15a1a6659572778375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64213693-d7", "ovs_interfaceid": "64213693-d706-4784-81b5-74a181309dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '0c2a1ba7-9f3e-4278-bc76-c4dfddda56ac', 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'moMrhZRv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0', 'attached_at': '', 'detached_at': '', 'volume_id': 'd7d836cb-af79-406d-8b9a-eadcda156723', 'serial': 'd7d836cb-af79-406d-8b9a-eadcda156723'}, 'delete_on_termination': True, 'guest_format': None, 'volume_type': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 15:09:13 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:09:13 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:09:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'moMrhZRv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:09:13 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:09:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:09:13 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:09:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:09:13 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ceb31b4-0ed7-4842-aba6-5d8e43843bcd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 15:09:13 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[316d7400-f59a-4597-82db-b02f02af95a6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723] added
Jul 31 15:09:13 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[482fcebc-450c-4402-b7a0-138d043ec603]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f354d2-7da6-4578-a644-314c60dbc753]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v moMrhZRv {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v moMrhZRv" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[49452ddc-bfd7-4a64-9594-a07608f21edf]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'moMrhZRv'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[979ee07f-dbcc-41a6-9d72-987cf0322601]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e732a3ba-fb85-48a4-9631-5b055a95f436]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 (non-flash)
Jul 31 15:09:13 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 (non-flash)
Jul 31 15:09:13 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4018084e-d48a-4709-81ec-abf971f6d7b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723, portal: 172.16.0.220,3260]
Jul 31 15:09:13 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723, portal: 172.16.0.220,3260] successful.
Jul 31 15:09:13 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[748002e4-00f2-4416-a437-b3e3b7ab448c]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:09:13 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Instance destroyed successfully.
Jul 31 15:09:13 user nova-compute[72239]: DEBUG nova.objects.instance [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lazy-loading 'resources' on Instance uuid 60a6975d-7c9a-4194-895f-4f66655b0e12 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f7a649-b14d-43df-be39-9298453e735f]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 (non-flash)
Jul 31 15:09:13 user nova-compute[72239]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 (non-flash)
Jul 31 15:09:13 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 (non-flash)
Jul 31 15:09:13 user nova-compute[72239]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 (non-flash)
Jul 31 15:09:13 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.321s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:07:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1495716642',display_name='tempest-TestVolumeBootPattern-server-1495716642',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1495716642',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T15:07:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='35aaefdc03aa4e43b4ba435eea373cc4',ramdisk_id='',reservation_id='r-n2dm1ivw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1903261024',owner_user_name='tempest-TestVolumeBootPattern-1903261024-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T15:07:42Z,user_data=None,user_id='a73969a32be54c8caf621290e8823134',uuid=60a6975d-7c9a-4194-895f-4f66655b0e12,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1d212810-1a98-48a8-800d-a1ef4da2900b", "address": "fa:16:3e:1a:7f:3b", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d212810-1a", "ovs_interfaceid": "1d212810-1a98-48a8-800d-a1ef4da2900b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Converting VIF {"id": "1d212810-1a98-48a8-800d-a1ef4da2900b", "address": "fa:16:3e:1a:7f:3b", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1d212810-1a", "ovs_interfaceid": "1d212810-1a98-48a8-800d-a1ef4da2900b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:7f:3b,bridge_name='br-int',has_traffic_filtering=True,id=1d212810-1a98-48a8-800d-a1ef4da2900b,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d212810-1a') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG os_vif [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:7f:3b,bridge_name='br-int',has_traffic_filtering=True,id=1d212810-1a98-48a8-800d-a1ef4da2900b,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d212810-1a') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1d212810-1a, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec42b26-9fb5-4599-918f-dea2271add08]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'moMrhZRv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:09:13 user nova-compute[72239]: INFO os_vif [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:7f:3b,bridge_name='br-int',has_traffic_filtering=True,id=1d212810-1a98-48a8-800d-a1ef4da2900b,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1d212810-1a')
Jul 31 15:09:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 15:09:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RMvoIQPp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:09:13 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:09:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:09:14 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:09:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:09:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '26433366461323735', 'path': '/dev/sdc'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:09:14 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433366461323735', 'path': '/dev/sdc'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 15:09:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.992s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:09:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 15:09:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:09:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:09:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[69beee39-5f43-42f7-a8f3-5d6f99cb2aeb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:09:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aaa5841-8706-4cf1-b4d4-49a0089ab614]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 (non-flash)
Jul 31 15:09:15 user nova-compute[72239]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 (non-flash)
Jul 31 15:09:15 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 (non-flash)
Jul 31 15:09:15 user nova-compute[72239]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 (non-flash)
Jul 31 15:09:15 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4100664160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25'): ({'sdb'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Removing single pathed devices sdb {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[73446e02-6fe2-4369-b803-a5681fe5aee4]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:09:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1994135225',display_name='tempest-TestShelveInstance-server-1994135225',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1994135225',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3qQ5EyJIarsxl7CaYOuVPwwqk4C7G4wSQwfzuItUZmVtlZcdALH0os05s05+hzmMpQ5fVwLwISvjkca5M9UBRVUUk+gNi7cnH1xg8jF0VqKa4OiRnwlx8eP9rTGwh+wQ==',key_name='tempest-TestShelveInstance-2002616022',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba645b8f83ca4a15a1a6659572778375',ramdisk_id='',reservation_id='r-96pfnsos',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1245549841',owner_user_name='tempest-TestShelveInstance-1245549841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T15:09:05Z,user_data=None,user_id='8138394ef7f641309224d84d8789c831',uuid=f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64213693-d706-4784-81b5-74a181309dd4", "address": "fa:16:3e:b2:e3:7d", "network": {"id": "cbc10aaa-d0d9-4abe-bf51-17206a8f085a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1222279697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba645b8f83ca4a15a1a6659572778375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64213693-d7", "ovs_interfaceid": "64213693-d706-4784-81b5-74a181309dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Converting VIF {"id": "64213693-d706-4784-81b5-74a181309dd4", "address": "fa:16:3e:b2:e3:7d", "network": {"id": "cbc10aaa-d0d9-4abe-bf51-17206a8f085a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1222279697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba645b8f83ca4a15a1a6659572778375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64213693-d7", "ovs_interfaceid": "64213693-d706-4784-81b5-74a181309dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e3:7d,bridge_name='br-int',has_traffic_filtering=True,id=64213693-d706-4784-81b5-74a181309dd4,network=Network(cbc10aaa-d0d9-4abe-bf51-17206a8f085a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64213693-d7') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG nova.objects.instance [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lazy-loading 'pci_devices' on Instance uuid f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e989bafe-5dd7-4b6d-b17b-37116be1614b]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Flushing IO for device /dev/sdb {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] End _get_guest_xml xml=<domain type="kvm">
Jul 31 15:09:15 user nova-compute[72239]:   <uuid>f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0</uuid>
Jul 31 15:09:15 user nova-compute[72239]:   <name>instance-0000002d</name>
Jul 31 15:09:15 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 15:09:15 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 15:09:15 user nova-compute[72239]:   <metadata>
Jul 31 15:09:15 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 15:09:15 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 15:09:15 user nova-compute[72239]:       <nova:name>tempest-TestShelveInstance-server-1994135225</nova:name>
Jul 31 15:09:15 user nova-compute[72239]:       <nova:creationTime>2023-07-31 15:09:13</nova:creationTime>
Jul 31 15:09:15 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 15:09:15 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 15:09:15 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 15:09:15 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 15:09:15 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 15:09:15 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 15:09:15 user nova-compute[72239]:       </nova:flavor>
Jul 31 15:09:15 user nova-compute[72239]:       <nova:owner>
Jul 31 15:09:15 user nova-compute[72239]:         <nova:user uuid="8138394ef7f641309224d84d8789c831">tempest-TestShelveInstance-1245549841-project-member</nova:user>
Jul 31 15:09:15 user nova-compute[72239]:         <nova:project uuid="ba645b8f83ca4a15a1a6659572778375">tempest-TestShelveInstance-1245549841</nova:project>
Jul 31 15:09:15 user nova-compute[72239]:       </nova:owner>
Jul 31 15:09:15 user nova-compute[72239]:       <nova:ports>
Jul 31 15:09:15 user nova-compute[72239]:         <nova:port uuid="64213693-d706-4784-81b5-74a181309dd4">
Jul 31 15:09:15 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 31 15:09:15 user nova-compute[72239]:         </nova:port>
Jul 31 15:09:15 user nova-compute[72239]:       </nova:ports>
Jul 31 15:09:15 user nova-compute[72239]:     </nova:instance>
Jul 31 15:09:15 user nova-compute[72239]:   </metadata>
Jul 31 15:09:15 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 15:09:15 user nova-compute[72239]:     <system>
Jul 31 15:09:15 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 15:09:15 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 15:09:15 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 15:09:15 user nova-compute[72239]:       <entry name="serial">f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0</entry>
Jul 31 15:09:15 user nova-compute[72239]:       <entry name="uuid">f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0</entry>
Jul 31 15:09:15 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 15:09:15 user nova-compute[72239]:     </system>
Jul 31 15:09:15 user nova-compute[72239]:   </sysinfo>
Jul 31 15:09:15 user nova-compute[72239]:   <os>
Jul 31 15:09:15 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 15:09:15 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 15:09:15 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 15:09:15 user nova-compute[72239]:   </os>
Jul 31 15:09:15 user nova-compute[72239]:   <features>
Jul 31 15:09:15 user nova-compute[72239]:     <acpi/>
Jul 31 15:09:15 user nova-compute[72239]:     <apic/>
Jul 31 15:09:15 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 15:09:15 user nova-compute[72239]:   </features>
Jul 31 15:09:15 user nova-compute[72239]:   <clock offset="utc">
Jul 31 15:09:15 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 15:09:15 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 15:09:15 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 15:09:15 user nova-compute[72239]:   </clock>
Jul 31 15:09:15 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 15:09:15 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 15:09:15 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 15:09:15 user nova-compute[72239]:   </cpu>
Jul 31 15:09:15 user nova-compute[72239]:   <devices>
Jul 31 15:09:15 user nova-compute[72239]:     <disk type="block" device="disk">
Jul 31 15:09:15 user nova-compute[72239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:09:15 user nova-compute[72239]:       <source dev="/dev/sdc"/>
Jul 31 15:09:15 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 15:09:15 user nova-compute[72239]:       <serial>d7d836cb-af79-406d-8b9a-eadcda156723</serial>
Jul 31 15:09:15 user nova-compute[72239]:     </disk>
Jul 31 15:09:15 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 15:09:15 user nova-compute[72239]:       <mac address="fa:16:3e:b2:e3:7d"/>
Jul 31 15:09:15 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:09:15 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 15:09:15 user nova-compute[72239]:       <target dev="tap64213693-d7"/>
Jul 31 15:09:15 user nova-compute[72239]:     </interface>
Jul 31 15:09:15 user nova-compute[72239]:     <serial type="pty">
Jul 31 15:09:15 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0/console.log" append="off"/>
Jul 31 15:09:15 user nova-compute[72239]:     </serial>
Jul 31 15:09:15 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 15:09:15 user nova-compute[72239]:     <video>
Jul 31 15:09:15 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:09:15 user nova-compute[72239]:     </video>
Jul 31 15:09:15 user nova-compute[72239]:     <rng model="virtio">
Jul 31 15:09:15 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 15:09:15 user nova-compute[72239]:     </rng>
Jul 31 15:09:15 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 15:09:15 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 15:09:15 user nova-compute[72239]:       <stats period="10"/>
Jul 31 15:09:15 user nova-compute[72239]:     </memballoon>
Jul 31 15:09:15 user nova-compute[72239]:   </devices>
Jul 31 15:09:15 user nova-compute[72239]: </domain>
Jul 31 15:09:15 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:09:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1994135225',display_name='tempest-TestShelveInstance-server-1994135225',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1994135225',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3qQ5EyJIarsxl7CaYOuVPwwqk4C7G4wSQwfzuItUZmVtlZcdALH0os05s05+hzmMpQ5fVwLwISvjkca5M9UBRVUUk+gNi7cnH1xg8jF0VqKa4OiRnwlx8eP9rTGwh+wQ==',key_name='tempest-TestShelveInstance-2002616022',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ba645b8f83ca4a15a1a6659572778375',ramdisk_id='',reservation_id='r-96pfnsos',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1245549841',owner_user_name='tempest-TestShelveInstance-1245549841-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T15:09:05Z,user_data=None,user_id='8138394ef7f641309224d84d8789c831',uuid=f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64213693-d706-4784-81b5-74a181309dd4", "address": "fa:16:3e:b2:e3:7d", "network": {"id": "cbc10aaa-d0d9-4abe-bf51-17206a8f085a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1222279697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba645b8f83ca4a15a1a6659572778375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64213693-d7", "ovs_interfaceid": "64213693-d706-4784-81b5-74a181309dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Converting VIF {"id": "64213693-d706-4784-81b5-74a181309dd4", "address": "fa:16:3e:b2:e3:7d", "network": {"id": "cbc10aaa-d0d9-4abe-bf51-17206a8f085a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1222279697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba645b8f83ca4a15a1a6659572778375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64213693-d7", "ovs_interfaceid": "64213693-d706-4784-81b5-74a181309dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e3:7d,bridge_name='br-int',has_traffic_filtering=True,id=64213693-d706-4784-81b5-74a181309dd4,network=Network(cbc10aaa-d0d9-4abe-bf51-17206a8f085a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64213693-d7') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG os_vif [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e3:7d,bridge_name='br-int',has_traffic_filtering=True,id=64213693-d706-4784-81b5-74a181309dd4,network=Network(cbc10aaa-d0d9-4abe-bf51-17206a8f085a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64213693-d7') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64213693-d7, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap64213693-d7, col_values=(('external_ids', {'iface-id': '64213693-d706-4784-81b5-74a181309dd4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:e3:7d', 'vm-uuid': 'f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b74b5c2f-f128-434a-be02-1f387ccbafc9]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:15 user nova-compute[72239]: INFO os_vif [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e3:7d,bridge_name='br-int',has_traffic_filtering=True,id=64213693-d706-4784-81b5-74a181309dd4,network=Network(cbc10aaa-d0d9-4abe-bf51-17206a8f085a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64213693-d7')
Jul 31 15:09:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e835d7c-89e0-4a81-8ab5-ce6e36dfa2f5]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] No VIF found with MAC fa:16:3e:b2:e3:7d, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[331e7c57-d15e-4012-b24d-502ae7559bda]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a30b32f4-f7dc-46ea-8e53-0282027644e4]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25, portal: 172.16.0.220,3260]
Jul 31 15:09:15 user nova-compute[72239]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25, portal: 172.16.0.220,3260] successful.
Jul 31 15:09:15 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e3db768d-7ca8-4618-8dec-761d36e05a25 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[137cac74-afc2-41e2-ba05-76d9f5994077]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] <== disconnect_volume: return (1311ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 15:09:15 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Deleting instance files /opt/stack/data/nova/instances/60a6975d-7c9a-4194-895f-4f66655b0e12_del
Jul 31 15:09:15 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Deletion of /opt/stack/data/nova/instances/60a6975d-7c9a-4194-895f-4f66655b0e12_del complete
Jul 31 15:09:15 user nova-compute[72239]: INFO nova.compute.manager [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Took 2.29 seconds to destroy the instance on the hypervisor.
Jul 31 15:09:15 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG nova.compute.manager [req-782a829e-e232-48c6-aed1-8ace40d8fea7 req-3145f59b-aa94-4cc0-948a-e69255732890 service nova] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Received event network-vif-plugged-1d212810-1a98-48a8-800d-a1ef4da2900b {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-782a829e-e232-48c6-aed1-8ace40d8fea7 req-3145f59b-aa94-4cc0-948a-e69255732890 service nova] Acquiring lock "60a6975d-7c9a-4194-895f-4f66655b0e12-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-782a829e-e232-48c6-aed1-8ace40d8fea7 req-3145f59b-aa94-4cc0-948a-e69255732890 service nova] Lock "60a6975d-7c9a-4194-895f-4f66655b0e12-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-782a829e-e232-48c6-aed1-8ace40d8fea7 req-3145f59b-aa94-4cc0-948a-e69255732890 service nova] Lock "60a6975d-7c9a-4194-895f-4f66655b0e12-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:09:15 user nova-compute[72239]: DEBUG nova.compute.manager [req-782a829e-e232-48c6-aed1-8ace40d8fea7 req-3145f59b-aa94-4cc0-948a-e69255732890 service nova] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] No waiting events found dispatching network-vif-plugged-1d212810-1a98-48a8-800d-a1ef4da2900b {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:09:15 user nova-compute[72239]: WARNING nova.compute.manager [req-782a829e-e232-48c6-aed1-8ace40d8fea7 req-3145f59b-aa94-4cc0-948a-e69255732890 service nova] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Received unexpected event network-vif-plugged-1d212810-1a98-48a8-800d-a1ef4da2900b for instance with vm_state active and task_state deleting.
Jul 31 15:09:15 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:09:16 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Took 0.62 seconds to deallocate network for instance.
Jul 31 15:09:16 user nova-compute[72239]: DEBUG nova.compute.manager [req-47b9fa6e-f699-4ab6-ad19-458c57d6977b req-d7f26866-7b4f-425b-916c-361783b978dc service nova] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Received event network-vif-deleted-1d212810-1a98-48a8-800d-a1ef4da2900b {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:09:16 user nova-compute[72239]: INFO nova.compute.manager [req-47b9fa6e-f699-4ab6-ad19-458c57d6977b req-d7f26866-7b4f-425b-916c-361783b978dc service nova] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Neutron deleted interface 1d212810-1a98-48a8-800d-a1ef4da2900b; detaching it from the instance and deleting it from the info cache
Jul 31 15:09:16 user nova-compute[72239]: DEBUG nova.network.neutron [req-47b9fa6e-f699-4ab6-ad19-458c57d6977b req-d7f26866-7b4f-425b-916c-361783b978dc service nova] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:09:16 user nova-compute[72239]: DEBUG nova.compute.manager [req-47b9fa6e-f699-4ab6-ad19-458c57d6977b req-d7f26866-7b4f-425b-916c-361783b978dc service nova] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Detach interface failed, port_id=1d212810-1a98-48a8-800d-a1ef4da2900b, reason: Instance 60a6975d-7c9a-4194-895f-4f66655b0e12 could not be found. {{(pid=72239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 15:09:16 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:16 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:17 user nova-compute[72239]: INFO nova.compute.manager [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Took 1.13 seconds to detach 1 volumes for instance.
Jul 31 15:09:17 user nova-compute[72239]: DEBUG nova.compute.manager [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Deleting volume: e3db768d-7ca8-4618-8dec-761d36e05a25 {{(pid=72239) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 31 15:09:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:09:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:09:17 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:09:17 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 15:09:17 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:09:17 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:09:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.311s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:09:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-9ba7bc46-392d-4fd7-a85e-84b728d34d2e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:09:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-9ba7bc46-392d-4fd7-a85e-84b728d34d2e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:09:17 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 15:09:17 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Deleted allocations for instance 60a6975d-7c9a-4194-895f-4f66655b0e12
Jul 31 15:09:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7d127c39-e261-4e26-8c31-1d766e39f35c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "60a6975d-7c9a-4194-895f-4f66655b0e12" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.720s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:09:18 user nova-compute[72239]: DEBUG nova.compute.manager [req-e12afe9f-e2b1-434f-acf7-5209b63d6a39 req-f90b5ed2-a0de-432f-b3f6-1e9e52b13164 service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Received event network-vif-plugged-64213693-d706-4784-81b5-74a181309dd4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:09:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e12afe9f-e2b1-434f-acf7-5209b63d6a39 req-f90b5ed2-a0de-432f-b3f6-1e9e52b13164 service nova] Acquiring lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:09:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e12afe9f-e2b1-434f-acf7-5209b63d6a39 req-f90b5ed2-a0de-432f-b3f6-1e9e52b13164 service nova] Lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:09:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e12afe9f-e2b1-434f-acf7-5209b63d6a39 req-f90b5ed2-a0de-432f-b3f6-1e9e52b13164 service nova] Lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:09:18 user nova-compute[72239]: DEBUG nova.compute.manager [req-e12afe9f-e2b1-434f-acf7-5209b63d6a39 req-f90b5ed2-a0de-432f-b3f6-1e9e52b13164 service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] No waiting events found dispatching network-vif-plugged-64213693-d706-4784-81b5-74a181309dd4 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:09:18 user nova-compute[72239]: WARNING nova.compute.manager [req-e12afe9f-e2b1-434f-acf7-5209b63d6a39 req-f90b5ed2-a0de-432f-b3f6-1e9e52b13164 service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Received unexpected event network-vif-plugged-64213693-d706-4784-81b5-74a181309dd4 for instance with vm_state building and task_state spawning.
Jul 31 15:09:18 user nova-compute[72239]: DEBUG nova.compute.manager [req-e12afe9f-e2b1-434f-acf7-5209b63d6a39 req-f90b5ed2-a0de-432f-b3f6-1e9e52b13164 service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Received event network-vif-plugged-64213693-d706-4784-81b5-74a181309dd4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:09:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e12afe9f-e2b1-434f-acf7-5209b63d6a39 req-f90b5ed2-a0de-432f-b3f6-1e9e52b13164 service nova] Acquiring lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:09:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e12afe9f-e2b1-434f-acf7-5209b63d6a39 req-f90b5ed2-a0de-432f-b3f6-1e9e52b13164 service nova] Lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:09:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e12afe9f-e2b1-434f-acf7-5209b63d6a39 req-f90b5ed2-a0de-432f-b3f6-1e9e52b13164 service nova] Lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:09:18 user nova-compute[72239]: DEBUG nova.compute.manager [req-e12afe9f-e2b1-434f-acf7-5209b63d6a39 req-f90b5ed2-a0de-432f-b3f6-1e9e52b13164 service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] No waiting events found dispatching network-vif-plugged-64213693-d706-4784-81b5-74a181309dd4 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:09:18 user nova-compute[72239]: WARNING nova.compute.manager [req-e12afe9f-e2b1-434f-acf7-5209b63d6a39 req-f90b5ed2-a0de-432f-b3f6-1e9e52b13164 service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Received unexpected event network-vif-plugged-64213693-d706-4784-81b5-74a181309dd4 for instance with vm_state building and task_state spawning.
Jul 31 15:09:18 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Updating instance_info_cache with network_info: [{"id": "38b94412-ebcb-4c39-9856-d328dac47a43", "address": "fa:16:3e:16:9d:79", "network": {"id": "982c660e-02ba-428c-93d9-774e0c381aba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-768235194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "680110c45b9b4484ac099c9389ebe1ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b94412-eb", "ovs_interfaceid": "38b94412-ebcb-4c39-9856-d328dac47a43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:09:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-9ba7bc46-392d-4fd7-a85e-84b728d34d2e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:09:18 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 15:09:18 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:09:19 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:09:19 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690816159.3714786, f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:09:19 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] VM Resumed (Lifecycle Event)
Jul 31 15:09:19 user nova-compute[72239]: DEBUG nova.compute.manager [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 15:09:19 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 15:09:19 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Instance spawned successfully.
Jul 31 15:09:19 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 15:09:19 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:09:19 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:09:19 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:09:19 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:09:19 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:09:19 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:09:19 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:09:19 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:09:19 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:09:19 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 15:09:19 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690816159.3733099, f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:09:19 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] VM Started (Lifecycle Event)
Jul 31 15:09:19 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:09:19 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:09:19 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 15:09:19 user nova-compute[72239]: INFO nova.compute.manager [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Took 5.97 seconds to spawn the instance on the hypervisor.
Jul 31 15:09:19 user nova-compute[72239]: DEBUG nova.compute.manager [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:09:19 user nova-compute[72239]: INFO nova.compute.manager [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Took 14.82 seconds to build instance.
Jul 31 15:09:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-85d1a095-1fed-4aaa-8d71-189ecd0dedc8 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.935s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:09:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:21 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:09:23 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:09:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:09:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:09:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:09:23 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 15:09:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:09:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:09:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:09:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:09:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:09:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:09:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:09:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:09:24 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 15:09:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ba7bc46-392d-4fd7-a85e-84b728d34d2e/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:09:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ba7bc46-392d-4fd7-a85e-84b728d34d2e/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:09:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ba7bc46-392d-4fd7-a85e-84b728d34d2e/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:09:24 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ba7bc46-392d-4fd7-a85e-84b728d34d2e/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:09:24 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:09:24 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:09:24 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=8192MB free_disk=25.109813690185547GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 15:09:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:09:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:09:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:25 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance f98cea94-e905-47c5-bf88-5f5694934966 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:09:25 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 9ba7bc46-392d-4fd7-a85e-84b728d34d2e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:09:25 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance bf7b3a30-776f-406b-9e38-db804c098e93 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:09:25 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:09:25 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 15:09:25 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 15:09:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:25 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:09:25 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:09:25 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 15:09:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.317s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:09:27 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:09:27 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 15:09:28 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690816153.9163375, 60a6975d-7c9a-4194-895f-4f66655b0e12 => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:09:28 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] VM Stopped (Lifecycle Event)
Jul 31 15:09:28 user nova-compute[72239]: DEBUG nova.compute.manager [None req-cefc5f8e-774f-4be3-a29e-7961e388df86 None None] [instance: 60a6975d-7c9a-4194-895f-4f66655b0e12] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:09:30 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:09:30 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:30 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:09:30 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:09:30 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:09:30 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:40 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:40 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-79090a53-13df-418f-9603-9580166fac47 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Acquiring lock "9ba7bc46-392d-4fd7-a85e-84b728d34d2e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:09:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-79090a53-13df-418f-9603-9580166fac47 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lock "9ba7bc46-392d-4fd7-a85e-84b728d34d2e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:09:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-79090a53-13df-418f-9603-9580166fac47 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Acquiring lock "9ba7bc46-392d-4fd7-a85e-84b728d34d2e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:09:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-79090a53-13df-418f-9603-9580166fac47 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lock "9ba7bc46-392d-4fd7-a85e-84b728d34d2e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:09:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-79090a53-13df-418f-9603-9580166fac47 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lock "9ba7bc46-392d-4fd7-a85e-84b728d34d2e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:09:54 user nova-compute[72239]: INFO nova.compute.manager [None req-79090a53-13df-418f-9603-9580166fac47 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Terminating instance
Jul 31 15:09:54 user nova-compute[72239]: DEBUG nova.compute.manager [None req-79090a53-13df-418f-9603-9580166fac47 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 15:09:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:54 user nova-compute[72239]: DEBUG nova.compute.manager [req-0032f6b3-1e64-45c7-b5a2-84dcb8d1309e req-3f9a85d0-260a-40fb-bb93-fe4bbe3ac6e5 service nova] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Received event network-vif-unplugged-38b94412-ebcb-4c39-9856-d328dac47a43 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:09:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0032f6b3-1e64-45c7-b5a2-84dcb8d1309e req-3f9a85d0-260a-40fb-bb93-fe4bbe3ac6e5 service nova] Acquiring lock "9ba7bc46-392d-4fd7-a85e-84b728d34d2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:09:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0032f6b3-1e64-45c7-b5a2-84dcb8d1309e req-3f9a85d0-260a-40fb-bb93-fe4bbe3ac6e5 service nova] Lock "9ba7bc46-392d-4fd7-a85e-84b728d34d2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:09:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0032f6b3-1e64-45c7-b5a2-84dcb8d1309e req-3f9a85d0-260a-40fb-bb93-fe4bbe3ac6e5 service nova] Lock "9ba7bc46-392d-4fd7-a85e-84b728d34d2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:09:54 user nova-compute[72239]: DEBUG nova.compute.manager [req-0032f6b3-1e64-45c7-b5a2-84dcb8d1309e req-3f9a85d0-260a-40fb-bb93-fe4bbe3ac6e5 service nova] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] No waiting events found dispatching network-vif-unplugged-38b94412-ebcb-4c39-9856-d328dac47a43 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:09:54 user nova-compute[72239]: DEBUG nova.compute.manager [req-0032f6b3-1e64-45c7-b5a2-84dcb8d1309e req-3f9a85d0-260a-40fb-bb93-fe4bbe3ac6e5 service nova] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Received event network-vif-unplugged-38b94412-ebcb-4c39-9856-d328dac47a43 for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 15:09:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:54 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Instance destroyed successfully.
Jul 31 15:09:54 user nova-compute[72239]: DEBUG nova.objects.instance [None req-79090a53-13df-418f-9603-9580166fac47 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lazy-loading 'resources' on Instance uuid 9ba7bc46-392d-4fd7-a85e-84b728d34d2e {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:09:54 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-79090a53-13df-418f-9603-9580166fac47 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:05:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1519585139',display_name='tempest-TestServerVolumeAttachmentScenario-server-1519585139',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1519585139',id=42,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB05nQUADzTgDT7Sjf7pG1UJRbyQSH2o2BFUxYAOOMlqLQxISuxZy1qbuD/sbzBZhwiK3REgvVhdk/jX7BzduP+IQW2sxfJvd476ZQ52+TtKz41oY1dLAf9Su9f47QfTqA==',key_name='tempest-keypair-451366580',keypairs=<?>,launch_index=0,launched_at=2023-07-31T15:06:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='680110c45b9b4484ac099c9389ebe1ab',ramdisk_id='',reservation_id='r-x9jpussz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-444464408',owner_user_name='tempest-TestServerVolumeAttachmentScenario-444464408-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T15:06:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ecf54f41fcb1435487f421510891440e',uuid=9ba7bc46-392d-4fd7-a85e-84b728d34d2e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38b94412-ebcb-4c39-9856-d328dac47a43", "address": "fa:16:3e:16:9d:79", "network": {"id": "982c660e-02ba-428c-93d9-774e0c381aba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-768235194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "680110c45b9b4484ac099c9389ebe1ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b94412-eb", "ovs_interfaceid": "38b94412-ebcb-4c39-9856-d328dac47a43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 15:09:54 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-79090a53-13df-418f-9603-9580166fac47 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Converting VIF {"id": "38b94412-ebcb-4c39-9856-d328dac47a43", "address": "fa:16:3e:16:9d:79", "network": {"id": "982c660e-02ba-428c-93d9-774e0c381aba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-768235194-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "680110c45b9b4484ac099c9389ebe1ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38b94412-eb", "ovs_interfaceid": "38b94412-ebcb-4c39-9856-d328dac47a43", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:09:54 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-79090a53-13df-418f-9603-9580166fac47 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:16:9d:79,bridge_name='br-int',has_traffic_filtering=True,id=38b94412-ebcb-4c39-9856-d328dac47a43,network=Network(982c660e-02ba-428c-93d9-774e0c381aba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38b94412-eb') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:09:54 user nova-compute[72239]: DEBUG os_vif [None req-79090a53-13df-418f-9603-9580166fac47 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:9d:79,bridge_name='br-int',has_traffic_filtering=True,id=38b94412-ebcb-4c39-9856-d328dac47a43,network=Network(982c660e-02ba-428c-93d9-774e0c381aba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38b94412-eb') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 15:09:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38b94412-eb, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:09:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:09:54 user nova-compute[72239]: INFO os_vif [None req-79090a53-13df-418f-9603-9580166fac47 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:16:9d:79,bridge_name='br-int',has_traffic_filtering=True,id=38b94412-ebcb-4c39-9856-d328dac47a43,network=Network(982c660e-02ba-428c-93d9-774e0c381aba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38b94412-eb')
Jul 31 15:09:54 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-79090a53-13df-418f-9603-9580166fac47 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Deleting instance files /opt/stack/data/nova/instances/9ba7bc46-392d-4fd7-a85e-84b728d34d2e_del
Jul 31 15:09:54 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-79090a53-13df-418f-9603-9580166fac47 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Deletion of /opt/stack/data/nova/instances/9ba7bc46-392d-4fd7-a85e-84b728d34d2e_del complete
Jul 31 15:09:54 user nova-compute[72239]: INFO nova.compute.manager [None req-79090a53-13df-418f-9603-9580166fac47 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Took 0.86 seconds to destroy the instance on the hypervisor.
Jul 31 15:09:54 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-79090a53-13df-418f-9603-9580166fac47 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 15:09:54 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 15:09:54 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 15:09:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:09:56 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:09:56 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Took 1.62 seconds to deallocate network for instance.
Jul 31 15:09:56 user nova-compute[72239]: DEBUG nova.compute.manager [req-79df02d0-cc80-4ffe-9e29-ac0e3a5b3629 req-2240c3ae-3aa1-4b8b-bf42-ee14e8ef842d service nova] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Received event network-vif-plugged-38b94412-ebcb-4c39-9856-d328dac47a43 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:09:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-79df02d0-cc80-4ffe-9e29-ac0e3a5b3629 req-2240c3ae-3aa1-4b8b-bf42-ee14e8ef842d service nova] Acquiring lock "9ba7bc46-392d-4fd7-a85e-84b728d34d2e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:09:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-79df02d0-cc80-4ffe-9e29-ac0e3a5b3629 req-2240c3ae-3aa1-4b8b-bf42-ee14e8ef842d service nova] Lock "9ba7bc46-392d-4fd7-a85e-84b728d34d2e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:09:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-79df02d0-cc80-4ffe-9e29-ac0e3a5b3629 req-2240c3ae-3aa1-4b8b-bf42-ee14e8ef842d service nova] Lock "9ba7bc46-392d-4fd7-a85e-84b728d34d2e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:09:56 user nova-compute[72239]: DEBUG nova.compute.manager [req-79df02d0-cc80-4ffe-9e29-ac0e3a5b3629 req-2240c3ae-3aa1-4b8b-bf42-ee14e8ef842d service nova] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] No waiting events found dispatching network-vif-plugged-38b94412-ebcb-4c39-9856-d328dac47a43 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:09:56 user nova-compute[72239]: WARNING nova.compute.manager [req-79df02d0-cc80-4ffe-9e29-ac0e3a5b3629 req-2240c3ae-3aa1-4b8b-bf42-ee14e8ef842d service nova] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Received unexpected event network-vif-plugged-38b94412-ebcb-4c39-9856-d328dac47a43 for instance with vm_state active and task_state deleting.
Jul 31 15:09:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-79090a53-13df-418f-9603-9580166fac47 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:09:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-79090a53-13df-418f-9603-9580166fac47 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:09:56 user nova-compute[72239]: DEBUG nova.compute.manager [req-ba35a0e5-0036-47e0-9542-6371196fcd7f req-a3492c7e-4a1f-4475-80bb-cc95067a7a8f service nova] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Received event network-vif-deleted-38b94412-ebcb-4c39-9856-d328dac47a43 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:09:56 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-79090a53-13df-418f-9603-9580166fac47 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:09:56 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-79090a53-13df-418f-9603-9580166fac47 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:09:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-79090a53-13df-418f-9603-9580166fac47 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.273s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:09:56 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-79090a53-13df-418f-9603-9580166fac47 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Deleted allocations for instance 9ba7bc46-392d-4fd7-a85e-84b728d34d2e
Jul 31 15:09:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-79090a53-13df-418f-9603-9580166fac47 tempest-TestServerVolumeAttachmentScenario-444464408 tempest-TestServerVolumeAttachmentScenario-444464408-project-member] Lock "9ba7bc46-392d-4fd7-a85e-84b728d34d2e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.065s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:09:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:10:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquiring lock "bf7b3a30-776f-406b-9e38-db804c098e93" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:10:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "bf7b3a30-776f-406b-9e38-db804c098e93" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:10:06 user nova-compute[72239]: DEBUG nova.objects.instance [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lazy-loading 'flavor' on Instance uuid bf7b3a30-776f-406b-9e38-db804c098e93 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:10:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "bf7b3a30-776f-406b-9e38-db804c098e93" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:10:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquiring lock "bf7b3a30-776f-406b-9e38-db804c098e93" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:10:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "bf7b3a30-776f-406b-9e38-db804c098e93" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:10:07 user nova-compute[72239]: INFO nova.compute.manager [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Attaching volume 741ede6d-9229-4264-afcb-c9b03372aa2f to /dev/vdb
Jul 31 15:10:07 user nova-compute[72239]: DEBUG os_brick.utils [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:10:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:07 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49d4ed6-d7c7-4a44-8cf3-cc9fb3c88f18]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:07 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9490382-9c8e-4c85-a5dd-19d9e11eaf76]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:07 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d701a80-195d-4735-b15c-80a5759355ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:07 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e899d9-b9c6-434a-b1ef-1beed3993004]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:10:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 15:10:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:10:07 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 15:10:07 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[027e8fe6-09ec-4865-aa63-a1796fd6b662]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 15:10:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 15:10:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 15:10:07 user nova-compute[72239]: DEBUG os_brick.utils [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:10:07 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Updating existing volume attachment record: bad63f71-5ca3-49c4-a199-939b0e77c802 {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 15:10:09 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690816194.8537734, 9ba7bc46-392d-4fd7-a85e-84b728d34d2e => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:10:09 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] VM Stopped (Lifecycle Event)
Jul 31 15:10:09 user nova-compute[72239]: DEBUG nova.compute.manager [None req-6f6b271e-0330-46b4-ba71-26fe45179637 None None] [instance: 9ba7bc46-392d-4fd7-a85e-84b728d34d2e] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:10:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGXcyAOb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:10:14 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:10:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:10:14 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:10:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:10:14 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 15:10:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab01bd7e-3415-4c7a-906e-68f7df5db218]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 15:10:14 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7f2295-80eb-4186-bd1f-2c420b945733]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f] added
Jul 31 15:10:14 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba42b50-604f-4d47-8fc3-f535c297340a]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7300cf4e-6731-4f11-a284-2e1a19bd1aca]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oGXcyAOb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oGXcyAOb" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[004d26fa-22ab-46a6-88ff-e27300994ee8]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oGXcyAOb'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf73203-1222-4d83-81f2-3c028b78b1ba]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd962c3-adc8-4db7-987e-72ee8538c3b9]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 (non-flash)
Jul 31 15:10:14 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 (non-flash)
Jul 31 15:10:14 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d27282-b465-4cbf-bd29-fdcba26a3dc0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f, portal: 172.16.0.220,3260]
Jul 31 15:10:14 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f, portal: 172.16.0.220,3260] successful.
Jul 31 15:10:14 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc63408-ef45-42d9-b646-6978a7b2e1d4]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c979d6d-1d04-48e3-a93e-1d7d48a7373f]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 (non-flash)
Jul 31 15:10:14 user nova-compute[72239]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f (non-flash)
Jul 31 15:10:14 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 (non-flash)
Jul 31 15:10:14 user nova-compute[72239]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f (non-flash)
Jul 31 15:10:14 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[42745d0d-c2d4-49d5-9bbc-949e96ba8934]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGXcyAOb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 15:10:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:10:15 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:10:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:10:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26436343430636562', 'path': '/dev/sdb'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:10:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436343430636562', 'path': '/dev/sdb'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 15:10:15 user nova-compute[72239]: DEBUG nova.objects.instance [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lazy-loading 'flavor' on Instance uuid bf7b3a30-776f-406b-9e38-db804c098e93 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:10:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 15:10:15 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:10:15 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 15:10:15 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 15:10:15 user nova-compute[72239]:   <serial>741ede6d-9229-4264-afcb-c9b03372aa2f</serial>
Jul 31 15:10:15 user nova-compute[72239]: </disk>
Jul 31 15:10:15 user nova-compute[72239]:  {{(pid=72239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 15:10:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:10:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:10:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] No VIF found with MAC fa:16:3e:a7:1b:0c, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 15:10:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-704a9e56-8646-43ed-8814-fde029f6678e tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "bf7b3a30-776f-406b-9e38-db804c098e93" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.088s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:10:17 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:10:18 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:10:19 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:10:19 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 15:10:19 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Didn't find any instances for network info cache update. {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 15:10:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:10:21 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:10:22 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:10:23 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:10:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "fc5e6dfe-def8-47cb-8639-d93a39cfeeaa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:10:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "fc5e6dfe-def8-47cb-8639-d93a39cfeeaa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:10:24 user nova-compute[72239]: DEBUG nova.compute.manager [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 15:10:24 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:10:24 user nova-compute[72239]: DEBUG nova.compute.manager [req-891e7ca3-2eae-4761-a401-2a9f009b9803 req-f237676a-888b-481a-933f-e8c2aebabde3 service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Received event network-changed-0fcc6557-b09c-4149-8458-ac4f1bf6ffcf {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG nova.compute.manager [req-891e7ca3-2eae-4761-a401-2a9f009b9803 req-f237676a-888b-481a-933f-e8c2aebabde3 service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Refreshing instance network info cache due to event network-changed-0fcc6557-b09c-4149-8458-ac4f1bf6ffcf. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-891e7ca3-2eae-4761-a401-2a9f009b9803 req-f237676a-888b-481a-933f-e8c2aebabde3 service nova] Acquiring lock "refresh_cache-bf7b3a30-776f-406b-9e38-db804c098e93" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-891e7ca3-2eae-4761-a401-2a9f009b9803 req-f237676a-888b-481a-933f-e8c2aebabde3 service nova] Acquired lock "refresh_cache-bf7b3a30-776f-406b-9e38-db804c098e93" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG nova.network.neutron [req-891e7ca3-2eae-4761-a401-2a9f009b9803 req-f237676a-888b-481a-933f-e8c2aebabde3 service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Refreshing network info cache for port 0fcc6557-b09c-4149-8458-ac4f1bf6ffcf {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 15:10:25 user nova-compute[72239]: INFO nova.compute.claims [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Claim successful on node user
Jul 31 15:10:25 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Refreshing inventories for resource provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Updating ProviderTree inventory for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Updating inventory in ProviderTree for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Refreshing aggregate associations for resource provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e, aggregates: None {{(pid=72239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Refreshing trait associations for resource provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI {{(pid=72239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.407s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG nova.compute.manager [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG nova.compute.manager [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG nova.network.neutron [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 15:10:25 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 15:10:25 user nova-compute[72239]: DEBUG nova.network.neutron [req-891e7ca3-2eae-4761-a401-2a9f009b9803 req-f237676a-888b-481a-933f-e8c2aebabde3 service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Updated VIF entry in instance network info cache for port 0fcc6557-b09c-4149-8458-ac4f1bf6ffcf. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG nova.network.neutron [req-891e7ca3-2eae-4761-a401-2a9f009b9803 req-f237676a-888b-481a-933f-e8c2aebabde3 service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Updating instance_info_cache with network_info: [{"id": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "address": "fa:16:3e:a7:1b:0c", "network": {"id": "b9eb37b6-27e4-4d9e-bfb2-7e167766e547", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1162541993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37ae523240a47bb936ef4b54994de61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fcc6557-b0", "ovs_interfaceid": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG nova.compute.manager [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-891e7ca3-2eae-4761-a401-2a9f009b9803 req-f237676a-888b-481a-933f-e8c2aebabde3 service nova] Releasing lock "refresh_cache-bf7b3a30-776f-406b-9e38-db804c098e93" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:10:25 user nova-compute[72239]: INFO nova.virt.block_device [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Booting with volume 23b8f653-d0da-48f4-a96a-c9ee06333dac at /dev/vda
Jul 31 15:10:25 user nova-compute[72239]: DEBUG nova.policy [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a73969a32be54c8caf621290e8823134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aaefdc03aa4e43b4ba435eea373cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG os_brick.utils [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3838cdf-5452-4796-980b-d2b2482c3aad]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3a70f8-c20b-4e1e-9995-e3b44f06c605]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6236ef33-b7b3-4b98-a32d-ce22bc02f31c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e69789d-88f4-4d48-a24e-11de943e6ece]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:10:25 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 15:10:25 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5dd8d47-dc89-401a-8d9c-d427710a6801]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG os_brick.utils [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Updating existing volume attachment record: 3deb111f-6a58-4f8d-a01a-349c7b57e4cf {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:25 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 15:10:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 15:10:26 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:10:26 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:10:26 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=8422MB free_disk=25.134605407714844GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 15:10:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:10:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:10:26 user nova-compute[72239]: DEBUG nova.network.neutron [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Successfully created port: 21545375-78db-48b9-b32d-37349f2f809b {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 15:10:26 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance f98cea94-e905-47c5-bf88-5f5694934966 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:10:26 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance bf7b3a30-776f-406b-9e38-db804c098e93 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:10:26 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:10:26 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance fc5e6dfe-def8-47cb-8639-d93a39cfeeaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:10:26 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 15:10:26 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 15:10:27 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:10:27 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:10:27 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 15:10:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.554s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:10:27 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:10:27 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Cleaning up deleted instances {{(pid=72239) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 15:10:27 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] There are 0 instances to clean {{(pid=72239) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 15:10:28 user nova-compute[72239]: DEBUG nova.compute.manager [req-eee96b0a-9b97-4755-9dea-4c66202006ae req-1f8050fb-fb09-4353-9458-3a4b86520dff service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Received event network-changed-0fcc6557-b09c-4149-8458-ac4f1bf6ffcf {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:10:28 user nova-compute[72239]: DEBUG nova.compute.manager [req-eee96b0a-9b97-4755-9dea-4c66202006ae req-1f8050fb-fb09-4353-9458-3a4b86520dff service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Refreshing instance network info cache due to event network-changed-0fcc6557-b09c-4149-8458-ac4f1bf6ffcf. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:10:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-eee96b0a-9b97-4755-9dea-4c66202006ae req-1f8050fb-fb09-4353-9458-3a4b86520dff service nova] Acquiring lock "refresh_cache-bf7b3a30-776f-406b-9e38-db804c098e93" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:10:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-eee96b0a-9b97-4755-9dea-4c66202006ae req-1f8050fb-fb09-4353-9458-3a4b86520dff service nova] Acquired lock "refresh_cache-bf7b3a30-776f-406b-9e38-db804c098e93" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:10:28 user nova-compute[72239]: DEBUG nova.network.neutron [req-eee96b0a-9b97-4755-9dea-4c66202006ae req-1f8050fb-fb09-4353-9458-3a4b86520dff service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Refreshing network info cache for port 0fcc6557-b09c-4149-8458-ac4f1bf6ffcf {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:10:28 user nova-compute[72239]: DEBUG nova.network.neutron [req-eee96b0a-9b97-4755-9dea-4c66202006ae req-1f8050fb-fb09-4353-9458-3a4b86520dff service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Updated VIF entry in instance network info cache for port 0fcc6557-b09c-4149-8458-ac4f1bf6ffcf. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:10:28 user nova-compute[72239]: DEBUG nova.network.neutron [req-eee96b0a-9b97-4755-9dea-4c66202006ae req-1f8050fb-fb09-4353-9458-3a4b86520dff service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Updating instance_info_cache with network_info: [{"id": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "address": "fa:16:3e:a7:1b:0c", "network": {"id": "b9eb37b6-27e4-4d9e-bfb2-7e167766e547", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1162541993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37ae523240a47bb936ef4b54994de61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fcc6557-b0", "ovs_interfaceid": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:10:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-eee96b0a-9b97-4755-9dea-4c66202006ae req-1f8050fb-fb09-4353-9458-3a4b86520dff service nova] Releasing lock "refresh_cache-bf7b3a30-776f-406b-9e38-db804c098e93" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:10:28 user nova-compute[72239]: DEBUG nova.network.neutron [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Successfully updated port: 21545375-78db-48b9-b32d-37349f2f809b {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 15:10:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "refresh_cache-fc5e6dfe-def8-47cb-8639-d93a39cfeeaa" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:10:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquired lock "refresh_cache-fc5e6dfe-def8-47cb-8639-d93a39cfeeaa" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:10:28 user nova-compute[72239]: DEBUG nova.network.neutron [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 15:10:28 user nova-compute[72239]: DEBUG nova.network.neutron [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 15:10:28 user nova-compute[72239]: DEBUG nova.network.neutron [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Updating instance_info_cache with network_info: [{"id": "21545375-78db-48b9-b32d-37349f2f809b", "address": "fa:16:3e:96:5d:34", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21545375-78", "ovs_interfaceid": "21545375-78db-48b9-b32d-37349f2f809b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:10:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Releasing lock "refresh_cache-fc5e6dfe-def8-47cb-8639-d93a39cfeeaa" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:10:28 user nova-compute[72239]: DEBUG nova.compute.manager [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Instance network_info: |[{"id": "21545375-78db-48b9-b32d-37349f2f809b", "address": "fa:16:3e:96:5d:34", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21545375-78", "ovs_interfaceid": "21545375-78db-48b9-b32d-37349f2f809b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 15:10:29 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:10:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:10:30 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:30 user nova-compute[72239]: DEBUG nova.compute.manager [req-8f079941-a741-42ee-8974-4413ab659239 req-d5e5de1e-ad12-46ca-8b9d-b716d67f2157 service nova] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Received event network-changed-21545375-78db-48b9-b32d-37349f2f809b {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:10:30 user nova-compute[72239]: DEBUG nova.compute.manager [req-8f079941-a741-42ee-8974-4413ab659239 req-d5e5de1e-ad12-46ca-8b9d-b716d67f2157 service nova] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Refreshing instance network info cache due to event network-changed-21545375-78db-48b9-b32d-37349f2f809b. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:10:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-8f079941-a741-42ee-8974-4413ab659239 req-d5e5de1e-ad12-46ca-8b9d-b716d67f2157 service nova] Acquiring lock "refresh_cache-fc5e6dfe-def8-47cb-8639-d93a39cfeeaa" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:10:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-8f079941-a741-42ee-8974-4413ab659239 req-d5e5de1e-ad12-46ca-8b9d-b716d67f2157 service nova] Acquired lock "refresh_cache-fc5e6dfe-def8-47cb-8639-d93a39cfeeaa" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:10:30 user nova-compute[72239]: DEBUG nova.network.neutron [req-8f079941-a741-42ee-8974-4413ab659239 req-d5e5de1e-ad12-46ca-8b9d-b716d67f2157 service nova] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Refreshing network info cache for port 21545375-78db-48b9-b32d-37349f2f809b {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:10:30 user nova-compute[72239]: DEBUG nova.network.neutron [req-8f079941-a741-42ee-8974-4413ab659239 req-d5e5de1e-ad12-46ca-8b9d-b716d67f2157 service nova] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Updated VIF entry in instance network info cache for port 21545375-78db-48b9-b32d-37349f2f809b. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:10:30 user nova-compute[72239]: DEBUG nova.network.neutron [req-8f079941-a741-42ee-8974-4413ab659239 req-d5e5de1e-ad12-46ca-8b9d-b716d67f2157 service nova] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Updating instance_info_cache with network_info: [{"id": "21545375-78db-48b9-b32d-37349f2f809b", "address": "fa:16:3e:96:5d:34", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21545375-78", "ovs_interfaceid": "21545375-78db-48b9-b32d-37349f2f809b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:10:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-8f079941-a741-42ee-8974-4413ab659239 req-d5e5de1e-ad12-46ca-8b9d-b716d67f2157 service nova] Releasing lock "refresh_cache-fc5e6dfe-def8-47cb-8639-d93a39cfeeaa" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:10:31 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:10:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquiring lock "bf7b3a30-776f-406b-9e38-db804c098e93" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:10:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "bf7b3a30-776f-406b-9e38-db804c098e93" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:10:32 user nova-compute[72239]: INFO nova.compute.manager [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Rebooting instance
Jul 31 15:10:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquiring lock "refresh_cache-bf7b3a30-776f-406b-9e38-db804c098e93" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:10:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquired lock "refresh_cache-bf7b3a30-776f-406b-9e38-db804c098e93" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:10:32 user nova-compute[72239]: DEBUG nova.network.neutron [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 15:10:32 user nova-compute[72239]: DEBUG nova.network.neutron [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Updating instance_info_cache with network_info: [{"id": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "address": "fa:16:3e:a7:1b:0c", "network": {"id": "b9eb37b6-27e4-4d9e-bfb2-7e167766e547", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1162541993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37ae523240a47bb936ef4b54994de61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fcc6557-b0", "ovs_interfaceid": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:10:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Releasing lock "refresh_cache-bf7b3a30-776f-406b-9e38-db804c098e93" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:10:32 user nova-compute[72239]: DEBUG nova.compute.manager [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG nova.compute.manager [req-bf87e3f2-6035-4b0f-83e9-700f349f9f21 req-25b72200-2c3c-460d-81f5-7fbf69e83ba3 service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Received event network-vif-unplugged-0fcc6557-b09c-4149-8458-ac4f1bf6ffcf {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-bf87e3f2-6035-4b0f-83e9-700f349f9f21 req-25b72200-2c3c-460d-81f5-7fbf69e83ba3 service nova] Acquiring lock "bf7b3a30-776f-406b-9e38-db804c098e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-bf87e3f2-6035-4b0f-83e9-700f349f9f21 req-25b72200-2c3c-460d-81f5-7fbf69e83ba3 service nova] Lock "bf7b3a30-776f-406b-9e38-db804c098e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-bf87e3f2-6035-4b0f-83e9-700f349f9f21 req-25b72200-2c3c-460d-81f5-7fbf69e83ba3 service nova] Lock "bf7b3a30-776f-406b-9e38-db804c098e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG nova.compute.manager [req-bf87e3f2-6035-4b0f-83e9-700f349f9f21 req-25b72200-2c3c-460d-81f5-7fbf69e83ba3 service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] No waiting events found dispatching network-vif-unplugged-0fcc6557-b09c-4149-8458-ac4f1bf6ffcf {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:10:33 user nova-compute[72239]: WARNING nova.compute.manager [req-bf87e3f2-6035-4b0f-83e9-700f349f9f21 req-25b72200-2c3c-460d-81f5-7fbf69e83ba3 service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Received unexpected event network-vif-unplugged-0fcc6557-b09c-4149-8458-ac4f1bf6ffcf for instance with vm_state active and task_state reboot_started_hard.
Jul 31 15:10:33 user nova-compute[72239]: DEBUG nova.compute.manager [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 15:10:33 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Creating image(s)
Jul 31 15:10:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Did not create local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Ensure instance console log exists: /opt/stack/data/nova/instances/fc5e6dfe-def8-47cb-8639-d93a39cfeeaa/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Start _get_guest_xml network_info=[{"id": "21545375-78db-48b9-b32d-37349f2f809b", "address": "fa:16:3e:96:5d:34", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21545375-78", "ovs_interfaceid": "21545375-78db-48b9-b32d-37349f2f809b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '3deb111f-6a58-4f8d-a01a-349c7b57e4cf', 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LlRwhzXP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fc5e6dfe-def8-47cb-8639-d93a39cfeeaa', 'attached_at': '', 'detached_at': '', 'volume_id': '23b8f653-d0da-48f4-a96a-c9ee06333dac', 'serial': '23b8f653-d0da-48f4-a96a-c9ee06333dac'}, 'delete_on_termination': True, 'guest_format': None, 'volume_type': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 15:10:33 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:10:33 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:10:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LlRwhzXP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:10:33 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:10:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:10:33 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:10:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:10:33 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 15:10:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a4c04b-d040-4b90-b812-ad98cca7b48e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 15:10:33 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2c8c26-9a3c-42e7-9245-d484d28a557e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac] added
Jul 31 15:10:33 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[209edfd7-3cb0-442f-af6d-9da225800ca8]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb1de73-776e-4a8c-a9cd-840b178de919]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LlRwhzXP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LlRwhzXP" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0645136-f000-4cae-a7d9-18a839d7f39d]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LlRwhzXP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6af6974-6264-4cde-9191-69543baa2c3d]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3350c17c-8944-44c9-91c1-52664abb5436]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 (non-flash)
Jul 31 15:10:33 user nova-compute[72239]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f (non-flash)
Jul 31 15:10:33 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 (non-flash)
Jul 31 15:10:33 user nova-compute[72239]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f (non-flash)
Jul 31 15:10:33 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfcf900e-5dee-469a-9a90-b01451b7b087]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac, portal: 172.16.0.220,3260]
Jul 31 15:10:33 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac, portal: 172.16.0.220,3260] successful.
Jul 31 15:10:33 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa5754d-72ef-4e6f-87da-1170776a9ae8]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[92eaaeb6-c3c0-4afc-9e56-3e73e72b477b]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 (non-flash)
Jul 31 15:10:33 user nova-compute[72239]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f (non-flash)
Jul 31 15:10:33 user nova-compute[72239]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac (non-flash)
Jul 31 15:10:33 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 (non-flash)
Jul 31 15:10:33 user nova-compute[72239]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f (non-flash)
Jul 31 15:10:33 user nova-compute[72239]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac (non-flash)
Jul 31 15:10:33 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] HCTL ('35', '-', '-', 0) found on session 54 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb773f8f-b4c5-4521-ba39-69565d362e77]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Searching for a device in session 54 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LlRwhzXP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:33 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Instance destroyed successfully.
Jul 31 15:10:33 user nova-compute[72239]: DEBUG nova.objects.instance [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lazy-loading 'resources' on Instance uuid bf7b3a30-776f-406b-9e38-db804c098e93 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:08:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1333595426',display_name='tempest-TestMinimumBasicScenario-server-1333595426',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1333595426',id=44,image_ref='307af25b-1f52-4706-b31a-436ccc6613aa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2hXK+hMzIEO9mGtRj+Z4xkohPHcKxHoldVex8CDLHt4D6siIXOeWXD4ztrVYXKX/MNsxUzGh1XBckhFsDBgK6c8NC757TbUJBfOZYlgBPzRKUhs1zaTP6bKGWi3eIeLw==',key_name='tempest-TestMinimumBasicScenario-895895609',keypairs=<?>,launch_index=0,launched_at=2023-07-31T15:08:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f37ae523240a47bb936ef4b54994de61',ramdisk_id='',reservation_id='r-otnsvvx6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='307af25b-1f52-4706-b31a-436ccc6613aa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-429761002',owner_user_name='tempest-TestMinimumBasicScenario-429761002-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T15:10:33Z,user_data=None,user_id='d0a629efb75a463892b841e95f6d4acf',uuid=bf7b3a30-776f-406b-9e38-db804c098e93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "address": "fa:16:3e:a7:1b:0c", "network": {"id": "b9eb37b6-27e4-4d9e-bfb2-7e167766e547", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1162541993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37ae523240a47bb936ef4b54994de61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fcc6557-b0", "ovs_interfaceid": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Converting VIF {"id": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "address": "fa:16:3e:a7:1b:0c", "network": {"id": "b9eb37b6-27e4-4d9e-bfb2-7e167766e547", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1162541993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37ae523240a47bb936ef4b54994de61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fcc6557-b0", "ovs_interfaceid": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:1b:0c,bridge_name='br-int',has_traffic_filtering=True,id=0fcc6557-b09c-4149-8458-ac4f1bf6ffcf,network=Network(b9eb37b6-27e4-4d9e-bfb2-7e167766e547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fcc6557-b0') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG os_vif [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:1b:0c,bridge_name='br-int',has_traffic_filtering=True,id=0fcc6557-b09c-4149-8458-ac4f1bf6ffcf,network=Network(b9eb37b6-27e4-4d9e-bfb2-7e167766e547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fcc6557-b0') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0fcc6557-b0, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:10:33 user nova-compute[72239]: INFO os_vif [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:1b:0c,bridge_name='br-int',has_traffic_filtering=True,id=0fcc6557-b09c-4149-8458-ac4f1bf6ffcf,network=Network(b9eb37b6-27e4-4d9e-bfb2-7e167766e547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fcc6557-b0')
Jul 31 15:10:33 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 15:10:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGXcyAOb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:10:33 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:10:33 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23661303364653339', 'path': '/dev/sdd'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661303364653339', 'path': '/dev/sdd'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.861s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[874896e9-8fec-469c-ae0a-e75e0d0fbd8c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:10:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1972320020',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1972320020',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1972320020',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAYA8orIqYdvT0NtuugFJ4sGqt3q+via2daMBXsXRl1bzr9FbJ6moNijUFQb9n5WqtSGRz9T++3yYY7vi3weuhPIqYlZv3cC6T5j1nr1p87d1QI7NMD0d62lKR9ff/kJQ==',key_name='tempest-keypair-730554026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35aaefdc03aa4e43b4ba435eea373cc4',ramdisk_id='',reservation_id='r-e2e830w9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1903261024',owner_user_name='tempest-TestVolumeBootPattern-1903261024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T15:10:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a73969a32be54c8caf621290e8823134',uuid=fc5e6dfe-def8-47cb-8639-d93a39cfeeaa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21545375-78db-48b9-b32d-37349f2f809b", "address": "fa:16:3e:96:5d:34", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21545375-78", "ovs_interfaceid": "21545375-78db-48b9-b32d-37349f2f809b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Converting VIF {"id": "21545375-78db-48b9-b32d-37349f2f809b", "address": "fa:16:3e:96:5d:34", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21545375-78", "ovs_interfaceid": "21545375-78db-48b9-b32d-37349f2f809b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:5d:34,bridge_name='br-int',has_traffic_filtering=True,id=21545375-78db-48b9-b32d-37349f2f809b,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21545375-78') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG nova.objects.instance [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lazy-loading 'pci_devices' on Instance uuid fc5e6dfe-def8-47cb-8639-d93a39cfeeaa {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] End _get_guest_xml xml=<domain type="kvm">
Jul 31 15:10:34 user nova-compute[72239]:   <uuid>fc5e6dfe-def8-47cb-8639-d93a39cfeeaa</uuid>
Jul 31 15:10:34 user nova-compute[72239]:   <name>instance-0000002e</name>
Jul 31 15:10:34 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 15:10:34 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 15:10:34 user nova-compute[72239]:   <metadata>
Jul 31 15:10:34 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 15:10:34 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 15:10:34 user nova-compute[72239]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1972320020</nova:name>
Jul 31 15:10:34 user nova-compute[72239]:       <nova:creationTime>2023-07-31 15:10:33</nova:creationTime>
Jul 31 15:10:34 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 15:10:34 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 15:10:34 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 15:10:34 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 15:10:34 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 15:10:34 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 15:10:34 user nova-compute[72239]:       </nova:flavor>
Jul 31 15:10:34 user nova-compute[72239]:       <nova:owner>
Jul 31 15:10:34 user nova-compute[72239]:         <nova:user uuid="a73969a32be54c8caf621290e8823134">tempest-TestVolumeBootPattern-1903261024-project-member</nova:user>
Jul 31 15:10:34 user nova-compute[72239]:         <nova:project uuid="35aaefdc03aa4e43b4ba435eea373cc4">tempest-TestVolumeBootPattern-1903261024</nova:project>
Jul 31 15:10:34 user nova-compute[72239]:       </nova:owner>
Jul 31 15:10:34 user nova-compute[72239]:       <nova:ports>
Jul 31 15:10:34 user nova-compute[72239]:         <nova:port uuid="21545375-78db-48b9-b32d-37349f2f809b">
Jul 31 15:10:34 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 31 15:10:34 user nova-compute[72239]:         </nova:port>
Jul 31 15:10:34 user nova-compute[72239]:       </nova:ports>
Jul 31 15:10:34 user nova-compute[72239]:     </nova:instance>
Jul 31 15:10:34 user nova-compute[72239]:   </metadata>
Jul 31 15:10:34 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 15:10:34 user nova-compute[72239]:     <system>
Jul 31 15:10:34 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 15:10:34 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 15:10:34 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 15:10:34 user nova-compute[72239]:       <entry name="serial">fc5e6dfe-def8-47cb-8639-d93a39cfeeaa</entry>
Jul 31 15:10:34 user nova-compute[72239]:       <entry name="uuid">fc5e6dfe-def8-47cb-8639-d93a39cfeeaa</entry>
Jul 31 15:10:34 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 15:10:34 user nova-compute[72239]:     </system>
Jul 31 15:10:34 user nova-compute[72239]:   </sysinfo>
Jul 31 15:10:34 user nova-compute[72239]:   <os>
Jul 31 15:10:34 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 15:10:34 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 15:10:34 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 15:10:34 user nova-compute[72239]:   </os>
Jul 31 15:10:34 user nova-compute[72239]:   <features>
Jul 31 15:10:34 user nova-compute[72239]:     <acpi/>
Jul 31 15:10:34 user nova-compute[72239]:     <apic/>
Jul 31 15:10:34 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 15:10:34 user nova-compute[72239]:   </features>
Jul 31 15:10:34 user nova-compute[72239]:   <clock offset="utc">
Jul 31 15:10:34 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 15:10:34 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 15:10:34 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 15:10:34 user nova-compute[72239]:   </clock>
Jul 31 15:10:34 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 15:10:34 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 15:10:34 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 15:10:34 user nova-compute[72239]:   </cpu>
Jul 31 15:10:34 user nova-compute[72239]:   <devices>
Jul 31 15:10:34 user nova-compute[72239]:     <disk type="block" device="disk">
Jul 31 15:10:34 user nova-compute[72239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:10:34 user nova-compute[72239]:       <source dev="/dev/sdd"/>
Jul 31 15:10:34 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 15:10:34 user nova-compute[72239]:       <serial>23b8f653-d0da-48f4-a96a-c9ee06333dac</serial>
Jul 31 15:10:34 user nova-compute[72239]:     </disk>
Jul 31 15:10:34 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 15:10:34 user nova-compute[72239]:       <mac address="fa:16:3e:96:5d:34"/>
Jul 31 15:10:34 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:10:34 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 15:10:34 user nova-compute[72239]:       <target dev="tap21545375-78"/>
Jul 31 15:10:34 user nova-compute[72239]:     </interface>
Jul 31 15:10:34 user nova-compute[72239]:     <serial type="pty">
Jul 31 15:10:34 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/fc5e6dfe-def8-47cb-8639-d93a39cfeeaa/console.log" append="off"/>
Jul 31 15:10:34 user nova-compute[72239]:     </serial>
Jul 31 15:10:34 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 15:10:34 user nova-compute[72239]:     <video>
Jul 31 15:10:34 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:10:34 user nova-compute[72239]:     </video>
Jul 31 15:10:34 user nova-compute[72239]:     <rng model="virtio">
Jul 31 15:10:34 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 15:10:34 user nova-compute[72239]:     </rng>
Jul 31 15:10:34 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 15:10:34 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 15:10:34 user nova-compute[72239]:       <stats period="10"/>
Jul 31 15:10:34 user nova-compute[72239]:     </memballoon>
Jul 31 15:10:34 user nova-compute[72239]:   </devices>
Jul 31 15:10:34 user nova-compute[72239]: </domain>
Jul 31 15:10:34 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:10:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1972320020',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1972320020',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1972320020',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAYA8orIqYdvT0NtuugFJ4sGqt3q+via2daMBXsXRl1bzr9FbJ6moNijUFQb9n5WqtSGRz9T++3yYY7vi3weuhPIqYlZv3cC6T5j1nr1p87d1QI7NMD0d62lKR9ff/kJQ==',key_name='tempest-keypair-730554026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35aaefdc03aa4e43b4ba435eea373cc4',ramdisk_id='',reservation_id='r-e2e830w9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1903261024',owner_user_name='tempest-TestVolumeBootPattern-1903261024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T15:10:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a73969a32be54c8caf621290e8823134',uuid=fc5e6dfe-def8-47cb-8639-d93a39cfeeaa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "21545375-78db-48b9-b32d-37349f2f809b", "address": "fa:16:3e:96:5d:34", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21545375-78", "ovs_interfaceid": "21545375-78db-48b9-b32d-37349f2f809b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Converting VIF {"id": "21545375-78db-48b9-b32d-37349f2f809b", "address": "fa:16:3e:96:5d:34", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21545375-78", "ovs_interfaceid": "21545375-78db-48b9-b32d-37349f2f809b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:96:5d:34,bridge_name='br-int',has_traffic_filtering=True,id=21545375-78db-48b9-b32d-37349f2f809b,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21545375-78') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG os_vif [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:5d:34,bridge_name='br-int',has_traffic_filtering=True,id=21545375-78db-48b9-b32d-37349f2f809b,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21545375-78') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff3f23c-aa6e-4a39-a37a-887ce57af021]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 (non-flash)
Jul 31 15:10:34 user nova-compute[72239]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f (non-flash)
Jul 31 15:10:34 user nova-compute[72239]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac (non-flash)
Jul 31 15:10:34 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 (non-flash)
Jul 31 15:10:34 user nova-compute[72239]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f (non-flash)
Jul 31 15:10:34 user nova-compute[72239]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac (non-flash)
Jul 31 15:10:34 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f412013c820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f'): ({'sdb'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Removing single pathed devices sdb {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap21545375-78, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap21545375-78, col_values=(('external_ids', {'iface-id': '21545375-78db-48b9-b32d-37349f2f809b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:96:5d:34', 'vm-uuid': 'fc5e6dfe-def8-47cb-8639-d93a39cfeeaa'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:34 user nova-compute[72239]: INFO os_vif [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:96:5d:34,bridge_name='br-int',has_traffic_filtering=True,id=21545375-78db-48b9-b32d-37349f2f809b,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21545375-78')
Jul 31 15:10:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39d9a49-a229-40f8-ab3c-ea7f03f38038]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d640da-7d8a-47cf-b602-c09705599cbd]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Flushing IO for device /dev/sdb {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[35766cd9-47b4-4c6f-a329-617661044da0]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] No VIF found with MAC fa:16:3e:96:5d:34, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5688311-5594-4337-b4c8-ddaf7266ed4b]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c45d7f-c07b-4dac-a099-76a80bd98283]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[586c5271-1227-4d92-9af0-bc92b8aa40f7]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f, portal: 172.16.0.220,3260]
Jul 31 15:10:34 user nova-compute[72239]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f, portal: 172.16.0.220,3260] successful.
Jul 31 15:10:34 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5404b64-6943-4dd2-bc05-4ef83eff9be0]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] <== disconnect_volume: return (1128ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Start _get_guest_xml network_info=[{"id": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "address": "fa:16:3e:a7:1b:0c", "network": {"id": "b9eb37b6-27e4-4d9e-bfb2-7e167766e547", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1162541993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37ae523240a47bb936ef4b54994de61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fcc6557-b0", "ovs_interfaceid": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=307af25b-1f52-4706-b31a-436ccc6613aa,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '307af25b-1f52-4706-b31a-436ccc6613aa'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'attachment_id': 'bad63f71-5ca3-49c4-a199-939b0e77c802', 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGXcyAOb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'bf7b3a30-776f-406b-9e38-db804c098e93', 'attached_at': '', 'detached_at': '', 'volume_id': '741ede6d-9229-4264-afcb-c9b03372aa2f', 'serial': '741ede6d-9229-4264-afcb-c9b03372aa2f'}, 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 15:10:34 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:10:34 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:10:34 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=307af25b-1f52-4706-b31a-436ccc6613aa,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 15:10:34 user nova-compute[72239]: DEBUG nova.objects.instance [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lazy-loading 'vcpu_model' on Instance uuid bf7b3a30-776f-406b-9e38-db804c098e93 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGXcyAOb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:10:35 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:10:35 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:10:35 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:10:35 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:10:35 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 15:10:35 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c1e0b59-f27b-4eb5-b619-03d0d2554527]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 15:10:35 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[49063f90-5432-40cb-b144-0010eb48cfb4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f] added
Jul 31 15:10:35 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[89565995-005f-4f5f-bdd3-fa4bca7dc600]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[810524e7-7579-4b22-b58b-308bff0f7406]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oGXcyAOb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oGXcyAOb" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6322157a-bce3-454c-9a99-8e9e8a861fa7]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oGXcyAOb'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d3dc90-2093-43cc-9b1e-f3f6f093ebbe]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[53327fd6-5bcd-493b-8a58-fc7ac7cd7b37]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 (non-flash)
Jul 31 15:10:35 user nova-compute[72239]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac (non-flash)
Jul 31 15:10:35 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 (non-flash)
Jul 31 15:10:35 user nova-compute[72239]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac (non-flash)
Jul 31 15:10:35 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c5243a-ad7d-4f3f-8222-96c7f3a5bb1a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f, portal: 172.16.0.220,3260]
Jul 31 15:10:35 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f, portal: 172.16.0.220,3260] successful.
Jul 31 15:10:35 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[26cfcc39-80d7-4446-8cb4-e71eccd5fc67]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[92664bd7-afca-4521-b790-0af0e70c2404]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 (non-flash)
Jul 31 15:10:35 user nova-compute[72239]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac (non-flash)
Jul 31 15:10:35 user nova-compute[72239]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f (non-flash)
Jul 31 15:10:35 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 (non-flash)
Jul 31 15:10:35 user nova-compute[72239]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac (non-flash)
Jul 31 15:10:35 user nova-compute[72239]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f (non-flash)
Jul 31 15:10:35 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d03d6be0-965c-46d1-8592-b9abf266ff76]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGXcyAOb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG nova.compute.manager [req-17a8a8f1-a623-4b19-a72a-55fbc28a1439 req-554b44b2-ee26-46ba-9e02-2efe8f5aa1d2 service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Received event network-vif-plugged-0fcc6557-b09c-4149-8458-ac4f1bf6ffcf {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-17a8a8f1-a623-4b19-a72a-55fbc28a1439 req-554b44b2-ee26-46ba-9e02-2efe8f5aa1d2 service nova] Acquiring lock "bf7b3a30-776f-406b-9e38-db804c098e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-17a8a8f1-a623-4b19-a72a-55fbc28a1439 req-554b44b2-ee26-46ba-9e02-2efe8f5aa1d2 service nova] Lock "bf7b3a30-776f-406b-9e38-db804c098e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-17a8a8f1-a623-4b19-a72a-55fbc28a1439 req-554b44b2-ee26-46ba-9e02-2efe8f5aa1d2 service nova] Lock "bf7b3a30-776f-406b-9e38-db804c098e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG nova.compute.manager [req-17a8a8f1-a623-4b19-a72a-55fbc28a1439 req-554b44b2-ee26-46ba-9e02-2efe8f5aa1d2 service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] No waiting events found dispatching network-vif-plugged-0fcc6557-b09c-4149-8458-ac4f1bf6ffcf {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:10:35 user nova-compute[72239]: WARNING nova.compute.manager [req-17a8a8f1-a623-4b19-a72a-55fbc28a1439 req-554b44b2-ee26-46ba-9e02-2efe8f5aa1d2 service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Received unexpected event network-vif-plugged-0fcc6557-b09c-4149-8458-ac4f1bf6ffcf for instance with vm_state active and task_state reboot_started_hard.
Jul 31 15:10:35 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:10:35 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Cleaning up deleted instances with incomplete migration  {{(pid=72239) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 15:10:36 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:36 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:36 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:36 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:36 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:10:36 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '26436343430636562', 'path': '/dev/sdb'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:10:36 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436343430636562', 'path': '/dev/sdb'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 15:10:36 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:08:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1333595426',display_name='tempest-TestMinimumBasicScenario-server-1333595426',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1333595426',id=44,image_ref='307af25b-1f52-4706-b31a-436ccc6613aa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2hXK+hMzIEO9mGtRj+Z4xkohPHcKxHoldVex8CDLHt4D6siIXOeWXD4ztrVYXKX/MNsxUzGh1XBckhFsDBgK6c8NC757TbUJBfOZYlgBPzRKUhs1zaTP6bKGWi3eIeLw==',key_name='tempest-TestMinimumBasicScenario-895895609',keypairs=<?>,launch_index=0,launched_at=2023-07-31T15:08:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f37ae523240a47bb936ef4b54994de61',ramdisk_id='',reservation_id='r-otnsvvx6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='307af25b-1f52-4706-b31a-436ccc6613aa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-429761002',owner_user_name='tempest-TestMinimumBasicScenario-429761002-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T15:10:33Z,user_data=None,user_id='d0a629efb75a463892b841e95f6d4acf',uuid=bf7b3a30-776f-406b-9e38-db804c098e93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "address": "fa:16:3e:a7:1b:0c", "network": {"id": "b9eb37b6-27e4-4d9e-bfb2-7e167766e547", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1162541993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37ae523240a47bb936ef4b54994de61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fcc6557-b0", "ovs_interfaceid": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 15:10:36 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Converting VIF {"id": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "address": "fa:16:3e:a7:1b:0c", "network": {"id": "b9eb37b6-27e4-4d9e-bfb2-7e167766e547", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1162541993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37ae523240a47bb936ef4b54994de61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fcc6557-b0", "ovs_interfaceid": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:10:36 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:1b:0c,bridge_name='br-int',has_traffic_filtering=True,id=0fcc6557-b09c-4149-8458-ac4f1bf6ffcf,network=Network(b9eb37b6-27e4-4d9e-bfb2-7e167766e547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fcc6557-b0') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:10:36 user nova-compute[72239]: DEBUG nova.objects.instance [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lazy-loading 'pci_devices' on Instance uuid bf7b3a30-776f-406b-9e38-db804c098e93 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:10:36 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] End _get_guest_xml xml=<domain type="kvm">
Jul 31 15:10:36 user nova-compute[72239]:   <uuid>bf7b3a30-776f-406b-9e38-db804c098e93</uuid>
Jul 31 15:10:36 user nova-compute[72239]:   <name>instance-0000002c</name>
Jul 31 15:10:36 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 15:10:36 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 15:10:36 user nova-compute[72239]:   <metadata>
Jul 31 15:10:36 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 15:10:36 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 15:10:36 user nova-compute[72239]:       <nova:name>tempest-TestMinimumBasicScenario-server-1333595426</nova:name>
Jul 31 15:10:36 user nova-compute[72239]:       <nova:creationTime>2023-07-31 15:10:34</nova:creationTime>
Jul 31 15:10:36 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 15:10:36 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 15:10:36 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 15:10:36 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 15:10:36 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 15:10:36 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 15:10:36 user nova-compute[72239]:       </nova:flavor>
Jul 31 15:10:36 user nova-compute[72239]:       <nova:owner>
Jul 31 15:10:36 user nova-compute[72239]:         <nova:user uuid="d0a629efb75a463892b841e95f6d4acf">tempest-TestMinimumBasicScenario-429761002-project-member</nova:user>
Jul 31 15:10:36 user nova-compute[72239]:         <nova:project uuid="f37ae523240a47bb936ef4b54994de61">tempest-TestMinimumBasicScenario-429761002</nova:project>
Jul 31 15:10:36 user nova-compute[72239]:       </nova:owner>
Jul 31 15:10:36 user nova-compute[72239]:       <nova:root type="image" uuid="307af25b-1f52-4706-b31a-436ccc6613aa"/>
Jul 31 15:10:36 user nova-compute[72239]:       <nova:ports>
Jul 31 15:10:36 user nova-compute[72239]:         <nova:port uuid="0fcc6557-b09c-4149-8458-ac4f1bf6ffcf">
Jul 31 15:10:36 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 31 15:10:36 user nova-compute[72239]:         </nova:port>
Jul 31 15:10:36 user nova-compute[72239]:       </nova:ports>
Jul 31 15:10:36 user nova-compute[72239]:     </nova:instance>
Jul 31 15:10:36 user nova-compute[72239]:   </metadata>
Jul 31 15:10:36 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 15:10:36 user nova-compute[72239]:     <system>
Jul 31 15:10:36 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 15:10:36 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 15:10:36 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 15:10:36 user nova-compute[72239]:       <entry name="serial">bf7b3a30-776f-406b-9e38-db804c098e93</entry>
Jul 31 15:10:36 user nova-compute[72239]:       <entry name="uuid">bf7b3a30-776f-406b-9e38-db804c098e93</entry>
Jul 31 15:10:36 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 15:10:36 user nova-compute[72239]:     </system>
Jul 31 15:10:36 user nova-compute[72239]:   </sysinfo>
Jul 31 15:10:36 user nova-compute[72239]:   <os>
Jul 31 15:10:36 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 15:10:36 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 15:10:36 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 15:10:36 user nova-compute[72239]:   </os>
Jul 31 15:10:36 user nova-compute[72239]:   <features>
Jul 31 15:10:36 user nova-compute[72239]:     <acpi/>
Jul 31 15:10:36 user nova-compute[72239]:     <apic/>
Jul 31 15:10:36 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 15:10:36 user nova-compute[72239]:   </features>
Jul 31 15:10:36 user nova-compute[72239]:   <clock offset="utc">
Jul 31 15:10:36 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 15:10:36 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 15:10:36 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 15:10:36 user nova-compute[72239]:   </clock>
Jul 31 15:10:36 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 15:10:36 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 15:10:36 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 15:10:36 user nova-compute[72239]:   </cpu>
Jul 31 15:10:36 user nova-compute[72239]:   <devices>
Jul 31 15:10:36 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 15:10:36 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 15:10:36 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/disk"/>
Jul 31 15:10:36 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 15:10:36 user nova-compute[72239]:     </disk>
Jul 31 15:10:36 user nova-compute[72239]:     <disk type="block" device="disk">
Jul 31 15:10:36 user nova-compute[72239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:10:36 user nova-compute[72239]:       <source dev="/dev/sdb"/>
Jul 31 15:10:36 user nova-compute[72239]:       <target dev="vdb" bus="virtio"/>
Jul 31 15:10:36 user nova-compute[72239]:       <serial>741ede6d-9229-4264-afcb-c9b03372aa2f</serial>
Jul 31 15:10:36 user nova-compute[72239]:     </disk>
Jul 31 15:10:36 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 15:10:36 user nova-compute[72239]:       <mac address="fa:16:3e:a7:1b:0c"/>
Jul 31 15:10:36 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:10:36 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 15:10:36 user nova-compute[72239]:       <target dev="tap0fcc6557-b0"/>
Jul 31 15:10:36 user nova-compute[72239]:     </interface>
Jul 31 15:10:36 user nova-compute[72239]:     <serial type="pty">
Jul 31 15:10:36 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/console.log" append="off"/>
Jul 31 15:10:36 user nova-compute[72239]:     </serial>
Jul 31 15:10:36 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 15:10:36 user nova-compute[72239]:     <video>
Jul 31 15:10:36 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:10:36 user nova-compute[72239]:     </video>
Jul 31 15:10:36 user nova-compute[72239]:     <rng model="virtio">
Jul 31 15:10:36 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 15:10:36 user nova-compute[72239]:     </rng>
Jul 31 15:10:36 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 15:10:36 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 15:10:36 user nova-compute[72239]:       <stats period="10"/>
Jul 31 15:10:36 user nova-compute[72239]:     </memballoon>
Jul 31 15:10:36 user nova-compute[72239]:   </devices>
Jul 31 15:10:36 user nova-compute[72239]: </domain>
Jul 31 15:10:36 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 15:10:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:36 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 15:10:36 user nova-compute[72239]: DEBUG nova.objects.instance [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lazy-loading 'trusted_certs' on Instance uuid bf7b3a30-776f-406b-9e38-db804c098e93 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:10:36 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/922ad16347e90ac9c087c8b5980cdced0efb6fd0 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:36 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/922ad16347e90ac9c087c8b5980cdced0efb6fd0 --force-share --output=json" returned: 0 in 0.139s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:36 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 15:10:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:10:36 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:10:36 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Cannot resize image /opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 15:10:36 user nova-compute[72239]: DEBUG nova.objects.instance [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lazy-loading 'migration_context' on Instance uuid bf7b3a30-776f-406b-9e38-db804c098e93 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:10:36 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:08:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1333595426',display_name='tempest-TestMinimumBasicScenario-server-1333595426',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1333595426',id=44,image_ref='307af25b-1f52-4706-b31a-436ccc6613aa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2hXK+hMzIEO9mGtRj+Z4xkohPHcKxHoldVex8CDLHt4D6siIXOeWXD4ztrVYXKX/MNsxUzGh1XBckhFsDBgK6c8NC757TbUJBfOZYlgBPzRKUhs1zaTP6bKGWi3eIeLw==',key_name='tempest-TestMinimumBasicScenario-895895609',keypairs=<?>,launch_index=0,launched_at=2023-07-31T15:08:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='f37ae523240a47bb936ef4b54994de61',ramdisk_id='',reservation_id='r-otnsvvx6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='307af25b-1f52-4706-b31a-436ccc6613aa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-429761002',owner_user_name='tempest-TestMinimumBasicScenario-429761002-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T15:10:33Z,user_data=None,user_id='d0a629efb75a463892b841e95f6d4acf',uuid=bf7b3a30-776f-406b-9e38-db804c098e93,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "address": "fa:16:3e:a7:1b:0c", "network": {"id": "b9eb37b6-27e4-4d9e-bfb2-7e167766e547", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1162541993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37ae523240a47bb936ef4b54994de61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fcc6557-b0", "ovs_interfaceid": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 15:10:36 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Converting VIF {"id": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "address": "fa:16:3e:a7:1b:0c", "network": {"id": "b9eb37b6-27e4-4d9e-bfb2-7e167766e547", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1162541993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37ae523240a47bb936ef4b54994de61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fcc6557-b0", "ovs_interfaceid": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:10:36 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:1b:0c,bridge_name='br-int',has_traffic_filtering=True,id=0fcc6557-b09c-4149-8458-ac4f1bf6ffcf,network=Network(b9eb37b6-27e4-4d9e-bfb2-7e167766e547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fcc6557-b0') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:10:36 user nova-compute[72239]: DEBUG os_vif [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:1b:0c,bridge_name='br-int',has_traffic_filtering=True,id=0fcc6557-b09c-4149-8458-ac4f1bf6ffcf,network=Network(b9eb37b6-27e4-4d9e-bfb2-7e167766e547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fcc6557-b0') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 15:10:36 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:36 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:10:36 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 15:10:36 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:36 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0fcc6557-b0, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:10:36 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0fcc6557-b0, col_values=(('external_ids', {'iface-id': '0fcc6557-b09c-4149-8458-ac4f1bf6ffcf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:1b:0c', 'vm-uuid': 'bf7b3a30-776f-406b-9e38-db804c098e93'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:10:36 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:36 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:10:36 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:36 user nova-compute[72239]: INFO os_vif [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:1b:0c,bridge_name='br-int',has_traffic_filtering=True,id=0fcc6557-b09c-4149-8458-ac4f1bf6ffcf,network=Network(b9eb37b6-27e4-4d9e-bfb2-7e167766e547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fcc6557-b0')
Jul 31 15:10:37 user nova-compute[72239]: DEBUG nova.compute.manager [req-40fa3b1b-e137-4b97-b580-60f7611d52c0 req-be88eab9-24c1-41e2-ad4d-7b3f982852d1 service nova] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Received event network-vif-plugged-21545375-78db-48b9-b32d-37349f2f809b {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:10:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-40fa3b1b-e137-4b97-b580-60f7611d52c0 req-be88eab9-24c1-41e2-ad4d-7b3f982852d1 service nova] Acquiring lock "fc5e6dfe-def8-47cb-8639-d93a39cfeeaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:10:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-40fa3b1b-e137-4b97-b580-60f7611d52c0 req-be88eab9-24c1-41e2-ad4d-7b3f982852d1 service nova] Lock "fc5e6dfe-def8-47cb-8639-d93a39cfeeaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:10:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-40fa3b1b-e137-4b97-b580-60f7611d52c0 req-be88eab9-24c1-41e2-ad4d-7b3f982852d1 service nova] Lock "fc5e6dfe-def8-47cb-8639-d93a39cfeeaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:10:37 user nova-compute[72239]: DEBUG nova.compute.manager [req-40fa3b1b-e137-4b97-b580-60f7611d52c0 req-be88eab9-24c1-41e2-ad4d-7b3f982852d1 service nova] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] No waiting events found dispatching network-vif-plugged-21545375-78db-48b9-b32d-37349f2f809b {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:10:37 user nova-compute[72239]: WARNING nova.compute.manager [req-40fa3b1b-e137-4b97-b580-60f7611d52c0 req-be88eab9-24c1-41e2-ad4d-7b3f982852d1 service nova] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Received unexpected event network-vif-plugged-21545375-78db-48b9-b32d-37349f2f809b for instance with vm_state building and task_state spawning.
Jul 31 15:10:37 user nova-compute[72239]: DEBUG nova.compute.manager [req-40fa3b1b-e137-4b97-b580-60f7611d52c0 req-be88eab9-24c1-41e2-ad4d-7b3f982852d1 service nova] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Received event network-vif-plugged-21545375-78db-48b9-b32d-37349f2f809b {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:10:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-40fa3b1b-e137-4b97-b580-60f7611d52c0 req-be88eab9-24c1-41e2-ad4d-7b3f982852d1 service nova] Acquiring lock "fc5e6dfe-def8-47cb-8639-d93a39cfeeaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:10:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-40fa3b1b-e137-4b97-b580-60f7611d52c0 req-be88eab9-24c1-41e2-ad4d-7b3f982852d1 service nova] Lock "fc5e6dfe-def8-47cb-8639-d93a39cfeeaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:10:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-40fa3b1b-e137-4b97-b580-60f7611d52c0 req-be88eab9-24c1-41e2-ad4d-7b3f982852d1 service nova] Lock "fc5e6dfe-def8-47cb-8639-d93a39cfeeaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:10:37 user nova-compute[72239]: DEBUG nova.compute.manager [req-40fa3b1b-e137-4b97-b580-60f7611d52c0 req-be88eab9-24c1-41e2-ad4d-7b3f982852d1 service nova] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] No waiting events found dispatching network-vif-plugged-21545375-78db-48b9-b32d-37349f2f809b {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:10:37 user nova-compute[72239]: WARNING nova.compute.manager [req-40fa3b1b-e137-4b97-b580-60f7611d52c0 req-be88eab9-24c1-41e2-ad4d-7b3f982852d1 service nova] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Received unexpected event network-vif-plugged-21545375-78db-48b9-b32d-37349f2f809b for instance with vm_state building and task_state spawning.
Jul 31 15:10:38 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690816238.1227686, fc5e6dfe-def8-47cb-8639-d93a39cfeeaa => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:10:38 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] VM Resumed (Lifecycle Event)
Jul 31 15:10:38 user nova-compute[72239]: DEBUG nova.compute.manager [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 15:10:38 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 15:10:38 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Instance spawned successfully.
Jul 31 15:10:38 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 15:10:38 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:10:38 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:10:38 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:10:38 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:10:38 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:10:38 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:10:38 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:10:38 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:10:38 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 15:10:38 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690816238.1272187, fc5e6dfe-def8-47cb-8639-d93a39cfeeaa => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:10:38 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] VM Started (Lifecycle Event)
Jul 31 15:10:38 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:10:38 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:10:38 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 15:10:38 user nova-compute[72239]: INFO nova.compute.manager [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Took 5.00 seconds to spawn the instance on the hypervisor.
Jul 31 15:10:38 user nova-compute[72239]: DEBUG nova.compute.manager [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:10:38 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:38 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:38 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:38 user nova-compute[72239]: INFO nova.compute.manager [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Took 13.48 seconds to build instance.
Jul 31 15:10:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-eef1aacf-462d-4a47-823e-e50b54957d38 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "fc5e6dfe-def8-47cb-8639-d93a39cfeeaa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.597s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:10:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:39 user nova-compute[72239]: DEBUG nova.compute.manager [req-9142b7f3-373a-4878-8658-60c4b8b9b431 req-49bb2089-0149-4809-983c-c2bee1c8119b service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Received event network-vif-plugged-0fcc6557-b09c-4149-8458-ac4f1bf6ffcf {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:10:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-9142b7f3-373a-4878-8658-60c4b8b9b431 req-49bb2089-0149-4809-983c-c2bee1c8119b service nova] Acquiring lock "bf7b3a30-776f-406b-9e38-db804c098e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:10:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-9142b7f3-373a-4878-8658-60c4b8b9b431 req-49bb2089-0149-4809-983c-c2bee1c8119b service nova] Lock "bf7b3a30-776f-406b-9e38-db804c098e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:10:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-9142b7f3-373a-4878-8658-60c4b8b9b431 req-49bb2089-0149-4809-983c-c2bee1c8119b service nova] Lock "bf7b3a30-776f-406b-9e38-db804c098e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:10:39 user nova-compute[72239]: DEBUG nova.compute.manager [req-9142b7f3-373a-4878-8658-60c4b8b9b431 req-49bb2089-0149-4809-983c-c2bee1c8119b service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] No waiting events found dispatching network-vif-plugged-0fcc6557-b09c-4149-8458-ac4f1bf6ffcf {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:10:39 user nova-compute[72239]: WARNING nova.compute.manager [req-9142b7f3-373a-4878-8658-60c4b8b9b431 req-49bb2089-0149-4809-983c-c2bee1c8119b service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Received unexpected event network-vif-plugged-0fcc6557-b09c-4149-8458-ac4f1bf6ffcf for instance with vm_state active and task_state reboot_started_hard.
Jul 31 15:10:39 user nova-compute[72239]: DEBUG nova.compute.manager [req-9142b7f3-373a-4878-8658-60c4b8b9b431 req-49bb2089-0149-4809-983c-c2bee1c8119b service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Received event network-vif-plugged-0fcc6557-b09c-4149-8458-ac4f1bf6ffcf {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:10:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-9142b7f3-373a-4878-8658-60c4b8b9b431 req-49bb2089-0149-4809-983c-c2bee1c8119b service nova] Acquiring lock "bf7b3a30-776f-406b-9e38-db804c098e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:10:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-9142b7f3-373a-4878-8658-60c4b8b9b431 req-49bb2089-0149-4809-983c-c2bee1c8119b service nova] Lock "bf7b3a30-776f-406b-9e38-db804c098e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:10:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-9142b7f3-373a-4878-8658-60c4b8b9b431 req-49bb2089-0149-4809-983c-c2bee1c8119b service nova] Lock "bf7b3a30-776f-406b-9e38-db804c098e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:10:39 user nova-compute[72239]: DEBUG nova.compute.manager [req-9142b7f3-373a-4878-8658-60c4b8b9b431 req-49bb2089-0149-4809-983c-c2bee1c8119b service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] No waiting events found dispatching network-vif-plugged-0fcc6557-b09c-4149-8458-ac4f1bf6ffcf {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:10:39 user nova-compute[72239]: WARNING nova.compute.manager [req-9142b7f3-373a-4878-8658-60c4b8b9b431 req-49bb2089-0149-4809-983c-c2bee1c8119b service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Received unexpected event network-vif-plugged-0fcc6557-b09c-4149-8458-ac4f1bf6ffcf for instance with vm_state active and task_state reboot_started_hard.
Jul 31 15:10:40 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:40 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Removed pending event for bf7b3a30-776f-406b-9e38-db804c098e93 due to event {{(pid=72239) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 15:10:40 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690816240.5811818, bf7b3a30-776f-406b-9e38-db804c098e93 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:10:40 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] VM Resumed (Lifecycle Event)
Jul 31 15:10:40 user nova-compute[72239]: DEBUG nova.compute.manager [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 15:10:40 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Instance rebooted successfully.
Jul 31 15:10:40 user nova-compute[72239]: DEBUG nova.compute.manager [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:10:40 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:10:40 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:10:40 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Jul 31 15:10:40 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690816240.5851552, bf7b3a30-776f-406b-9e38-db804c098e93 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:10:40 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] VM Started (Lifecycle Event)
Jul 31 15:10:40 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:10:40 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:10:40 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Jul 31 15:10:40 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-5bd7b7dd-3c39-4525-9006-0142899a7a9c tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "bf7b3a30-776f-406b-9e38-db804c098e93" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.350s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:10:41 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:10:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:55 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._sync_power_states {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:10:55 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Triggering sync for uuid f98cea94-e905-47c5-bf88-5f5694934966 {{(pid=72239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 15:10:55 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Triggering sync for uuid bf7b3a30-776f-406b-9e38-db804c098e93 {{(pid=72239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 15:10:55 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Triggering sync for uuid f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0 {{(pid=72239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 15:10:55 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Triggering sync for uuid fc5e6dfe-def8-47cb-8639-d93a39cfeeaa {{(pid=72239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 15:10:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "f98cea94-e905-47c5-bf88-5f5694934966" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:10:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "f98cea94-e905-47c5-bf88-5f5694934966" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:10:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "bf7b3a30-776f-406b-9e38-db804c098e93" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:10:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "bf7b3a30-776f-406b-9e38-db804c098e93" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:10:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:10:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:10:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "fc5e6dfe-def8-47cb-8639-d93a39cfeeaa" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:10:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "fc5e6dfe-def8-47cb-8639-d93a39cfeeaa" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:10:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "bf7b3a30-776f-406b-9e38-db804c098e93" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:10:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "f98cea94-e905-47c5-bf88-5f5694934966" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:10:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.038s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:10:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "fc5e6dfe-def8-47cb-8639-d93a39cfeeaa" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:10:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:57 user nova-compute[72239]: DEBUG nova.compute.manager [req-a30b7b1e-d1b6-4737-9615-12210821eca0 req-03d47558-9d71-4b0d-b433-c95921271679 service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Received event network-changed-64213693-d706-4784-81b5-74a181309dd4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:10:57 user nova-compute[72239]: DEBUG nova.compute.manager [req-a30b7b1e-d1b6-4737-9615-12210821eca0 req-03d47558-9d71-4b0d-b433-c95921271679 service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Refreshing instance network info cache due to event network-changed-64213693-d706-4784-81b5-74a181309dd4. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:10:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a30b7b1e-d1b6-4737-9615-12210821eca0 req-03d47558-9d71-4b0d-b433-c95921271679 service nova] Acquiring lock "refresh_cache-f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:10:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a30b7b1e-d1b6-4737-9615-12210821eca0 req-03d47558-9d71-4b0d-b433-c95921271679 service nova] Acquired lock "refresh_cache-f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:10:57 user nova-compute[72239]: DEBUG nova.network.neutron [req-a30b7b1e-d1b6-4737-9615-12210821eca0 req-03d47558-9d71-4b0d-b433-c95921271679 service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Refreshing network info cache for port 64213693-d706-4784-81b5-74a181309dd4 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:10:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Acquiring lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:10:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:10:58 user nova-compute[72239]: INFO nova.compute.manager [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Shelve offloading
Jul 31 15:10:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:59 user nova-compute[72239]: DEBUG nova.network.neutron [req-a30b7b1e-d1b6-4737-9615-12210821eca0 req-03d47558-9d71-4b0d-b433-c95921271679 service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Updated VIF entry in instance network info cache for port 64213693-d706-4784-81b5-74a181309dd4. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:10:59 user nova-compute[72239]: DEBUG nova.network.neutron [req-a30b7b1e-d1b6-4737-9615-12210821eca0 req-03d47558-9d71-4b0d-b433-c95921271679 service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Updating instance_info_cache with network_info: [{"id": "64213693-d706-4784-81b5-74a181309dd4", "address": "fa:16:3e:b2:e3:7d", "network": {"id": "cbc10aaa-d0d9-4abe-bf51-17206a8f085a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1222279697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba645b8f83ca4a15a1a6659572778375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64213693-d7", "ovs_interfaceid": "64213693-d706-4784-81b5-74a181309dd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:10:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:10:59 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Instance destroyed successfully.
Jul 31 15:10:59 user nova-compute[72239]: DEBUG nova.compute.manager [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:10:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Acquiring lock "refresh_cache-f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:10:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a30b7b1e-d1b6-4737-9615-12210821eca0 req-03d47558-9d71-4b0d-b433-c95921271679 service nova] Releasing lock "refresh_cache-f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:10:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Acquired lock "refresh_cache-f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:10:59 user nova-compute[72239]: DEBUG nova.network.neutron [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 15:10:59 user nova-compute[72239]: DEBUG nova.network.neutron [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Updating instance_info_cache with network_info: [{"id": "64213693-d706-4784-81b5-74a181309dd4", "address": "fa:16:3e:b2:e3:7d", "network": {"id": "cbc10aaa-d0d9-4abe-bf51-17206a8f085a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1222279697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba645b8f83ca4a15a1a6659572778375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64213693-d7", "ovs_interfaceid": "64213693-d706-4784-81b5-74a181309dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:10:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Releasing lock "refresh_cache-f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:10:59 user nova-compute[72239]: DEBUG nova.compute.manager [req-610e3fdb-1520-4301-a977-e810c87b4d7d req-b13b04fa-be57-4a3b-99b1-92c6a0b10aa2 service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Received event network-vif-unplugged-64213693-d706-4784-81b5-74a181309dd4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:10:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-610e3fdb-1520-4301-a977-e810c87b4d7d req-b13b04fa-be57-4a3b-99b1-92c6a0b10aa2 service nova] Acquiring lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:10:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-610e3fdb-1520-4301-a977-e810c87b4d7d req-b13b04fa-be57-4a3b-99b1-92c6a0b10aa2 service nova] Lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:10:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-610e3fdb-1520-4301-a977-e810c87b4d7d req-b13b04fa-be57-4a3b-99b1-92c6a0b10aa2 service nova] Lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:10:59 user nova-compute[72239]: DEBUG nova.compute.manager [req-610e3fdb-1520-4301-a977-e810c87b4d7d req-b13b04fa-be57-4a3b-99b1-92c6a0b10aa2 service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] No waiting events found dispatching network-vif-unplugged-64213693-d706-4784-81b5-74a181309dd4 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:10:59 user nova-compute[72239]: WARNING nova.compute.manager [req-610e3fdb-1520-4301-a977-e810c87b4d7d req-b13b04fa-be57-4a3b-99b1-92c6a0b10aa2 service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Received unexpected event network-vif-unplugged-64213693-d706-4784-81b5-74a181309dd4 for instance with vm_state active and task_state shelving.
Jul 31 15:10:59 user nova-compute[72239]: DEBUG nova.compute.manager [req-610e3fdb-1520-4301-a977-e810c87b4d7d req-b13b04fa-be57-4a3b-99b1-92c6a0b10aa2 service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Received event network-vif-plugged-64213693-d706-4784-81b5-74a181309dd4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:10:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-610e3fdb-1520-4301-a977-e810c87b4d7d req-b13b04fa-be57-4a3b-99b1-92c6a0b10aa2 service nova] Acquiring lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:10:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-610e3fdb-1520-4301-a977-e810c87b4d7d req-b13b04fa-be57-4a3b-99b1-92c6a0b10aa2 service nova] Lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:10:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-610e3fdb-1520-4301-a977-e810c87b4d7d req-b13b04fa-be57-4a3b-99b1-92c6a0b10aa2 service nova] Lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:10:59 user nova-compute[72239]: DEBUG nova.compute.manager [req-610e3fdb-1520-4301-a977-e810c87b4d7d req-b13b04fa-be57-4a3b-99b1-92c6a0b10aa2 service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] No waiting events found dispatching network-vif-plugged-64213693-d706-4784-81b5-74a181309dd4 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:10:59 user nova-compute[72239]: WARNING nova.compute.manager [req-610e3fdb-1520-4301-a977-e810c87b4d7d req-b13b04fa-be57-4a3b-99b1-92c6a0b10aa2 service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Received unexpected event network-vif-plugged-64213693-d706-4784-81b5-74a181309dd4 for instance with vm_state active and task_state shelving.
Jul 31 15:11:00 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:11:00 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Instance destroyed successfully.
Jul 31 15:11:00 user nova-compute[72239]: DEBUG nova.objects.instance [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lazy-loading 'resources' on Instance uuid f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:09:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1994135225',display_name='tempest-TestShelveInstance-server-1994135225',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1994135225',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3qQ5EyJIarsxl7CaYOuVPwwqk4C7G4wSQwfzuItUZmVtlZcdALH0os05s05+hzmMpQ5fVwLwISvjkca5M9UBRVUUk+gNi7cnH1xg8jF0VqKa4OiRnwlx8eP9rTGwh+wQ==',key_name='tempest-TestShelveInstance-2002616022',keypairs=<?>,launch_index=0,launched_at=2023-07-31T15:09:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba645b8f83ca4a15a1a6659572778375',ramdisk_id='',reservation_id='r-96pfnsos',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1245549841',owner_user_name='tempest-TestShelveInstance-1245549841-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T15:09:20Z,user_data=None,user_id='8138394ef7f641309224d84d8789c831',uuid=f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64213693-d706-4784-81b5-74a181309dd4", "address": "fa:16:3e:b2:e3:7d", "network": {"id": "cbc10aaa-d0d9-4abe-bf51-17206a8f085a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1222279697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba645b8f83ca4a15a1a6659572778375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64213693-d7", "ovs_interfaceid": "64213693-d706-4784-81b5-74a181309dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Converting VIF {"id": "64213693-d706-4784-81b5-74a181309dd4", "address": "fa:16:3e:b2:e3:7d", "network": {"id": "cbc10aaa-d0d9-4abe-bf51-17206a8f085a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1222279697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba645b8f83ca4a15a1a6659572778375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64213693-d7", "ovs_interfaceid": "64213693-d706-4784-81b5-74a181309dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e3:7d,bridge_name='br-int',has_traffic_filtering=True,id=64213693-d706-4784-81b5-74a181309dd4,network=Network(cbc10aaa-d0d9-4abe-bf51-17206a8f085a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64213693-d7') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG os_vif [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e3:7d,bridge_name='br-int',has_traffic_filtering=True,id=64213693-d706-4784-81b5-74a181309dd4,network=Network(cbc10aaa-d0d9-4abe-bf51-17206a8f085a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64213693-d7') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64213693-d7, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:11:00 user nova-compute[72239]: INFO os_vif [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e3:7d,bridge_name='br-int',has_traffic_filtering=True,id=64213693-d706-4784-81b5-74a181309dd4,network=Network(cbc10aaa-d0d9-4abe-bf51-17206a8f085a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64213693-d7')
Jul 31 15:11:00 user nova-compute[72239]: DEBUG nova.compute.manager [req-15865762-367d-4801-9af4-e074e4cffa5e req-63be8eb1-1d6c-423a-8f49-a3e17206fd95 service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Received event network-changed-64213693-d706-4784-81b5-74a181309dd4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG nova.compute.manager [req-15865762-367d-4801-9af4-e074e4cffa5e req-63be8eb1-1d6c-423a-8f49-a3e17206fd95 service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Refreshing instance network info cache due to event network-changed-64213693-d706-4784-81b5-74a181309dd4. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-15865762-367d-4801-9af4-e074e4cffa5e req-63be8eb1-1d6c-423a-8f49-a3e17206fd95 service nova] Acquiring lock "refresh_cache-f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-15865762-367d-4801-9af4-e074e4cffa5e req-63be8eb1-1d6c-423a-8f49-a3e17206fd95 service nova] Acquired lock "refresh_cache-f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG nova.network.neutron [req-15865762-367d-4801-9af4-e074e4cffa5e req-63be8eb1-1d6c-423a-8f49-a3e17206fd95 service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Refreshing network info cache for port 64213693-d706-4784-81b5-74a181309dd4 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'moMrhZRv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:11:00 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:11:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf77c88-b341-4579-b4cc-b008f20859e0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdffd935-79b2-4869-bb45-cdca24284ac2]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 (non-flash)
Jul 31 15:11:00 user nova-compute[72239]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac (non-flash)
Jul 31 15:11:00 user nova-compute[72239]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f (non-flash)
Jul 31 15:11:00 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 (non-flash)
Jul 31 15:11:00 user nova-compute[72239]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac (non-flash)
Jul 31 15:11:00 user nova-compute[72239]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f (non-flash)
Jul 31 15:11:00 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4126b345e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723'): ({'sdc'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Removing single pathed devices sdc {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd51a30-801f-4c11-bfe5-5b05a8845cb2]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5a824f-eb68-4e48-a98e-40d17e0844fd]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Flushing IO for device /dev/sdc {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65a1a06-2a7a-4c1f-a1b1-291f100813bf]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b51ab3-e684-4619-8c58-538926d810b6]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] SCSI volumes sdc have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7734dc-ace9-4f49-a376-f423f0d33869]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1031b5-160d-4076-b405-ce1cb3e06a80]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723, portal: 172.16.0.220,3260]
Jul 31 15:11:00 user nova-compute[72239]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723, portal: 172.16.0.220,3260] successful.
Jul 31 15:11:00 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.125s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d5129b-22be-4b31-b4d5-4a0fa4c3bc61]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] <== disconnect_volume: return (379ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 15:11:00 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Deleting instance files /opt/stack/data/nova/instances/f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0_del
Jul 31 15:11:00 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Deletion of /opt/stack/data/nova/instances/f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0_del complete
Jul 31 15:11:00 user nova-compute[72239]: DEBUG nova.network.neutron [req-15865762-367d-4801-9af4-e074e4cffa5e req-63be8eb1-1d6c-423a-8f49-a3e17206fd95 service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Updated VIF entry in instance network info cache for port 64213693-d706-4784-81b5-74a181309dd4. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG nova.network.neutron [req-15865762-367d-4801-9af4-e074e4cffa5e req-63be8eb1-1d6c-423a-8f49-a3e17206fd95 service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Updating instance_info_cache with network_info: [{"id": "64213693-d706-4784-81b5-74a181309dd4", "address": "fa:16:3e:b2:e3:7d", "network": {"id": "cbc10aaa-d0d9-4abe-bf51-17206a8f085a", "bridge": null, "label": "tempest-TestShelveInstance-1222279697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba645b8f83ca4a15a1a6659572778375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap64213693-d7", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:11:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-15865762-367d-4801-9af4-e074e4cffa5e req-63be8eb1-1d6c-423a-8f49-a3e17206fd95 service nova] Releasing lock "refresh_cache-f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:11:01 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Deleted allocations for instance f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0
Jul 31 15:11:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:11:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:11:01 user nova-compute[72239]: DEBUG nova.objects.instance [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lazy-loading 'numa_topology' on Instance uuid f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:11:01 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:11:01 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:11:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.170s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:11:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-0c8b596d-c298-476d-8239-83f1ef2e8ff9 tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.561s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:11:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:11:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:11:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:11:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:11:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:11:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1103812e-826d-4996-94b5-8172e5b99efd tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Acquiring lock "f98cea94-e905-47c5-bf88-5f5694934966" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:11:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1103812e-826d-4996-94b5-8172e5b99efd tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Lock "f98cea94-e905-47c5-bf88-5f5694934966" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:11:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1103812e-826d-4996-94b5-8172e5b99efd tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Acquiring lock "f98cea94-e905-47c5-bf88-5f5694934966-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:11:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1103812e-826d-4996-94b5-8172e5b99efd tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Lock "f98cea94-e905-47c5-bf88-5f5694934966-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:11:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1103812e-826d-4996-94b5-8172e5b99efd tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Lock "f98cea94-e905-47c5-bf88-5f5694934966-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:11:13 user nova-compute[72239]: INFO nova.compute.manager [None req-1103812e-826d-4996-94b5-8172e5b99efd tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Terminating instance
Jul 31 15:11:13 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1103812e-826d-4996-94b5-8172e5b99efd tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 15:11:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:11:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:11:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:11:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:11:13 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Instance destroyed successfully.
Jul 31 15:11:13 user nova-compute[72239]: DEBUG nova.objects.instance [None req-1103812e-826d-4996-94b5-8172e5b99efd tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Lazy-loading 'resources' on Instance uuid f98cea94-e905-47c5-bf88-5f5694934966 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:11:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-1103812e-826d-4996-94b5-8172e5b99efd tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:02:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-624613072',display_name='tempest-ServersNegativeTestJSON-server-624613072',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-624613072',id=36,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-31T15:02:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='36f4d01080114839b14b23997a4dc1f3',ramdisk_id='',reservation_id='r-4k5yo3y3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-628169841',owner_user_name='tempest-ServersNegativeTestJSON-628169841-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T15:02:22Z,user_data=None,user_id='21222ab2b99941978eb3c3e511547e65',uuid=f98cea94-e905-47c5-bf88-5f5694934966,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9134cdf-ef4b-442f-8a86-313a3a2d5fdf", "address": "fa:16:3e:ce:31:50", "network": {"id": "afcad268-9e48-452e-ae62-cbeaf3f538dd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-791822524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f4d01080114839b14b23997a4dc1f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9134cdf-ef", "ovs_interfaceid": "d9134cdf-ef4b-442f-8a86-313a3a2d5fdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 15:11:13 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-1103812e-826d-4996-94b5-8172e5b99efd tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Converting VIF {"id": "d9134cdf-ef4b-442f-8a86-313a3a2d5fdf", "address": "fa:16:3e:ce:31:50", "network": {"id": "afcad268-9e48-452e-ae62-cbeaf3f538dd", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-791822524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "36f4d01080114839b14b23997a4dc1f3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9134cdf-ef", "ovs_interfaceid": "d9134cdf-ef4b-442f-8a86-313a3a2d5fdf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:11:13 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-1103812e-826d-4996-94b5-8172e5b99efd tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:31:50,bridge_name='br-int',has_traffic_filtering=True,id=d9134cdf-ef4b-442f-8a86-313a3a2d5fdf,network=Network(afcad268-9e48-452e-ae62-cbeaf3f538dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9134cdf-ef') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:11:13 user nova-compute[72239]: DEBUG os_vif [None req-1103812e-826d-4996-94b5-8172e5b99efd tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:31:50,bridge_name='br-int',has_traffic_filtering=True,id=d9134cdf-ef4b-442f-8a86-313a3a2d5fdf,network=Network(afcad268-9e48-452e-ae62-cbeaf3f538dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9134cdf-ef') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 15:11:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:11:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9134cdf-ef, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:11:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:11:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:11:13 user nova-compute[72239]: INFO os_vif [None req-1103812e-826d-4996-94b5-8172e5b99efd tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:31:50,bridge_name='br-int',has_traffic_filtering=True,id=d9134cdf-ef4b-442f-8a86-313a3a2d5fdf,network=Network(afcad268-9e48-452e-ae62-cbeaf3f538dd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9134cdf-ef')
Jul 31 15:11:13 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-1103812e-826d-4996-94b5-8172e5b99efd tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Deleting instance files /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966_del
Jul 31 15:11:13 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-1103812e-826d-4996-94b5-8172e5b99efd tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Deletion of /opt/stack/data/nova/instances/f98cea94-e905-47c5-bf88-5f5694934966_del complete
Jul 31 15:11:13 user nova-compute[72239]: INFO nova.compute.manager [None req-1103812e-826d-4996-94b5-8172e5b99efd tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Took 0.63 seconds to destroy the instance on the hypervisor.
Jul 31 15:11:13 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-1103812e-826d-4996-94b5-8172e5b99efd tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 15:11:13 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 15:11:13 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: f98cea94-e905-47c5-bf88-5f5694934966] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 15:11:13 user nova-compute[72239]: DEBUG nova.compute.manager [req-63d655b4-3fe4-4b7c-949e-4ac4ef5dec78 req-85445463-d01a-4346-b479-962cddeed63d service nova] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Received event network-vif-unplugged-d9134cdf-ef4b-442f-8a86-313a3a2d5fdf {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:11:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-63d655b4-3fe4-4b7c-949e-4ac4ef5dec78 req-85445463-d01a-4346-b479-962cddeed63d service nova] Acquiring lock "f98cea94-e905-47c5-bf88-5f5694934966-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:11:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-63d655b4-3fe4-4b7c-949e-4ac4ef5dec78 req-85445463-d01a-4346-b479-962cddeed63d service nova] Lock "f98cea94-e905-47c5-bf88-5f5694934966-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:11:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-63d655b4-3fe4-4b7c-949e-4ac4ef5dec78 req-85445463-d01a-4346-b479-962cddeed63d service nova] Lock "f98cea94-e905-47c5-bf88-5f5694934966-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:11:13 user nova-compute[72239]: DEBUG nova.compute.manager [req-63d655b4-3fe4-4b7c-949e-4ac4ef5dec78 req-85445463-d01a-4346-b479-962cddeed63d service nova] [instance: f98cea94-e905-47c5-bf88-5f5694934966] No waiting events found dispatching network-vif-unplugged-d9134cdf-ef4b-442f-8a86-313a3a2d5fdf {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:11:13 user nova-compute[72239]: DEBUG nova.compute.manager [req-63d655b4-3fe4-4b7c-949e-4ac4ef5dec78 req-85445463-d01a-4346-b479-962cddeed63d service nova] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Received event network-vif-unplugged-d9134cdf-ef4b-442f-8a86-313a3a2d5fdf for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 15:11:14 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690816259.220701, f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0 => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:11:14 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] VM Stopped (Lifecycle Event)
Jul 31 15:11:14 user nova-compute[72239]: DEBUG nova.compute.manager [None req-837cabef-aaac-49a8-b846-34f670728b3e None None] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:11:14 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:11:14 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Took 0.64 seconds to deallocate network for instance.
Jul 31 15:11:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1103812e-826d-4996-94b5-8172e5b99efd tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:11:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1103812e-826d-4996-94b5-8172e5b99efd tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:11:14 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:11:14 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-1103812e-826d-4996-94b5-8172e5b99efd tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:11:14 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-1103812e-826d-4996-94b5-8172e5b99efd tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:11:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1103812e-826d-4996-94b5-8172e5b99efd tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.151s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:11:14 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-1103812e-826d-4996-94b5-8172e5b99efd tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Deleted allocations for instance f98cea94-e905-47c5-bf88-5f5694934966
Jul 31 15:11:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1103812e-826d-4996-94b5-8172e5b99efd tempest-ServersNegativeTestJSON-628169841 tempest-ServersNegativeTestJSON-628169841-project-member] Lock "f98cea94-e905-47c5-bf88-5f5694934966" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.604s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:11:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:11:15 user nova-compute[72239]: DEBUG nova.compute.manager [req-610f5db8-3e8f-4884-9e58-95706f2de2c8 req-73bd3f68-d80f-4a2a-b83e-57034ea739a1 service nova] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Received event network-vif-plugged-d9134cdf-ef4b-442f-8a86-313a3a2d5fdf {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:11:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-610f5db8-3e8f-4884-9e58-95706f2de2c8 req-73bd3f68-d80f-4a2a-b83e-57034ea739a1 service nova] Acquiring lock "f98cea94-e905-47c5-bf88-5f5694934966-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:11:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-610f5db8-3e8f-4884-9e58-95706f2de2c8 req-73bd3f68-d80f-4a2a-b83e-57034ea739a1 service nova] Lock "f98cea94-e905-47c5-bf88-5f5694934966-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:11:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-610f5db8-3e8f-4884-9e58-95706f2de2c8 req-73bd3f68-d80f-4a2a-b83e-57034ea739a1 service nova] Lock "f98cea94-e905-47c5-bf88-5f5694934966-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:11:15 user nova-compute[72239]: DEBUG nova.compute.manager [req-610f5db8-3e8f-4884-9e58-95706f2de2c8 req-73bd3f68-d80f-4a2a-b83e-57034ea739a1 service nova] [instance: f98cea94-e905-47c5-bf88-5f5694934966] No waiting events found dispatching network-vif-plugged-d9134cdf-ef4b-442f-8a86-313a3a2d5fdf {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:11:15 user nova-compute[72239]: WARNING nova.compute.manager [req-610f5db8-3e8f-4884-9e58-95706f2de2c8 req-73bd3f68-d80f-4a2a-b83e-57034ea739a1 service nova] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Received unexpected event network-vif-plugged-d9134cdf-ef4b-442f-8a86-313a3a2d5fdf for instance with vm_state deleted and task_state None.
Jul 31 15:11:15 user nova-compute[72239]: DEBUG nova.compute.manager [req-610f5db8-3e8f-4884-9e58-95706f2de2c8 req-73bd3f68-d80f-4a2a-b83e-57034ea739a1 service nova] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Received event network-vif-deleted-d9134cdf-ef4b-442f-8a86-313a3a2d5fdf {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:11:16 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:11:18 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:11:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:11:19 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:11:21 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:11:21 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 15:11:21 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Rebuilding the list of instances to heal {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 15:11:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-bf7b3a30-776f-406b-9e38-db804c098e93" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:11:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-bf7b3a30-776f-406b-9e38-db804c098e93" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:11:21 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 15:11:21 user nova-compute[72239]: DEBUG nova.objects.instance [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lazy-loading 'info_cache' on Instance uuid bf7b3a30-776f-406b-9e38-db804c098e93 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:11:22 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Updating instance_info_cache with network_info: [{"id": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "address": "fa:16:3e:a7:1b:0c", "network": {"id": "b9eb37b6-27e4-4d9e-bfb2-7e167766e547", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1162541993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37ae523240a47bb936ef4b54994de61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fcc6557-b0", "ovs_interfaceid": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:11:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-bf7b3a30-776f-406b-9e38-db804c098e93" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:11:22 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 15:11:22 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:11:23 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:11:24 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:11:25 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:11:25 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 15:11:26 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:11:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:11:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:11:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:11:26 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 15:11:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:11:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:11:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:11:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:11:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 15:11:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 15:11:27 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:11:27 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:11:27 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=8428MB free_disk=25.157875061035156GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 15:11:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:11:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:11:27 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance bf7b3a30-776f-406b-9e38-db804c098e93 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:11:27 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance fc5e6dfe-def8-47cb-8639-d93a39cfeeaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:11:27 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 15:11:27 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 15:11:27 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:11:27 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:11:27 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 15:11:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.213s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:11:28 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690816273.6271093, f98cea94-e905-47c5-bf88-5f5694934966 => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:11:28 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: f98cea94-e905-47c5-bf88-5f5694934966] VM Stopped (Lifecycle Event)
Jul 31 15:11:28 user nova-compute[72239]: DEBUG nova.compute.manager [None req-f1b72d43-8e0c-4709-a682-4dfa4e200a12 None None] [instance: f98cea94-e905-47c5-bf88-5f5694934966] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:11:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:11:30 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:11:33 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:11:38 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:11:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:11:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:11:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:11:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:11:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:12:03 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:12:06 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:12:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:12:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:12:16 user nova-compute[72239]: DEBUG nova.compute.manager [req-d6ce9817-8bc6-4e7d-8f79-2af0c846753c req-b78d6fe3-078d-4ac0-9b39-f07547013d4c service nova] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Received event network-changed-21545375-78db-48b9-b32d-37349f2f809b {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:12:16 user nova-compute[72239]: DEBUG nova.compute.manager [req-d6ce9817-8bc6-4e7d-8f79-2af0c846753c req-b78d6fe3-078d-4ac0-9b39-f07547013d4c service nova] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Refreshing instance network info cache due to event network-changed-21545375-78db-48b9-b32d-37349f2f809b. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:12:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d6ce9817-8bc6-4e7d-8f79-2af0c846753c req-b78d6fe3-078d-4ac0-9b39-f07547013d4c service nova] Acquiring lock "refresh_cache-fc5e6dfe-def8-47cb-8639-d93a39cfeeaa" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:12:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d6ce9817-8bc6-4e7d-8f79-2af0c846753c req-b78d6fe3-078d-4ac0-9b39-f07547013d4c service nova] Acquired lock "refresh_cache-fc5e6dfe-def8-47cb-8639-d93a39cfeeaa" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:12:16 user nova-compute[72239]: DEBUG nova.network.neutron [req-d6ce9817-8bc6-4e7d-8f79-2af0c846753c req-b78d6fe3-078d-4ac0-9b39-f07547013d4c service nova] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Refreshing network info cache for port 21545375-78db-48b9-b32d-37349f2f809b {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:12:16 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:12:16 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:12:16 user nova-compute[72239]: DEBUG nova.network.neutron [req-d6ce9817-8bc6-4e7d-8f79-2af0c846753c req-b78d6fe3-078d-4ac0-9b39-f07547013d4c service nova] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Updated VIF entry in instance network info cache for port 21545375-78db-48b9-b32d-37349f2f809b. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:12:16 user nova-compute[72239]: DEBUG nova.network.neutron [req-d6ce9817-8bc6-4e7d-8f79-2af0c846753c req-b78d6fe3-078d-4ac0-9b39-f07547013d4c service nova] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Updating instance_info_cache with network_info: [{"id": "21545375-78db-48b9-b32d-37349f2f809b", "address": "fa:16:3e:96:5d:34", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21545375-78", "ovs_interfaceid": "21545375-78db-48b9-b32d-37349f2f809b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:12:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d6ce9817-8bc6-4e7d-8f79-2af0c846753c req-b78d6fe3-078d-4ac0-9b39-f07547013d4c service nova] Releasing lock "refresh_cache-fc5e6dfe-def8-47cb-8639-d93a39cfeeaa" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:12:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:12:19 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:12:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:12:21 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:12:21 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 15:12:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-fc5e6dfe-def8-47cb-8639-d93a39cfeeaa" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:12:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-fc5e6dfe-def8-47cb-8639-d93a39cfeeaa" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:12:21 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 15:12:22 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Updating instance_info_cache with network_info: [{"id": "21545375-78db-48b9-b32d-37349f2f809b", "address": "fa:16:3e:96:5d:34", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21545375-78", "ovs_interfaceid": "21545375-78db-48b9-b32d-37349f2f809b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:12:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-fc5e6dfe-def8-47cb-8639-d93a39cfeeaa" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:12:22 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 15:12:22 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:12:23 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:12:24 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:12:24 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:12:24 user nova-compute[72239]: DEBUG nova.compute.manager [req-888a0829-48d3-45a9-84df-dd86542caa96 req-cdca93a4-aaff-4fbc-bfba-08d8b1032276 service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Received event network-changed-0fcc6557-b09c-4149-8458-ac4f1bf6ffcf {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:12:24 user nova-compute[72239]: DEBUG nova.compute.manager [req-888a0829-48d3-45a9-84df-dd86542caa96 req-cdca93a4-aaff-4fbc-bfba-08d8b1032276 service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Refreshing instance network info cache due to event network-changed-0fcc6557-b09c-4149-8458-ac4f1bf6ffcf. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:12:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-888a0829-48d3-45a9-84df-dd86542caa96 req-cdca93a4-aaff-4fbc-bfba-08d8b1032276 service nova] Acquiring lock "refresh_cache-bf7b3a30-776f-406b-9e38-db804c098e93" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:12:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-888a0829-48d3-45a9-84df-dd86542caa96 req-cdca93a4-aaff-4fbc-bfba-08d8b1032276 service nova] Acquired lock "refresh_cache-bf7b3a30-776f-406b-9e38-db804c098e93" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:12:24 user nova-compute[72239]: DEBUG nova.network.neutron [req-888a0829-48d3-45a9-84df-dd86542caa96 req-cdca93a4-aaff-4fbc-bfba-08d8b1032276 service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Refreshing network info cache for port 0fcc6557-b09c-4149-8458-ac4f1bf6ffcf {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:12:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:12:25 user nova-compute[72239]: DEBUG nova.compute.manager [req-5acb8fd6-616c-49ae-859f-c38e93d1f5a7 req-70a578fe-1104-4601-beac-bccbd6978de7 service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Received event network-changed-0fcc6557-b09c-4149-8458-ac4f1bf6ffcf {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:12:25 user nova-compute[72239]: DEBUG nova.compute.manager [req-5acb8fd6-616c-49ae-859f-c38e93d1f5a7 req-70a578fe-1104-4601-beac-bccbd6978de7 service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Refreshing instance network info cache due to event network-changed-0fcc6557-b09c-4149-8458-ac4f1bf6ffcf. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:12:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5acb8fd6-616c-49ae-859f-c38e93d1f5a7 req-70a578fe-1104-4601-beac-bccbd6978de7 service nova] Acquiring lock "refresh_cache-bf7b3a30-776f-406b-9e38-db804c098e93" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:12:25 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:12:25 user nova-compute[72239]: DEBUG nova.network.neutron [req-888a0829-48d3-45a9-84df-dd86542caa96 req-cdca93a4-aaff-4fbc-bfba-08d8b1032276 service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Updated VIF entry in instance network info cache for port 0fcc6557-b09c-4149-8458-ac4f1bf6ffcf. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:12:25 user nova-compute[72239]: DEBUG nova.network.neutron [req-888a0829-48d3-45a9-84df-dd86542caa96 req-cdca93a4-aaff-4fbc-bfba-08d8b1032276 service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Updating instance_info_cache with network_info: [{"id": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "address": "fa:16:3e:a7:1b:0c", "network": {"id": "b9eb37b6-27e4-4d9e-bfb2-7e167766e547", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1162541993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37ae523240a47bb936ef4b54994de61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fcc6557-b0", "ovs_interfaceid": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:12:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-888a0829-48d3-45a9-84df-dd86542caa96 req-cdca93a4-aaff-4fbc-bfba-08d8b1032276 service nova] Releasing lock "refresh_cache-bf7b3a30-776f-406b-9e38-db804c098e93" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:12:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5acb8fd6-616c-49ae-859f-c38e93d1f5a7 req-70a578fe-1104-4601-beac-bccbd6978de7 service nova] Acquired lock "refresh_cache-bf7b3a30-776f-406b-9e38-db804c098e93" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:12:25 user nova-compute[72239]: DEBUG nova.network.neutron [req-5acb8fd6-616c-49ae-859f-c38e93d1f5a7 req-70a578fe-1104-4601-beac-bccbd6978de7 service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Refreshing network info cache for port 0fcc6557-b09c-4149-8458-ac4f1bf6ffcf {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:12:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-76dfaea0-1710-40c3-81bb-42bde7e8aaa6 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquiring lock "bf7b3a30-776f-406b-9e38-db804c098e93" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:12:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-76dfaea0-1710-40c3-81bb-42bde7e8aaa6 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "bf7b3a30-776f-406b-9e38-db804c098e93" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:12:25 user nova-compute[72239]: INFO nova.compute.manager [None req-76dfaea0-1710-40c3-81bb-42bde7e8aaa6 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Detaching volume 741ede6d-9229-4264-afcb-c9b03372aa2f
Jul 31 15:12:25 user nova-compute[72239]: INFO nova.virt.block_device [None req-76dfaea0-1710-40c3-81bb-42bde7e8aaa6 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Attempting to driver detach volume 741ede6d-9229-4264-afcb-c9b03372aa2f from mountpoint /dev/vdb
Jul 31 15:12:25 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-76dfaea0-1710-40c3-81bb-42bde7e8aaa6 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Attempting to detach device vdb from instance bf7b3a30-776f-406b-9e38-db804c098e93 from the persistent domain config. {{(pid=72239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 15:12:25 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-76dfaea0-1710-40c3-81bb-42bde7e8aaa6 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 15:12:25 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:12:25 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 15:12:25 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 15:12:25 user nova-compute[72239]:   <serial>741ede6d-9229-4264-afcb-c9b03372aa2f</serial>
Jul 31 15:12:25 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 31 15:12:25 user nova-compute[72239]: </disk>
Jul 31 15:12:25 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 15:12:25 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-76dfaea0-1710-40c3-81bb-42bde7e8aaa6 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Successfully detached device vdb from instance bf7b3a30-776f-406b-9e38-db804c098e93 from the persistent domain config.
Jul 31 15:12:25 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-76dfaea0-1710-40c3-81bb-42bde7e8aaa6 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bf7b3a30-776f-406b-9e38-db804c098e93 from the live domain config. {{(pid=72239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 15:12:25 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-76dfaea0-1710-40c3-81bb-42bde7e8aaa6 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 15:12:25 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:12:25 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 15:12:25 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 15:12:25 user nova-compute[72239]:   <serial>741ede6d-9229-4264-afcb-c9b03372aa2f</serial>
Jul 31 15:12:25 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 31 15:12:25 user nova-compute[72239]: </disk>
Jul 31 15:12:25 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Received event <DeviceRemovedEvent: 1690816346.1211069, bf7b3a30-776f-406b-9e38-db804c098e93 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72239) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-76dfaea0-1710-40c3-81bb-42bde7e8aaa6 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bf7b3a30-776f-406b-9e38-db804c098e93 {{(pid=72239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 15:12:26 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-76dfaea0-1710-40c3-81bb-42bde7e8aaa6 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Successfully detached device vdb from instance bf7b3a30-776f-406b-9e38-db804c098e93 from the live domain config.
Jul 31 15:12:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76dfaea0-1710-40c3-81bb-42bde7e8aaa6 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-76dfaea0-1710-40c3-81bb-42bde7e8aaa6 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGXcyAOb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:12:26 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-76dfaea0-1710-40c3-81bb-42bde7e8aaa6 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:12:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-76dfaea0-1710-40c3-81bb-42bde7e8aaa6 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-76dfaea0-1710-40c3-81bb-42bde7e8aaa6 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-76dfaea0-1710-40c3-81bb-42bde7e8aaa6 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[458f85a4-ed5c-4a98-a29d-bc3ee86a3a81]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40b4aac-9abd-4dd1-8a41-8a60590e05a9]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-76dfaea0-1710-40c3-81bb-42bde7e8aaa6 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac (non-flash)
Jul 31 15:12:26 user nova-compute[72239]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f (non-flash)
Jul 31 15:12:26 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-76dfaea0-1710-40c3-81bb-42bde7e8aaa6 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac (non-flash)
Jul 31 15:12:26 user nova-compute[72239]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f (non-flash)
Jul 31 15:12:26 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-76dfaea0-1710-40c3-81bb-42bde7e8aaa6 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41201557e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f'): ({'sdb'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-76dfaea0-1710-40c3-81bb-42bde7e8aaa6 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Removing single pathed devices sdb {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.055s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1ec33c-0d06-48fe-b01d-20fc45ec2576]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b76b62-e37d-4f3b-9278-cc2ca2b80582]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-76dfaea0-1710-40c3-81bb-42bde7e8aaa6 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Flushing IO for device /dev/sdb {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG nova.network.neutron [req-5acb8fd6-616c-49ae-859f-c38e93d1f5a7 req-70a578fe-1104-4601-beac-bccbd6978de7 service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Updated VIF entry in instance network info cache for port 0fcc6557-b09c-4149-8458-ac4f1bf6ffcf. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG nova.network.neutron [req-5acb8fd6-616c-49ae-859f-c38e93d1f5a7 req-70a578fe-1104-4601-beac-bccbd6978de7 service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Updating instance_info_cache with network_info: [{"id": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "address": "fa:16:3e:a7:1b:0c", "network": {"id": "b9eb37b6-27e4-4d9e-bfb2-7e167766e547", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1162541993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37ae523240a47bb936ef4b54994de61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fcc6557-b0", "ovs_interfaceid": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7beab8d6-4fe2-4348-ae40-7569d6217f23]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-76dfaea0-1710-40c3-81bb-42bde7e8aaa6 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5acb8fd6-616c-49ae-859f-c38e93d1f5a7 req-70a578fe-1104-4601-beac-bccbd6978de7 service nova] Releasing lock "refresh_cache-bf7b3a30-776f-406b-9e38-db804c098e93" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[81db34f5-9a9e-4946-bfa2-38fd509875fc]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-76dfaea0-1710-40c3-81bb-42bde7e8aaa6 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-76dfaea0-1710-40c3-81bb-42bde7e8aaa6 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-76dfaea0-1710-40c3-81bb-42bde7e8aaa6 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07c5491-c9e9-4967-a53e-e255d935ba25]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-76dfaea0-1710-40c3-81bb-42bde7e8aaa6 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[97503d41-aed2-427a-8d3d-5302f7b2929f]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-76dfaea0-1710-40c3-81bb-42bde7e8aaa6 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f, portal: 172.16.0.220,3260]
Jul 31 15:12:26 user nova-compute[72239]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f, portal: 172.16.0.220,3260] successful.
Jul 31 15:12:26 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:741ede6d-9229-4264-afcb-c9b03372aa2f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c12ccf-2584-45aa-a5f8-d8c9f36ac5bd]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-76dfaea0-1710-40c3-81bb-42bde7e8aaa6 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-76dfaea0-1710-40c3-81bb-42bde7e8aaa6 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-76dfaea0-1710-40c3-81bb-42bde7e8aaa6 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] <== disconnect_volume: return (332ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:12:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76dfaea0-1710-40c3-81bb-42bde7e8aaa6 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 15:12:27 user nova-compute[72239]: DEBUG nova.objects.instance [None req-76dfaea0-1710-40c3-81bb-42bde7e8aaa6 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lazy-loading 'flavor' on Instance uuid bf7b3a30-776f-406b-9e38-db804c098e93 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:12:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-76dfaea0-1710-40c3-81bb-42bde7e8aaa6 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "bf7b3a30-776f-406b-9e38-db804c098e93" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.778s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:12:27 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:12:27 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 15:12:27 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:12:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:12:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:12:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:12:27 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 15:12:27 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:12:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "27004836-5fb4-49cc-8be9-db2afef945a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:12:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "27004836-5fb4-49cc-8be9-db2afef945a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:12:27 user nova-compute[72239]: DEBUG nova.compute.manager [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 15:12:27 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:12:27 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:12:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:12:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:12:27 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 15:12:27 user nova-compute[72239]: INFO nova.compute.claims [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Claim successful on node user
Jul 31 15:12:27 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:12:27 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 15:12:28 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:12:28 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:12:28 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=8600MB free_disk=25.14769744873047GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 15:12:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:12:28 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:12:28 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:12:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.683s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:12:28 user nova-compute[72239]: DEBUG nova.compute.manager [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 15:12:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.099s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:12:28 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 15:12:28 user nova-compute[72239]: DEBUG nova.compute.manager [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 15:12:28 user nova-compute[72239]: DEBUG nova.network.neutron [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 15:12:28 user nova-compute[72239]: DEBUG nova.compute.manager [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 15:12:28 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance bf7b3a30-776f-406b-9e38-db804c098e93 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:12:28 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance fc5e6dfe-def8-47cb-8639-d93a39cfeeaa actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:12:28 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 27004836-5fb4-49cc-8be9-db2afef945a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:12:28 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 15:12:28 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 15:12:28 user nova-compute[72239]: INFO nova.virt.block_device [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Booting with volume snapshot e2f07914-58c2-4b87-8ab4-b355a6434fdd at /dev/vda
Jul 31 15:12:28 user nova-compute[72239]: DEBUG nova.policy [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a73969a32be54c8caf621290e8823134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aaefdc03aa4e43b4ba435eea373cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 15:12:28 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:12:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:12:28 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:12:28 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 15:12:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.228s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:12:29 user nova-compute[72239]: DEBUG nova.network.neutron [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Successfully created port: 20a43068-68ab-4588-a2b1-4ca7d685e504 {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 15:12:30 user nova-compute[72239]: DEBUG nova.network.neutron [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Successfully updated port: 20a43068-68ab-4588-a2b1-4ca7d685e504 {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 15:12:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "refresh_cache-27004836-5fb4-49cc-8be9-db2afef945a7" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:12:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquired lock "refresh_cache-27004836-5fb4-49cc-8be9-db2afef945a7" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:12:30 user nova-compute[72239]: DEBUG nova.network.neutron [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 15:12:30 user nova-compute[72239]: DEBUG nova.compute.manager [req-4169251f-8133-4fee-a2b2-371ab363e598 req-b7a9585b-94e5-46af-bdff-7a6851c2e370 service nova] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Received event network-changed-20a43068-68ab-4588-a2b1-4ca7d685e504 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:12:30 user nova-compute[72239]: DEBUG nova.compute.manager [req-4169251f-8133-4fee-a2b2-371ab363e598 req-b7a9585b-94e5-46af-bdff-7a6851c2e370 service nova] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Refreshing instance network info cache due to event network-changed-20a43068-68ab-4588-a2b1-4ca7d685e504. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:12:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-4169251f-8133-4fee-a2b2-371ab363e598 req-b7a9585b-94e5-46af-bdff-7a6851c2e370 service nova] Acquiring lock "refresh_cache-27004836-5fb4-49cc-8be9-db2afef945a7" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:12:30 user nova-compute[72239]: DEBUG nova.network.neutron [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 15:12:30 user nova-compute[72239]: DEBUG nova.network.neutron [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Updating instance_info_cache with network_info: [{"id": "20a43068-68ab-4588-a2b1-4ca7d685e504", "address": "fa:16:3e:86:f7:39", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20a43068-68", "ovs_interfaceid": "20a43068-68ab-4588-a2b1-4ca7d685e504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:12:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Releasing lock "refresh_cache-27004836-5fb4-49cc-8be9-db2afef945a7" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:12:30 user nova-compute[72239]: DEBUG nova.compute.manager [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Instance network_info: |[{"id": "20a43068-68ab-4588-a2b1-4ca7d685e504", "address": "fa:16:3e:86:f7:39", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20a43068-68", "ovs_interfaceid": "20a43068-68ab-4588-a2b1-4ca7d685e504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 15:12:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-4169251f-8133-4fee-a2b2-371ab363e598 req-b7a9585b-94e5-46af-bdff-7a6851c2e370 service nova] Acquired lock "refresh_cache-27004836-5fb4-49cc-8be9-db2afef945a7" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:12:30 user nova-compute[72239]: DEBUG nova.network.neutron [req-4169251f-8133-4fee-a2b2-371ab363e598 req-b7a9585b-94e5-46af-bdff-7a6851c2e370 service nova] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Refreshing network info cache for port 20a43068-68ab-4588-a2b1-4ca7d685e504 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:12:30 user nova-compute[72239]: DEBUG nova.network.neutron [req-4169251f-8133-4fee-a2b2-371ab363e598 req-b7a9585b-94e5-46af-bdff-7a6851c2e370 service nova] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Updated VIF entry in instance network info cache for port 20a43068-68ab-4588-a2b1-4ca7d685e504. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:12:30 user nova-compute[72239]: DEBUG nova.network.neutron [req-4169251f-8133-4fee-a2b2-371ab363e598 req-b7a9585b-94e5-46af-bdff-7a6851c2e370 service nova] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Updating instance_info_cache with network_info: [{"id": "20a43068-68ab-4588-a2b1-4ca7d685e504", "address": "fa:16:3e:86:f7:39", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20a43068-68", "ovs_interfaceid": "20a43068-68ab-4588-a2b1-4ca7d685e504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:12:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-4169251f-8133-4fee-a2b2-371ab363e598 req-b7a9585b-94e5-46af-bdff-7a6851c2e370 service nova] Releasing lock "refresh_cache-27004836-5fb4-49cc-8be9-db2afef945a7" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:12:33 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:12:34 user nova-compute[72239]: DEBUG os_brick.utils [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:12:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:12:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:12:34 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[721fcf9b-6f9c-4e1b-8082-e4fdff6405a6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:12:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:12:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:12:34 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e787f4c-06c9-49f7-b1c9-52fd9c1ce833]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:12:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:12:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:12:34 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[125a029b-0638-4188-a873-6341820faad9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:12:34 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeaaf844-3b6c-400f-9eb3-6858167b3d48]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:12:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:12:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:12:34 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 15:12:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:12:34 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:12:34 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 15:12:34 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1255c967-ba14-4cb9-8b6e-8a335bac18ff]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:12:34 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 15:12:34 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 15:12:34 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 15:12:34 user nova-compute[72239]: DEBUG os_brick.utils [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:12:34 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Updating existing volume attachment record: 267653ed-f46a-4e6a-b834-14b71d5ada75 {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 15:12:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:12:38 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG nova.compute.manager [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 15:12:41 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Creating image(s)
Jul 31 15:12:41 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Did not create local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Ensure instance console log exists: /opt/stack/data/nova/instances/27004836-5fb4-49cc-8be9-db2afef945a7/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Start _get_guest_xml network_info=[{"id": "20a43068-68ab-4588-a2b1-4ca7d685e504", "address": "fa:16:3e:86:f7:39", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20a43068-68", "ovs_interfaceid": "20a43068-68ab-4588-a2b1-4ca7d685e504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-07-31T15:12:18Z,direct_url=<?>,disk_format='qcow2',id=a95cd1aa-ca86-42b9-a4de-7596e427fe1b,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2137580934',owner='35aaefdc03aa4e43b4ba435eea373cc4',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-07-31T15:12:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '267653ed-f46a-4e6a-b834-14b71d5ada75', 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yveElKGF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '27004836-5fb4-49cc-8be9-db2afef945a7', 'attached_at': '', 'detached_at': '', 'volume_id': 'ef107601-5f4e-462d-ac0e-9023530cefc8', 'serial': 'ef107601-5f4e-462d-ac0e-9023530cefc8'}, 'delete_on_termination': True, 'guest_format': None, 'volume_type': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 15:12:41 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:12:41 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:12:41 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-07-31T15:12:18Z,direct_url=<?>,disk_format='qcow2',id=a95cd1aa-ca86-42b9-a4de-7596e427fe1b,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2137580934',owner='35aaefdc03aa4e43b4ba435eea373cc4',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-07-31T15:12:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yveElKGF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:12:41 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:12:41 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:12:41 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:12:41 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:12:41 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 15:12:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8 -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf66d34-8322-46da-b9e5-f63120abb17f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 15:12:41 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8 -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[011285a3-8d5d-4b37-8415-bd13f559a504]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8] added
Jul 31 15:12:41 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ebd368-0fba-4425-ba99-977b32d6bee3]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6917edb3-be9a-44f2-8cd9-f098d5930c05]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yveElKGF {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yveElKGF" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb448ac-8800-4519-a9c9-af676a271712]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yveElKGF'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:12:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:12:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:12:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6783ab8-c0ff-4f78-a8e4-7b940568e2fb]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:12:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:12:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:12:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:12:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ac8fa2-57db-476d-841e-1416627217e3]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:12:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac (non-flash)
Jul 31 15:12:42 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:12:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac (non-flash)
Jul 31 15:12:42 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:12:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8 -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:12:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:12:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[608e4e48-9a0d-4ab6-980b-44b878ecb696]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:12:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8, portal: 172.16.0.220,3260]
Jul 31 15:12:42 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8, portal: 172.16.0.220,3260] successful.
Jul 31 15:12:42 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:12:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:12:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:12:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6553856-d712-4fd8-b0d0-a7398f3e4899]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:12:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:12:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:12:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:12:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f46ced9-0edc-4411-9f11-11780b848e36]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:12:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac (non-flash)
Jul 31 15:12:42 user nova-compute[72239]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8 (non-flash)
Jul 31 15:12:42 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:12:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac (non-flash)
Jul 31 15:12:42 user nova-compute[72239]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8 (non-flash)
Jul 31 15:12:42 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:12:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:12:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 15:12:42 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 15:12:42 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 15:12:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:12:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:12:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42af41a-e83e-4313-9fcb-ab7d59d2709f]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:12:42 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 15:12:43 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 15:12:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yveElKGF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 15:12:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:12:43 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '23832333432623664', 'path': '/dev/sdb'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:12:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23832333432623664', 'path': '/dev/sdb'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 15:12:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:12:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1986330739',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1986330739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1986330739',id=47,image_ref='a95cd1aa-ca86-42b9-a4de-7596e427fe1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaoPPLt66pWH3zE+GpPB2BEdOMFv/qPG5EbqzIXstwV/kjW3s5Z2NdK6wwRBqZIQfLd+t9vFJNxveBc96/VhhixJnD0MvqbOCyMn46h7Ph3CGLDBnI/NvjWYRZyDi1YyA==',key_name='tempest-keypair-1050593475',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35aaefdc03aa4e43b4ba435eea373cc4',ramdisk_id='',reservation_id='r-7g46u3l2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1903261024',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1903261024-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1903261024',owner_user_name='tempest-TestVolumeBootPattern-1903261024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T15:12:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a73969a32be54c8caf621290e8823134',uuid=27004836-5fb4-49cc-8be9-db2afef945a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20a43068-68ab-4588-a2b1-4ca7d685e504", "address": "fa:16:3e:86:f7:39", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20a43068-68", "ovs_interfaceid": "20a43068-68ab-4588-a2b1-4ca7d685e504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 15:12:43 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Converting VIF {"id": "20a43068-68ab-4588-a2b1-4ca7d685e504", "address": "fa:16:3e:86:f7:39", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20a43068-68", "ovs_interfaceid": "20a43068-68ab-4588-a2b1-4ca7d685e504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:12:43 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:f7:39,bridge_name='br-int',has_traffic_filtering=True,id=20a43068-68ab-4588-a2b1-4ca7d685e504,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20a43068-68') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:12:43 user nova-compute[72239]: DEBUG nova.objects.instance [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lazy-loading 'pci_devices' on Instance uuid 27004836-5fb4-49cc-8be9-db2afef945a7 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:12:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] End _get_guest_xml xml=<domain type="kvm">
Jul 31 15:12:43 user nova-compute[72239]:   <uuid>27004836-5fb4-49cc-8be9-db2afef945a7</uuid>
Jul 31 15:12:43 user nova-compute[72239]:   <name>instance-0000002f</name>
Jul 31 15:12:43 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 15:12:43 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 15:12:43 user nova-compute[72239]:   <metadata>
Jul 31 15:12:43 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 15:12:43 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 15:12:43 user nova-compute[72239]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1986330739</nova:name>
Jul 31 15:12:43 user nova-compute[72239]:       <nova:creationTime>2023-07-31 15:12:41</nova:creationTime>
Jul 31 15:12:43 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 15:12:43 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 15:12:43 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 15:12:43 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 15:12:43 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 15:12:43 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 15:12:43 user nova-compute[72239]:       </nova:flavor>
Jul 31 15:12:43 user nova-compute[72239]:       <nova:owner>
Jul 31 15:12:43 user nova-compute[72239]:         <nova:user uuid="a73969a32be54c8caf621290e8823134">tempest-TestVolumeBootPattern-1903261024-project-member</nova:user>
Jul 31 15:12:43 user nova-compute[72239]:         <nova:project uuid="35aaefdc03aa4e43b4ba435eea373cc4">tempest-TestVolumeBootPattern-1903261024</nova:project>
Jul 31 15:12:43 user nova-compute[72239]:       </nova:owner>
Jul 31 15:12:43 user nova-compute[72239]:       <nova:root type="image" uuid="a95cd1aa-ca86-42b9-a4de-7596e427fe1b"/>
Jul 31 15:12:43 user nova-compute[72239]:       <nova:ports>
Jul 31 15:12:43 user nova-compute[72239]:         <nova:port uuid="20a43068-68ab-4588-a2b1-4ca7d685e504">
Jul 31 15:12:43 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 31 15:12:43 user nova-compute[72239]:         </nova:port>
Jul 31 15:12:43 user nova-compute[72239]:       </nova:ports>
Jul 31 15:12:43 user nova-compute[72239]:     </nova:instance>
Jul 31 15:12:43 user nova-compute[72239]:   </metadata>
Jul 31 15:12:43 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 15:12:43 user nova-compute[72239]:     <system>
Jul 31 15:12:43 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 15:12:43 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 15:12:43 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 15:12:43 user nova-compute[72239]:       <entry name="serial">27004836-5fb4-49cc-8be9-db2afef945a7</entry>
Jul 31 15:12:43 user nova-compute[72239]:       <entry name="uuid">27004836-5fb4-49cc-8be9-db2afef945a7</entry>
Jul 31 15:12:43 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 15:12:43 user nova-compute[72239]:     </system>
Jul 31 15:12:43 user nova-compute[72239]:   </sysinfo>
Jul 31 15:12:43 user nova-compute[72239]:   <os>
Jul 31 15:12:43 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 15:12:43 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 15:12:43 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 15:12:43 user nova-compute[72239]:   </os>
Jul 31 15:12:43 user nova-compute[72239]:   <features>
Jul 31 15:12:43 user nova-compute[72239]:     <acpi/>
Jul 31 15:12:43 user nova-compute[72239]:     <apic/>
Jul 31 15:12:43 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 15:12:43 user nova-compute[72239]:   </features>
Jul 31 15:12:43 user nova-compute[72239]:   <clock offset="utc">
Jul 31 15:12:43 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 15:12:43 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 15:12:43 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 15:12:43 user nova-compute[72239]:   </clock>
Jul 31 15:12:43 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 15:12:43 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 15:12:43 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 15:12:43 user nova-compute[72239]:   </cpu>
Jul 31 15:12:43 user nova-compute[72239]:   <devices>
Jul 31 15:12:43 user nova-compute[72239]:     <disk type="block" device="disk">
Jul 31 15:12:43 user nova-compute[72239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:12:43 user nova-compute[72239]:       <source dev="/dev/sdb"/>
Jul 31 15:12:43 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 15:12:43 user nova-compute[72239]:       <serial>ef107601-5f4e-462d-ac0e-9023530cefc8</serial>
Jul 31 15:12:43 user nova-compute[72239]:     </disk>
Jul 31 15:12:43 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 15:12:43 user nova-compute[72239]:       <mac address="fa:16:3e:86:f7:39"/>
Jul 31 15:12:43 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:12:43 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 15:12:43 user nova-compute[72239]:       <target dev="tap20a43068-68"/>
Jul 31 15:12:43 user nova-compute[72239]:     </interface>
Jul 31 15:12:43 user nova-compute[72239]:     <serial type="pty">
Jul 31 15:12:43 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/27004836-5fb4-49cc-8be9-db2afef945a7/console.log" append="off"/>
Jul 31 15:12:43 user nova-compute[72239]:     </serial>
Jul 31 15:12:43 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 15:12:43 user nova-compute[72239]:     <video>
Jul 31 15:12:43 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:12:43 user nova-compute[72239]:     </video>
Jul 31 15:12:43 user nova-compute[72239]:     <rng model="virtio">
Jul 31 15:12:43 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 15:12:43 user nova-compute[72239]:     </rng>
Jul 31 15:12:43 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 15:12:43 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 15:12:43 user nova-compute[72239]:       <stats period="10"/>
Jul 31 15:12:43 user nova-compute[72239]:     </memballoon>
Jul 31 15:12:43 user nova-compute[72239]:   </devices>
Jul 31 15:12:43 user nova-compute[72239]: </domain>
Jul 31 15:12:43 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 15:12:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:12:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1986330739',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1986330739',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1986330739',id=47,image_ref='a95cd1aa-ca86-42b9-a4de-7596e427fe1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaoPPLt66pWH3zE+GpPB2BEdOMFv/qPG5EbqzIXstwV/kjW3s5Z2NdK6wwRBqZIQfLd+t9vFJNxveBc96/VhhixJnD0MvqbOCyMn46h7Ph3CGLDBnI/NvjWYRZyDi1YyA==',key_name='tempest-keypair-1050593475',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35aaefdc03aa4e43b4ba435eea373cc4',ramdisk_id='',reservation_id='r-7g46u3l2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1903261024',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1903261024-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1903261024',owner_user_name='tempest-TestVolumeBootPattern-1903261024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T15:12:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a73969a32be54c8caf621290e8823134',uuid=27004836-5fb4-49cc-8be9-db2afef945a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20a43068-68ab-4588-a2b1-4ca7d685e504", "address": "fa:16:3e:86:f7:39", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20a43068-68", "ovs_interfaceid": "20a43068-68ab-4588-a2b1-4ca7d685e504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 15:12:43 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Converting VIF {"id": "20a43068-68ab-4588-a2b1-4ca7d685e504", "address": "fa:16:3e:86:f7:39", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20a43068-68", "ovs_interfaceid": "20a43068-68ab-4588-a2b1-4ca7d685e504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:12:43 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:f7:39,bridge_name='br-int',has_traffic_filtering=True,id=20a43068-68ab-4588-a2b1-4ca7d685e504,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20a43068-68') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:12:43 user nova-compute[72239]: DEBUG os_vif [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:f7:39,bridge_name='br-int',has_traffic_filtering=True,id=20a43068-68ab-4588-a2b1-4ca7d685e504,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20a43068-68') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 15:12:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:12:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:12:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 15:12:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:12:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap20a43068-68, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:12:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap20a43068-68, col_values=(('external_ids', {'iface-id': '20a43068-68ab-4588-a2b1-4ca7d685e504', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:f7:39', 'vm-uuid': '27004836-5fb4-49cc-8be9-db2afef945a7'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:12:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:12:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:12:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:12:43 user nova-compute[72239]: INFO os_vif [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:f7:39,bridge_name='br-int',has_traffic_filtering=True,id=20a43068-68ab-4588-a2b1-4ca7d685e504,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20a43068-68')
Jul 31 15:12:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:12:43 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] No VIF found with MAC fa:16:3e:86:f7:39, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 15:12:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:12:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:12:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:12:44 user nova-compute[72239]: DEBUG nova.compute.manager [req-5f65be3f-fb23-4563-8e5c-369f9274f74b req-4b04569e-cf31-45e2-b042-1c69c9cf37a5 service nova] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Received event network-vif-plugged-20a43068-68ab-4588-a2b1-4ca7d685e504 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:12:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5f65be3f-fb23-4563-8e5c-369f9274f74b req-4b04569e-cf31-45e2-b042-1c69c9cf37a5 service nova] Acquiring lock "27004836-5fb4-49cc-8be9-db2afef945a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:12:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5f65be3f-fb23-4563-8e5c-369f9274f74b req-4b04569e-cf31-45e2-b042-1c69c9cf37a5 service nova] Lock "27004836-5fb4-49cc-8be9-db2afef945a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:12:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-5f65be3f-fb23-4563-8e5c-369f9274f74b req-4b04569e-cf31-45e2-b042-1c69c9cf37a5 service nova] Lock "27004836-5fb4-49cc-8be9-db2afef945a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:12:44 user nova-compute[72239]: DEBUG nova.compute.manager [req-5f65be3f-fb23-4563-8e5c-369f9274f74b req-4b04569e-cf31-45e2-b042-1c69c9cf37a5 service nova] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] No waiting events found dispatching network-vif-plugged-20a43068-68ab-4588-a2b1-4ca7d685e504 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:12:44 user nova-compute[72239]: WARNING nova.compute.manager [req-5f65be3f-fb23-4563-8e5c-369f9274f74b req-4b04569e-cf31-45e2-b042-1c69c9cf37a5 service nova] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Received unexpected event network-vif-plugged-20a43068-68ab-4588-a2b1-4ca7d685e504 for instance with vm_state building and task_state spawning.
Jul 31 15:12:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:12:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:12:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:12:46 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690816366.6469688, 27004836-5fb4-49cc-8be9-db2afef945a7 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:12:46 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] VM Resumed (Lifecycle Event)
Jul 31 15:12:46 user nova-compute[72239]: DEBUG nova.compute.manager [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 15:12:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 15:12:46 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Instance spawned successfully.
Jul 31 15:12:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 15:12:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:12:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:12:46 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:12:46 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:12:46 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 15:12:46 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690816366.6482766, 27004836-5fb4-49cc-8be9-db2afef945a7 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:12:46 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] VM Started (Lifecycle Event)
Jul 31 15:12:46 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:12:46 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:12:46 user nova-compute[72239]: INFO nova.compute.manager [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Took 5.01 seconds to spawn the instance on the hypervisor.
Jul 31 15:12:46 user nova-compute[72239]: DEBUG nova.compute.manager [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:12:46 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 15:12:46 user nova-compute[72239]: DEBUG nova.compute.manager [req-cf744258-c919-4b06-bcf1-3b29828f1ae9 req-d779e5d5-5008-47df-a57b-515542a7b659 service nova] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Received event network-vif-plugged-20a43068-68ab-4588-a2b1-4ca7d685e504 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:12:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-cf744258-c919-4b06-bcf1-3b29828f1ae9 req-d779e5d5-5008-47df-a57b-515542a7b659 service nova] Acquiring lock "27004836-5fb4-49cc-8be9-db2afef945a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:12:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-cf744258-c919-4b06-bcf1-3b29828f1ae9 req-d779e5d5-5008-47df-a57b-515542a7b659 service nova] Lock "27004836-5fb4-49cc-8be9-db2afef945a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:12:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-cf744258-c919-4b06-bcf1-3b29828f1ae9 req-d779e5d5-5008-47df-a57b-515542a7b659 service nova] Lock "27004836-5fb4-49cc-8be9-db2afef945a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:12:46 user nova-compute[72239]: DEBUG nova.compute.manager [req-cf744258-c919-4b06-bcf1-3b29828f1ae9 req-d779e5d5-5008-47df-a57b-515542a7b659 service nova] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] No waiting events found dispatching network-vif-plugged-20a43068-68ab-4588-a2b1-4ca7d685e504 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:12:46 user nova-compute[72239]: WARNING nova.compute.manager [req-cf744258-c919-4b06-bcf1-3b29828f1ae9 req-d779e5d5-5008-47df-a57b-515542a7b659 service nova] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Received unexpected event network-vif-plugged-20a43068-68ab-4588-a2b1-4ca7d685e504 for instance with vm_state building and task_state spawning.
Jul 31 15:12:46 user nova-compute[72239]: INFO nova.compute.manager [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Took 19.11 seconds to build instance.
Jul 31 15:12:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-43a8e18c-1232-4e99-a7b7-c20f1c5ece1c tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "27004836-5fb4-49cc-8be9-db2afef945a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.266s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:12:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:12:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:12:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Acquiring lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:12:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:12:50 user nova-compute[72239]: INFO nova.compute.manager [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Unshelving
Jul 31 15:12:50 user nova-compute[72239]: INFO nova.virt.block_device [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Booting with volume d7d836cb-af79-406d-8b9a-eadcda156723 at /dev/vda
Jul 31 15:12:50 user nova-compute[72239]: DEBUG os_brick.utils [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:12:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:12:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:12:50 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[505b01ef-5670-402d-8861-8421f2fccf80]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:12:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:12:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:12:50 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb60e40-7915-4832-b154-97442dda578c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:12:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:12:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:12:50 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9732e0-81d7-43d0-aa44-53746e4c4a10]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:12:50 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[09019cca-b8f9-4477-acab-21f8891f0a97]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:12:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:12:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:12:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 15:12:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:12:50 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:12:50 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 15:12:50 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5386b349-f21d-4cc1-ab05-e4acfdfaa225]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:12:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 15:12:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 15:12:50 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 15:12:50 user nova-compute[72239]: DEBUG os_brick.utils [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:12:50 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Updating existing volume attachment record: 85a006b6-510a-47a1-b9c9-740f0ff1b4ac {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 15:12:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:12:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:12:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:12:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:12:58 user nova-compute[72239]: DEBUG nova.objects.instance [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lazy-loading 'pci_requests' on Instance uuid f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:12:58 user nova-compute[72239]: DEBUG nova.objects.instance [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lazy-loading 'numa_topology' on Instance uuid f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:12:58 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 15:12:58 user nova-compute[72239]: INFO nova.compute.claims [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Claim successful on node user
Jul 31 15:12:58 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:12:58 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:12:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.373s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:12:59 user nova-compute[72239]: INFO nova.network.neutron [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Updating port 64213693-d706-4784-81b5-74a181309dd4 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 31 15:12:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Acquiring lock "refresh_cache-f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:12:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Acquired lock "refresh_cache-f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:12:59 user nova-compute[72239]: DEBUG nova.network.neutron [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 15:12:59 user nova-compute[72239]: DEBUG nova.compute.manager [req-ccb5b48e-d2b2-46cb-90cf-2b7649eb2a65 req-785e7dd8-80b4-427f-8cec-6924d116f256 service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Received event network-changed-64213693-d706-4784-81b5-74a181309dd4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:12:59 user nova-compute[72239]: DEBUG nova.compute.manager [req-ccb5b48e-d2b2-46cb-90cf-2b7649eb2a65 req-785e7dd8-80b4-427f-8cec-6924d116f256 service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Refreshing instance network info cache due to event network-changed-64213693-d706-4784-81b5-74a181309dd4. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:12:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ccb5b48e-d2b2-46cb-90cf-2b7649eb2a65 req-785e7dd8-80b4-427f-8cec-6924d116f256 service nova] Acquiring lock "refresh_cache-f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG nova.network.neutron [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Updating instance_info_cache with network_info: [{"id": "64213693-d706-4784-81b5-74a181309dd4", "address": "fa:16:3e:b2:e3:7d", "network": {"id": "cbc10aaa-d0d9-4abe-bf51-17206a8f085a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1222279697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba645b8f83ca4a15a1a6659572778375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64213693-d7", "ovs_interfaceid": "64213693-d706-4784-81b5-74a181309dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Releasing lock "refresh_cache-f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 15:13:00 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Creating image(s)
Jul 31 15:13:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Did not create local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Ensure instance console log exists: /opt/stack/data/nova/instances/f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Start _get_guest_xml network_info=[{"id": "64213693-d706-4784-81b5-74a181309dd4", "address": "fa:16:3e:b2:e3:7d", "network": {"id": "cbc10aaa-d0d9-4abe-bf51-17206a8f085a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1222279697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba645b8f83ca4a15a1a6659572778375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64213693-d7", "ovs_interfaceid": "64213693-d706-4784-81b5-74a181309dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '85a006b6-510a-47a1-b9c9-740f0ff1b4ac', 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'moMrhZRv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0', 'attached_at': '', 'detached_at': '', 'volume_id': 'd7d836cb-af79-406d-8b9a-eadcda156723', 'serial': 'd7d836cb-af79-406d-8b9a-eadcda156723'}, 'delete_on_termination': True, 'guest_format': None, 'volume_type': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ccb5b48e-d2b2-46cb-90cf-2b7649eb2a65 req-785e7dd8-80b4-427f-8cec-6924d116f256 service nova] Acquired lock "refresh_cache-f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG nova.network.neutron [req-ccb5b48e-d2b2-46cb-90cf-2b7649eb2a65 req-785e7dd8-80b4-427f-8cec-6924d116f256 service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Refreshing network info cache for port 64213693-d706-4784-81b5-74a181309dd4 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:13:00 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:13:00 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:13:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG nova.objects.instance [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lazy-loading 'vcpu_model' on Instance uuid f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'moMrhZRv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:13:00 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:13:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:13:00 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:13:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:13:00 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 15:13:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff57820-962d-48eb-bf1e-b9f4f69ee10a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 15:13:00 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2601625-be3d-403b-9599-6793bfdf6044]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723] added
Jul 31 15:13:00 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5469f08a-a060-4176-a128-ed803de18f7a]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7beb4cc-5ec7-4214-bba3-fde93c9c71da]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v moMrhZRv {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v moMrhZRv" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[07761c7b-ca13-4d98-b0c7-603bafe4f93a]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'moMrhZRv'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[702831da-0ba4-4917-a96c-e7914e9d8cb5]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ea5918-d662-43dc-ab16-1ca835b1247a]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac (non-flash)
Jul 31 15:13:00 user nova-compute[72239]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8 (non-flash)
Jul 31 15:13:00 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac (non-flash)
Jul 31 15:13:00 user nova-compute[72239]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8 (non-flash)
Jul 31 15:13:00 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e652d9-160f-4117-9616-add7fd76500d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723, portal: 172.16.0.220,3260]
Jul 31 15:13:00 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723, portal: 172.16.0.220,3260] successful.
Jul 31 15:13:00 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:13:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:13:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:13:01 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bb68ead-ff5f-4e6d-81df-c5f3177ac6ad]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:13:01 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:13:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:13:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:13:01 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b132a611-8509-4ac8-8b16-b2d9ee389d71]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:13:01 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac (non-flash)
Jul 31 15:13:01 user nova-compute[72239]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8 (non-flash)
Jul 31 15:13:01 user nova-compute[72239]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 (non-flash)
Jul 31 15:13:01 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:13:01 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac (non-flash)
Jul 31 15:13:01 user nova-compute[72239]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8 (non-flash)
Jul 31 15:13:01 user nova-compute[72239]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 (non-flash)
Jul 31 15:13:01 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:13:01 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:13:01 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 15:13:01 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 15:13:01 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 15:13:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:13:01 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:13:01 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb496b2-240a-438a-99dc-6214c57c51ef]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:13:01 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 15:13:01 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'moMrhZRv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 15:13:01 user nova-compute[72239]: DEBUG nova.network.neutron [req-ccb5b48e-d2b2-46cb-90cf-2b7649eb2a65 req-785e7dd8-80b4-427f-8cec-6924d116f256 service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Updated VIF entry in instance network info cache for port 64213693-d706-4784-81b5-74a181309dd4. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:13:01 user nova-compute[72239]: DEBUG nova.network.neutron [req-ccb5b48e-d2b2-46cb-90cf-2b7649eb2a65 req-785e7dd8-80b4-427f-8cec-6924d116f256 service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Updating instance_info_cache with network_info: [{"id": "64213693-d706-4784-81b5-74a181309dd4", "address": "fa:16:3e:b2:e3:7d", "network": {"id": "cbc10aaa-d0d9-4abe-bf51-17206a8f085a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1222279697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba645b8f83ca4a15a1a6659572778375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64213693-d7", "ovs_interfaceid": "64213693-d706-4784-81b5-74a181309dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:13:01 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ccb5b48e-d2b2-46cb-90cf-2b7649eb2a65 req-785e7dd8-80b4-427f-8cec-6924d116f256 service nova] Releasing lock "refresh_cache-f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:13:02 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:13:02 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '26433366461323735', 'path': '/dev/sdc'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:13:02 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26433366461323735', 'path': '/dev/sdc'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 15:13:02 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T15:09:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1994135225',display_name='tempest-TestShelveInstance-server-1994135225',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1994135225',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-2002616022',keypairs=<?>,launch_index=0,launched_at=2023-07-31T15:09:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ba645b8f83ca4a15a1a6659572778375',ramdisk_id='',reservation_id='r-96pfnsos',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1245549841',owner_user_name='tempest-TestShelveInstance-1245549841-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T15:12:50Z,user_data=None,user_id='8138394ef7f641309224d84d8789c831',uuid=f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "64213693-d706-4784-81b5-74a181309dd4", "address": "fa:16:3e:b2:e3:7d", "network": {"id": "cbc10aaa-d0d9-4abe-bf51-17206a8f085a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1222279697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba645b8f83ca4a15a1a6659572778375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64213693-d7", "ovs_interfaceid": "64213693-d706-4784-81b5-74a181309dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 15:13:02 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Converting VIF {"id": "64213693-d706-4784-81b5-74a181309dd4", "address": "fa:16:3e:b2:e3:7d", "network": {"id": "cbc10aaa-d0d9-4abe-bf51-17206a8f085a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1222279697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba645b8f83ca4a15a1a6659572778375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64213693-d7", "ovs_interfaceid": "64213693-d706-4784-81b5-74a181309dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:13:02 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e3:7d,bridge_name='br-int',has_traffic_filtering=True,id=64213693-d706-4784-81b5-74a181309dd4,network=Network(cbc10aaa-d0d9-4abe-bf51-17206a8f085a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64213693-d7') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:13:02 user nova-compute[72239]: DEBUG nova.objects.instance [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lazy-loading 'pci_devices' on Instance uuid f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:13:02 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] End _get_guest_xml xml=<domain type="kvm">
Jul 31 15:13:02 user nova-compute[72239]:   <uuid>f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0</uuid>
Jul 31 15:13:02 user nova-compute[72239]:   <name>instance-0000002d</name>
Jul 31 15:13:02 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 15:13:02 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 15:13:02 user nova-compute[72239]:   <metadata>
Jul 31 15:13:02 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 15:13:02 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 15:13:02 user nova-compute[72239]:       <nova:name>tempest-TestShelveInstance-server-1994135225</nova:name>
Jul 31 15:13:02 user nova-compute[72239]:       <nova:creationTime>2023-07-31 15:13:00</nova:creationTime>
Jul 31 15:13:02 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 15:13:02 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 15:13:02 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 15:13:02 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 15:13:02 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 15:13:02 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 15:13:02 user nova-compute[72239]:       </nova:flavor>
Jul 31 15:13:02 user nova-compute[72239]:       <nova:owner>
Jul 31 15:13:02 user nova-compute[72239]:         <nova:user uuid="8138394ef7f641309224d84d8789c831">tempest-TestShelveInstance-1245549841-project-member</nova:user>
Jul 31 15:13:02 user nova-compute[72239]:         <nova:project uuid="ba645b8f83ca4a15a1a6659572778375">tempest-TestShelveInstance-1245549841</nova:project>
Jul 31 15:13:02 user nova-compute[72239]:       </nova:owner>
Jul 31 15:13:02 user nova-compute[72239]:       <nova:ports>
Jul 31 15:13:02 user nova-compute[72239]:         <nova:port uuid="64213693-d706-4784-81b5-74a181309dd4">
Jul 31 15:13:02 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 31 15:13:02 user nova-compute[72239]:         </nova:port>
Jul 31 15:13:02 user nova-compute[72239]:       </nova:ports>
Jul 31 15:13:02 user nova-compute[72239]:     </nova:instance>
Jul 31 15:13:02 user nova-compute[72239]:   </metadata>
Jul 31 15:13:02 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 15:13:02 user nova-compute[72239]:     <system>
Jul 31 15:13:02 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 15:13:02 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 15:13:02 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 15:13:02 user nova-compute[72239]:       <entry name="serial">f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0</entry>
Jul 31 15:13:02 user nova-compute[72239]:       <entry name="uuid">f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0</entry>
Jul 31 15:13:02 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 15:13:02 user nova-compute[72239]:     </system>
Jul 31 15:13:02 user nova-compute[72239]:   </sysinfo>
Jul 31 15:13:02 user nova-compute[72239]:   <os>
Jul 31 15:13:02 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 15:13:02 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 15:13:02 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 15:13:02 user nova-compute[72239]:   </os>
Jul 31 15:13:02 user nova-compute[72239]:   <features>
Jul 31 15:13:02 user nova-compute[72239]:     <acpi/>
Jul 31 15:13:02 user nova-compute[72239]:     <apic/>
Jul 31 15:13:02 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 15:13:02 user nova-compute[72239]:   </features>
Jul 31 15:13:02 user nova-compute[72239]:   <clock offset="utc">
Jul 31 15:13:02 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 15:13:02 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 15:13:02 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 15:13:02 user nova-compute[72239]:   </clock>
Jul 31 15:13:02 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 15:13:02 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 15:13:02 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 15:13:02 user nova-compute[72239]:   </cpu>
Jul 31 15:13:02 user nova-compute[72239]:   <devices>
Jul 31 15:13:02 user nova-compute[72239]:     <disk type="block" device="disk">
Jul 31 15:13:02 user nova-compute[72239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:13:02 user nova-compute[72239]:       <source dev="/dev/sdc"/>
Jul 31 15:13:02 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 15:13:02 user nova-compute[72239]:       <serial>d7d836cb-af79-406d-8b9a-eadcda156723</serial>
Jul 31 15:13:02 user nova-compute[72239]:     </disk>
Jul 31 15:13:02 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 15:13:02 user nova-compute[72239]:       <mac address="fa:16:3e:b2:e3:7d"/>
Jul 31 15:13:02 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:13:02 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 15:13:02 user nova-compute[72239]:       <target dev="tap64213693-d7"/>
Jul 31 15:13:02 user nova-compute[72239]:     </interface>
Jul 31 15:13:02 user nova-compute[72239]:     <serial type="pty">
Jul 31 15:13:02 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0/console.log" append="off"/>
Jul 31 15:13:02 user nova-compute[72239]:     </serial>
Jul 31 15:13:02 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 15:13:02 user nova-compute[72239]:     <video>
Jul 31 15:13:02 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:13:02 user nova-compute[72239]:     </video>
Jul 31 15:13:02 user nova-compute[72239]:     <rng model="virtio">
Jul 31 15:13:02 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 15:13:02 user nova-compute[72239]:     </rng>
Jul 31 15:13:02 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 15:13:02 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 15:13:02 user nova-compute[72239]:       <stats period="10"/>
Jul 31 15:13:02 user nova-compute[72239]:     </memballoon>
Jul 31 15:13:02 user nova-compute[72239]:   </devices>
Jul 31 15:13:02 user nova-compute[72239]: </domain>
Jul 31 15:13:02 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 15:13:02 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T15:09:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1994135225',display_name='tempest-TestShelveInstance-server-1994135225',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1994135225',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-2002616022',keypairs=<?>,launch_index=0,launched_at=2023-07-31T15:09:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='ba645b8f83ca4a15a1a6659572778375',ramdisk_id='',reservation_id='r-96pfnsos',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1245549841',owner_user_name='tempest-TestShelveInstance-1245549841-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T15:12:50Z,user_data=None,user_id='8138394ef7f641309224d84d8789c831',uuid=f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "64213693-d706-4784-81b5-74a181309dd4", "address": "fa:16:3e:b2:e3:7d", "network": {"id": "cbc10aaa-d0d9-4abe-bf51-17206a8f085a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1222279697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba645b8f83ca4a15a1a6659572778375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64213693-d7", "ovs_interfaceid": "64213693-d706-4784-81b5-74a181309dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 15:13:02 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Converting VIF {"id": "64213693-d706-4784-81b5-74a181309dd4", "address": "fa:16:3e:b2:e3:7d", "network": {"id": "cbc10aaa-d0d9-4abe-bf51-17206a8f085a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1222279697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba645b8f83ca4a15a1a6659572778375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64213693-d7", "ovs_interfaceid": "64213693-d706-4784-81b5-74a181309dd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:13:02 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e3:7d,bridge_name='br-int',has_traffic_filtering=True,id=64213693-d706-4784-81b5-74a181309dd4,network=Network(cbc10aaa-d0d9-4abe-bf51-17206a8f085a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64213693-d7') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:13:02 user nova-compute[72239]: DEBUG os_vif [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e3:7d,bridge_name='br-int',has_traffic_filtering=True,id=64213693-d706-4784-81b5-74a181309dd4,network=Network(cbc10aaa-d0d9-4abe-bf51-17206a8f085a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64213693-d7') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 15:13:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:13:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:13:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 15:13:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:13:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64213693-d7, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:13:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap64213693-d7, col_values=(('external_ids', {'iface-id': '64213693-d706-4784-81b5-74a181309dd4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:e3:7d', 'vm-uuid': 'f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:13:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:13:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:13:02 user nova-compute[72239]: INFO os_vif [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:e3:7d,bridge_name='br-int',has_traffic_filtering=True,id=64213693-d706-4784-81b5-74a181309dd4,network=Network(cbc10aaa-d0d9-4abe-bf51-17206a8f085a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64213693-d7')
Jul 31 15:13:02 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:13:02 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] No VIF found with MAC fa:16:3e:b2:e3:7d, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 15:13:03 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:13:03 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:13:03 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:13:03 user nova-compute[72239]: DEBUG nova.compute.manager [req-26d5d3a0-456a-4828-90fe-47978b8485cf req-c04ec72c-8886-45ca-ac08-303b1e55030d service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Received event network-vif-plugged-64213693-d706-4784-81b5-74a181309dd4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:13:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-26d5d3a0-456a-4828-90fe-47978b8485cf req-c04ec72c-8886-45ca-ac08-303b1e55030d service nova] Acquiring lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:13:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-26d5d3a0-456a-4828-90fe-47978b8485cf req-c04ec72c-8886-45ca-ac08-303b1e55030d service nova] Lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:13:03 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-26d5d3a0-456a-4828-90fe-47978b8485cf req-c04ec72c-8886-45ca-ac08-303b1e55030d service nova] Lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:13:03 user nova-compute[72239]: DEBUG nova.compute.manager [req-26d5d3a0-456a-4828-90fe-47978b8485cf req-c04ec72c-8886-45ca-ac08-303b1e55030d service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] No waiting events found dispatching network-vif-plugged-64213693-d706-4784-81b5-74a181309dd4 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:13:03 user nova-compute[72239]: WARNING nova.compute.manager [req-26d5d3a0-456a-4828-90fe-47978b8485cf req-c04ec72c-8886-45ca-ac08-303b1e55030d service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Received unexpected event network-vif-plugged-64213693-d706-4784-81b5-74a181309dd4 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 31 15:13:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:13:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:13:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:13:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:13:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:13:05 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690816385.5212781, f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:13:05 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] VM Resumed (Lifecycle Event)
Jul 31 15:13:05 user nova-compute[72239]: DEBUG nova.compute.manager [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 15:13:05 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 15:13:05 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Instance spawned successfully.
Jul 31 15:13:05 user nova-compute[72239]: DEBUG nova.compute.manager [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:13:05 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:13:05 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:13:05 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 15:13:05 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690816385.5228934, f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:13:05 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] VM Started (Lifecycle Event)
Jul 31 15:13:05 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:13:05 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:13:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-60bf1da2-2871-4644-b821-733e2130722c tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.196s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:13:05 user nova-compute[72239]: DEBUG nova.compute.manager [req-6980aacc-7ca2-41d2-a115-052a78a0c55e req-f8de447f-c44a-4f32-861f-c45e6ff3f879 service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Received event network-vif-plugged-64213693-d706-4784-81b5-74a181309dd4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:13:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-6980aacc-7ca2-41d2-a115-052a78a0c55e req-f8de447f-c44a-4f32-861f-c45e6ff3f879 service nova] Acquiring lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:13:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-6980aacc-7ca2-41d2-a115-052a78a0c55e req-f8de447f-c44a-4f32-861f-c45e6ff3f879 service nova] Lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:13:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-6980aacc-7ca2-41d2-a115-052a78a0c55e req-f8de447f-c44a-4f32-861f-c45e6ff3f879 service nova] Lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:13:05 user nova-compute[72239]: DEBUG nova.compute.manager [req-6980aacc-7ca2-41d2-a115-052a78a0c55e req-f8de447f-c44a-4f32-861f-c45e6ff3f879 service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] No waiting events found dispatching network-vif-plugged-64213693-d706-4784-81b5-74a181309dd4 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:13:05 user nova-compute[72239]: WARNING nova.compute.manager [req-6980aacc-7ca2-41d2-a115-052a78a0c55e req-f8de447f-c44a-4f32-861f-c45e6ff3f879 service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Received unexpected event network-vif-plugged-64213693-d706-4784-81b5-74a181309dd4 for instance with vm_state active and task_state None.
Jul 31 15:13:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:13:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:13:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:13:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:13:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:13:17 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:13:17 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:13:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:13:20 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:13:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-892a71ed-af60-48ec-ac29-97445f7cfa2d tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquiring lock "bf7b3a30-776f-406b-9e38-db804c098e93" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:13:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-892a71ed-af60-48ec-ac29-97445f7cfa2d tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "bf7b3a30-776f-406b-9e38-db804c098e93" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:13:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-892a71ed-af60-48ec-ac29-97445f7cfa2d tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquiring lock "bf7b3a30-776f-406b-9e38-db804c098e93-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:13:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-892a71ed-af60-48ec-ac29-97445f7cfa2d tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "bf7b3a30-776f-406b-9e38-db804c098e93-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:13:20 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-892a71ed-af60-48ec-ac29-97445f7cfa2d tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "bf7b3a30-776f-406b-9e38-db804c098e93-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:13:20 user nova-compute[72239]: INFO nova.compute.manager [None req-892a71ed-af60-48ec-ac29-97445f7cfa2d tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Terminating instance
Jul 31 15:13:20 user nova-compute[72239]: DEBUG nova.compute.manager [None req-892a71ed-af60-48ec-ac29-97445f7cfa2d tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 15:13:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:13:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:13:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:13:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:13:21 user nova-compute[72239]: DEBUG nova.compute.manager [req-2ae8281d-5e95-4382-884f-1c19f768a51b req-3e72794e-0f13-4da2-a579-2aa0c08a0881 service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Received event network-vif-unplugged-0fcc6557-b09c-4149-8458-ac4f1bf6ffcf {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:13:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-2ae8281d-5e95-4382-884f-1c19f768a51b req-3e72794e-0f13-4da2-a579-2aa0c08a0881 service nova] Acquiring lock "bf7b3a30-776f-406b-9e38-db804c098e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:13:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-2ae8281d-5e95-4382-884f-1c19f768a51b req-3e72794e-0f13-4da2-a579-2aa0c08a0881 service nova] Lock "bf7b3a30-776f-406b-9e38-db804c098e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:13:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-2ae8281d-5e95-4382-884f-1c19f768a51b req-3e72794e-0f13-4da2-a579-2aa0c08a0881 service nova] Lock "bf7b3a30-776f-406b-9e38-db804c098e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:13:21 user nova-compute[72239]: DEBUG nova.compute.manager [req-2ae8281d-5e95-4382-884f-1c19f768a51b req-3e72794e-0f13-4da2-a579-2aa0c08a0881 service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] No waiting events found dispatching network-vif-unplugged-0fcc6557-b09c-4149-8458-ac4f1bf6ffcf {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:13:21 user nova-compute[72239]: DEBUG nova.compute.manager [req-2ae8281d-5e95-4382-884f-1c19f768a51b req-3e72794e-0f13-4da2-a579-2aa0c08a0881 service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Received event network-vif-unplugged-0fcc6557-b09c-4149-8458-ac4f1bf6ffcf for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 15:13:21 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:13:21 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 15:13:21 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Rebuilding the list of instances to heal {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 15:13:21 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:13:21 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Skipping network cache update for instance because it is being deleted. {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9859}}
Jul 31 15:13:21 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Instance destroyed successfully.
Jul 31 15:13:21 user nova-compute[72239]: DEBUG nova.objects.instance [None req-892a71ed-af60-48ec-ac29-97445f7cfa2d tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lazy-loading 'resources' on Instance uuid bf7b3a30-776f-406b-9e38-db804c098e93 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:13:21 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-892a71ed-af60-48ec-ac29-97445f7cfa2d tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:08:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1333595426',display_name='tempest-TestMinimumBasicScenario-server-1333595426',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1333595426',id=44,image_ref='307af25b-1f52-4706-b31a-436ccc6613aa',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ2hXK+hMzIEO9mGtRj+Z4xkohPHcKxHoldVex8CDLHt4D6siIXOeWXD4ztrVYXKX/MNsxUzGh1XBckhFsDBgK6c8NC757TbUJBfOZYlgBPzRKUhs1zaTP6bKGWi3eIeLw==',key_name='tempest-TestMinimumBasicScenario-895895609',keypairs=<?>,launch_index=0,launched_at=2023-07-31T15:08:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f37ae523240a47bb936ef4b54994de61',ramdisk_id='',reservation_id='r-otnsvvx6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='307af25b-1f52-4706-b31a-436ccc6613aa',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-429761002',owner_user_name='tempest-TestMinimumBasicScenario-429761002-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T15:10:41Z,user_data=None,user_id='d0a629efb75a463892b841e95f6d4acf',uuid=bf7b3a30-776f-406b-9e38-db804c098e93,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "address": "fa:16:3e:a7:1b:0c", "network": {"id": "b9eb37b6-27e4-4d9e-bfb2-7e167766e547", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1162541993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37ae523240a47bb936ef4b54994de61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fcc6557-b0", "ovs_interfaceid": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 15:13:21 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-892a71ed-af60-48ec-ac29-97445f7cfa2d tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Converting VIF {"id": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "address": "fa:16:3e:a7:1b:0c", "network": {"id": "b9eb37b6-27e4-4d9e-bfb2-7e167766e547", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1162541993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37ae523240a47bb936ef4b54994de61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0fcc6557-b0", "ovs_interfaceid": "0fcc6557-b09c-4149-8458-ac4f1bf6ffcf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:13:21 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-892a71ed-af60-48ec-ac29-97445f7cfa2d tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a7:1b:0c,bridge_name='br-int',has_traffic_filtering=True,id=0fcc6557-b09c-4149-8458-ac4f1bf6ffcf,network=Network(b9eb37b6-27e4-4d9e-bfb2-7e167766e547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fcc6557-b0') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:13:21 user nova-compute[72239]: DEBUG os_vif [None req-892a71ed-af60-48ec-ac29-97445f7cfa2d tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:1b:0c,bridge_name='br-int',has_traffic_filtering=True,id=0fcc6557-b09c-4149-8458-ac4f1bf6ffcf,network=Network(b9eb37b6-27e4-4d9e-bfb2-7e167766e547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fcc6557-b0') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 15:13:21 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:13:21 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0fcc6557-b0, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:13:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:13:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:13:21 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 15:13:21 user nova-compute[72239]: DEBUG nova.objects.instance [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lazy-loading 'info_cache' on Instance uuid f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:13:21 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:13:21 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:13:21 user nova-compute[72239]: INFO os_vif [None req-892a71ed-af60-48ec-ac29-97445f7cfa2d tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a7:1b:0c,bridge_name='br-int',has_traffic_filtering=True,id=0fcc6557-b09c-4149-8458-ac4f1bf6ffcf,network=Network(b9eb37b6-27e4-4d9e-bfb2-7e167766e547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0fcc6557-b0')
Jul 31 15:13:21 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-892a71ed-af60-48ec-ac29-97445f7cfa2d tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Deleting instance files /opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93_del
Jul 31 15:13:21 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-892a71ed-af60-48ec-ac29-97445f7cfa2d tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Deletion of /opt/stack/data/nova/instances/bf7b3a30-776f-406b-9e38-db804c098e93_del complete
Jul 31 15:13:21 user nova-compute[72239]: INFO nova.compute.manager [None req-892a71ed-af60-48ec-ac29-97445f7cfa2d tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Took 0.93 seconds to destroy the instance on the hypervisor.
Jul 31 15:13:21 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-892a71ed-af60-48ec-ac29-97445f7cfa2d tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 15:13:21 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 15:13:21 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 15:13:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:13:22 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:13:22 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Took 0.55 seconds to deallocate network for instance.
Jul 31 15:13:22 user nova-compute[72239]: DEBUG nova.compute.manager [req-b702bc5a-f227-43df-b06a-596da61c7bea req-badea611-8834-40ed-b848-38e78de4a167 service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Received event network-vif-deleted-0fcc6557-b09c-4149-8458-ac4f1bf6ffcf {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:13:22 user nova-compute[72239]: INFO nova.compute.manager [req-b702bc5a-f227-43df-b06a-596da61c7bea req-badea611-8834-40ed-b848-38e78de4a167 service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Neutron deleted interface 0fcc6557-b09c-4149-8458-ac4f1bf6ffcf; detaching it from the instance and deleting it from the info cache
Jul 31 15:13:22 user nova-compute[72239]: DEBUG nova.network.neutron [req-b702bc5a-f227-43df-b06a-596da61c7bea req-badea611-8834-40ed-b848-38e78de4a167 service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:13:22 user nova-compute[72239]: DEBUG nova.compute.manager [req-b702bc5a-f227-43df-b06a-596da61c7bea req-badea611-8834-40ed-b848-38e78de4a167 service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Detach interface failed, port_id=0fcc6557-b09c-4149-8458-ac4f1bf6ffcf, reason: Instance bf7b3a30-776f-406b-9e38-db804c098e93 could not be found. {{(pid=72239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 15:13:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-892a71ed-af60-48ec-ac29-97445f7cfa2d tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:13:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-892a71ed-af60-48ec-ac29-97445f7cfa2d tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:13:22 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Updating instance_info_cache with network_info: [{"id": "64213693-d706-4784-81b5-74a181309dd4", "address": "fa:16:3e:b2:e3:7d", "network": {"id": "cbc10aaa-d0d9-4abe-bf51-17206a8f085a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1222279697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba645b8f83ca4a15a1a6659572778375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64213693-d7", "ovs_interfaceid": "64213693-d706-4784-81b5-74a181309dd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:13:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:13:22 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 15:13:22 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-892a71ed-af60-48ec-ac29-97445f7cfa2d tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:13:22 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-892a71ed-af60-48ec-ac29-97445f7cfa2d tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:13:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-892a71ed-af60-48ec-ac29-97445f7cfa2d tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.193s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:13:22 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-892a71ed-af60-48ec-ac29-97445f7cfa2d tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Deleted allocations for instance bf7b3a30-776f-406b-9e38-db804c098e93
Jul 31 15:13:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-892a71ed-af60-48ec-ac29-97445f7cfa2d tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "bf7b3a30-776f-406b-9e38-db804c098e93" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.871s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:13:23 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:13:23 user nova-compute[72239]: DEBUG nova.compute.manager [req-0da2a48d-c5d3-4311-bed4-6d5102504428 req-f80448f7-7a97-4577-af6e-f0b585be57d5 service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Received event network-vif-plugged-0fcc6557-b09c-4149-8458-ac4f1bf6ffcf {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:13:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0da2a48d-c5d3-4311-bed4-6d5102504428 req-f80448f7-7a97-4577-af6e-f0b585be57d5 service nova] Acquiring lock "bf7b3a30-776f-406b-9e38-db804c098e93-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:13:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0da2a48d-c5d3-4311-bed4-6d5102504428 req-f80448f7-7a97-4577-af6e-f0b585be57d5 service nova] Lock "bf7b3a30-776f-406b-9e38-db804c098e93-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:13:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0da2a48d-c5d3-4311-bed4-6d5102504428 req-f80448f7-7a97-4577-af6e-f0b585be57d5 service nova] Lock "bf7b3a30-776f-406b-9e38-db804c098e93-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:13:23 user nova-compute[72239]: DEBUG nova.compute.manager [req-0da2a48d-c5d3-4311-bed4-6d5102504428 req-f80448f7-7a97-4577-af6e-f0b585be57d5 service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] No waiting events found dispatching network-vif-plugged-0fcc6557-b09c-4149-8458-ac4f1bf6ffcf {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:13:23 user nova-compute[72239]: WARNING nova.compute.manager [req-0da2a48d-c5d3-4311-bed4-6d5102504428 req-f80448f7-7a97-4577-af6e-f0b585be57d5 service nova] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Received unexpected event network-vif-plugged-0fcc6557-b09c-4149-8458-ac4f1bf6ffcf for instance with vm_state deleted and task_state None.
Jul 31 15:13:24 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:13:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:13:26 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:13:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:13:27 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:13:27 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 15:13:27 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:13:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:13:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:13:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:13:27 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 15:13:27 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 15:13:27 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 15:13:27 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 15:13:27 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:13:27 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:13:27 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=8375MB free_disk=25.16351318359375GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 15:13:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:13:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:13:28 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance fc5e6dfe-def8-47cb-8639-d93a39cfeeaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:13:28 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 27004836-5fb4-49cc-8be9-db2afef945a7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:13:28 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:13:28 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 15:13:28 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 15:13:28 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:13:28 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:13:28 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 15:13:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.252s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:13:30 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:13:31 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:13:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:13:36 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690816401.4593325, bf7b3a30-776f-406b-9e38-db804c098e93 => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:13:36 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] VM Stopped (Lifecycle Event)
Jul 31 15:13:36 user nova-compute[72239]: DEBUG nova.compute.manager [None req-5debc2a9-59bd-41e7-ad47-39134c2f2413 None None] [instance: bf7b3a30-776f-406b-9e38-db804c098e93] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:13:36 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:13:41 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:13:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:13:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:13:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:14:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:14:06 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:14:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:14:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquiring lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:14:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:14:14 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 15:14:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:14:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:14:14 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 15:14:14 user nova-compute[72239]: INFO nova.compute.claims [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Claim successful on node user
Jul 31 15:14:14 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:14:14 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:14:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.254s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:14:14 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 15:14:14 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 15:14:14 user nova-compute[72239]: DEBUG nova.network.neutron [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 15:14:14 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 15:14:14 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 15:14:15 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 15:14:15 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 15:14:15 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Creating image(s)
Jul 31 15:14:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquiring lock "/opt/stack/data/nova/instances/f8b7d69e-f23a-4615-9f08-ce5fede9e4eb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:14:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "/opt/stack/data/nova/instances/f8b7d69e-f23a-4615-9f08-ce5fede9e4eb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:14:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "/opt/stack/data/nova/instances/f8b7d69e-f23a-4615-9f08-ce5fede9e4eb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:14:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquiring lock "d6df4aa3e5816c8dc08db76d08729105b0faeaeb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:14:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "d6df4aa3e5816c8dc08db76d08729105b0faeaeb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:14:15 user nova-compute[72239]: DEBUG nova.policy [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd0a629efb75a463892b841e95f6d4acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f37ae523240a47bb936ef4b54994de61', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 15:14:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d6df4aa3e5816c8dc08db76d08729105b0faeaeb.part --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:14:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d6df4aa3e5816c8dc08db76d08729105b0faeaeb.part --force-share --output=json" returned: 0 in 0.148s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:14:15 user nova-compute[72239]: DEBUG nova.virt.images [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] 01125b01-4b83-422d-b8ab-a9b86821978e was qcow2, converting to raw {{(pid=72239) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 31 15:14:15 user nova-compute[72239]: DEBUG nova.privsep.utils [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=72239) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 31 15:14:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d6df4aa3e5816c8dc08db76d08729105b0faeaeb.part /opt/stack/data/nova/instances/_base/d6df4aa3e5816c8dc08db76d08729105b0faeaeb.converted {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:14:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:14:15 user nova-compute[72239]: DEBUG nova.network.neutron [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Successfully created port: dade5b65-0491-41c1-988b-d18a6613ec6d {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 15:14:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/d6df4aa3e5816c8dc08db76d08729105b0faeaeb.part /opt/stack/data/nova/instances/_base/d6df4aa3e5816c8dc08db76d08729105b0faeaeb.converted" returned: 0 in 0.255s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:14:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d6df4aa3e5816c8dc08db76d08729105b0faeaeb.converted --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:14:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d6df4aa3e5816c8dc08db76d08729105b0faeaeb.converted --force-share --output=json" returned: 0 in 0.152s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:14:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "d6df4aa3e5816c8dc08db76d08729105b0faeaeb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.085s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:14:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d6df4aa3e5816c8dc08db76d08729105b0faeaeb --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:14:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d6df4aa3e5816c8dc08db76d08729105b0faeaeb --force-share --output=json" returned: 0 in 0.133s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:14:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquiring lock "d6df4aa3e5816c8dc08db76d08729105b0faeaeb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:14:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "d6df4aa3e5816c8dc08db76d08729105b0faeaeb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:14:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d6df4aa3e5816c8dc08db76d08729105b0faeaeb --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:14:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d6df4aa3e5816c8dc08db76d08729105b0faeaeb --force-share --output=json" returned: 0 in 0.139s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:14:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d6df4aa3e5816c8dc08db76d08729105b0faeaeb,backing_fmt=raw /opt/stack/data/nova/instances/f8b7d69e-f23a-4615-9f08-ce5fede9e4eb/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:14:16 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:14:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/d6df4aa3e5816c8dc08db76d08729105b0faeaeb,backing_fmt=raw /opt/stack/data/nova/instances/f8b7d69e-f23a-4615-9f08-ce5fede9e4eb/disk 1073741824" returned: 0 in 0.139s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:14:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "d6df4aa3e5816c8dc08db76d08729105b0faeaeb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:14:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d6df4aa3e5816c8dc08db76d08729105b0faeaeb --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:14:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/d6df4aa3e5816c8dc08db76d08729105b0faeaeb --force-share --output=json" returned: 0 in 0.139s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:14:16 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f8b7d69e-f23a-4615-9f08-ce5fede9e4eb/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 15:14:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8b7d69e-f23a-4615-9f08-ce5fede9e4eb/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:14:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8b7d69e-f23a-4615-9f08-ce5fede9e4eb/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:14:16 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Cannot resize image /opt/stack/data/nova/instances/f8b7d69e-f23a-4615-9f08-ce5fede9e4eb/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 15:14:16 user nova-compute[72239]: DEBUG nova.objects.instance [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lazy-loading 'migration_context' on Instance uuid f8b7d69e-f23a-4615-9f08-ce5fede9e4eb {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:14:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 15:14:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Ensure instance console log exists: /opt/stack/data/nova/instances/f8b7d69e-f23a-4615-9f08-ce5fede9e4eb/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 15:14:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:14:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:14:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG nova.network.neutron [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Successfully updated port: dade5b65-0491-41c1-988b-d18a6613ec6d {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquiring lock "refresh_cache-f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquired lock "refresh_cache-f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG nova.network.neutron [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG nova.compute.manager [req-94321592-ceae-48a8-8c3f-5dd3530188ac req-af94ced9-b1f9-4c25-bf59-e04ac784bb89 service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Received event network-changed-dade5b65-0491-41c1-988b-d18a6613ec6d {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG nova.compute.manager [req-94321592-ceae-48a8-8c3f-5dd3530188ac req-af94ced9-b1f9-4c25-bf59-e04ac784bb89 service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Refreshing instance network info cache due to event network-changed-dade5b65-0491-41c1-988b-d18a6613ec6d. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-94321592-ceae-48a8-8c3f-5dd3530188ac req-af94ced9-b1f9-4c25-bf59-e04ac784bb89 service nova] Acquiring lock "refresh_cache-f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG nova.network.neutron [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG nova.network.neutron [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Updating instance_info_cache with network_info: [{"id": "dade5b65-0491-41c1-988b-d18a6613ec6d", "address": "fa:16:3e:cf:e2:1d", "network": {"id": "b9eb37b6-27e4-4d9e-bfb2-7e167766e547", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1162541993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37ae523240a47bb936ef4b54994de61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdade5b65-04", "ovs_interfaceid": "dade5b65-0491-41c1-988b-d18a6613ec6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Releasing lock "refresh_cache-f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Instance network_info: |[{"id": "dade5b65-0491-41c1-988b-d18a6613ec6d", "address": "fa:16:3e:cf:e2:1d", "network": {"id": "b9eb37b6-27e4-4d9e-bfb2-7e167766e547", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1162541993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37ae523240a47bb936ef4b54994de61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdade5b65-04", "ovs_interfaceid": "dade5b65-0491-41c1-988b-d18a6613ec6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-94321592-ceae-48a8-8c3f-5dd3530188ac req-af94ced9-b1f9-4c25-bf59-e04ac784bb89 service nova] Acquired lock "refresh_cache-f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG nova.network.neutron [req-94321592-ceae-48a8-8c3f-5dd3530188ac req-af94ced9-b1f9-4c25-bf59-e04ac784bb89 service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Refreshing network info cache for port dade5b65-0491-41c1-988b-d18a6613ec6d {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Start _get_guest_xml network_info=[{"id": "dade5b65-0491-41c1-988b-d18a6613ec6d", "address": "fa:16:3e:cf:e2:1d", "network": {"id": "b9eb37b6-27e4-4d9e-bfb2-7e167766e547", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1162541993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37ae523240a47bb936ef4b54994de61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdade5b65-04", "ovs_interfaceid": "dade5b65-0491-41c1-988b-d18a6613ec6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T15:14:12Z,direct_url=<?>,disk_format='qcow2',id=01125b01-4b83-422d-b8ab-a9b86821978e,min_disk=0,min_ram=0,name='tempest-scenario-img--881019849',owner='f37ae523240a47bb936ef4b54994de61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T15:14:13Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '01125b01-4b83-422d-b8ab-a9b86821978e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 15:14:17 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:14:17 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:14:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T15:14:12Z,direct_url=<?>,disk_format='qcow2',id=01125b01-4b83-422d-b8ab-a9b86821978e,min_disk=0,min_ram=0,name='tempest-scenario-img--881019849',owner='f37ae523240a47bb936ef4b54994de61',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T15:14:13Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:14:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1389812758',display_name='tempest-TestMinimumBasicScenario-server-1389812758',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1389812758',id=48,image_ref='01125b01-4b83-422d-b8ab-a9b86821978e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPB4PaX1aLez4CZP4ezZr+kmozP1OQIYFxiMKhZ28BG6oz32xLwAtJg0LaQl8b2kpCmZ7a86lBBv4vfq3UeeWJkLN6sDz7u9+q9DciQuvJHr9YWmCHdHcIznbJgteqOyA==',key_name='tempest-TestMinimumBasicScenario-1453227332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f37ae523240a47bb936ef4b54994de61',ramdisk_id='',reservation_id='r-pd9f956b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='01125b01-4b83-422d-b8ab-a9b86821978e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-429761002',owner_user_name='tempest-TestMinimumBasicScenario-429761002-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T15:14:15Z,user_data=None,user_id='d0a629efb75a463892b841e95f6d4acf',uuid=f8b7d69e-f23a-4615-9f08-ce5fede9e4eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dade5b65-0491-41c1-988b-d18a6613ec6d", "address": "fa:16:3e:cf:e2:1d", "network": {"id": "b9eb37b6-27e4-4d9e-bfb2-7e167766e547", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1162541993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37ae523240a47bb936ef4b54994de61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdade5b65-04", "ovs_interfaceid": "dade5b65-0491-41c1-988b-d18a6613ec6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Converting VIF {"id": "dade5b65-0491-41c1-988b-d18a6613ec6d", "address": "fa:16:3e:cf:e2:1d", "network": {"id": "b9eb37b6-27e4-4d9e-bfb2-7e167766e547", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1162541993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37ae523240a47bb936ef4b54994de61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdade5b65-04", "ovs_interfaceid": "dade5b65-0491-41c1-988b-d18a6613ec6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:e2:1d,bridge_name='br-int',has_traffic_filtering=True,id=dade5b65-0491-41c1-988b-d18a6613ec6d,network=Network(b9eb37b6-27e4-4d9e-bfb2-7e167766e547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdade5b65-04') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG nova.objects.instance [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lazy-loading 'pci_devices' on Instance uuid f8b7d69e-f23a-4615-9f08-ce5fede9e4eb {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] End _get_guest_xml xml=<domain type="kvm">
Jul 31 15:14:17 user nova-compute[72239]:   <uuid>f8b7d69e-f23a-4615-9f08-ce5fede9e4eb</uuid>
Jul 31 15:14:17 user nova-compute[72239]:   <name>instance-00000030</name>
Jul 31 15:14:17 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 15:14:17 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 15:14:17 user nova-compute[72239]:   <metadata>
Jul 31 15:14:17 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 15:14:17 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 15:14:17 user nova-compute[72239]:       <nova:name>tempest-TestMinimumBasicScenario-server-1389812758</nova:name>
Jul 31 15:14:17 user nova-compute[72239]:       <nova:creationTime>2023-07-31 15:14:17</nova:creationTime>
Jul 31 15:14:17 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 15:14:17 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 15:14:17 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 15:14:17 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 15:14:17 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 15:14:17 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 15:14:17 user nova-compute[72239]:       </nova:flavor>
Jul 31 15:14:17 user nova-compute[72239]:       <nova:owner>
Jul 31 15:14:17 user nova-compute[72239]:         <nova:user uuid="d0a629efb75a463892b841e95f6d4acf">tempest-TestMinimumBasicScenario-429761002-project-member</nova:user>
Jul 31 15:14:17 user nova-compute[72239]:         <nova:project uuid="f37ae523240a47bb936ef4b54994de61">tempest-TestMinimumBasicScenario-429761002</nova:project>
Jul 31 15:14:17 user nova-compute[72239]:       </nova:owner>
Jul 31 15:14:17 user nova-compute[72239]:       <nova:root type="image" uuid="01125b01-4b83-422d-b8ab-a9b86821978e"/>
Jul 31 15:14:17 user nova-compute[72239]:       <nova:ports>
Jul 31 15:14:17 user nova-compute[72239]:         <nova:port uuid="dade5b65-0491-41c1-988b-d18a6613ec6d">
Jul 31 15:14:17 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 31 15:14:17 user nova-compute[72239]:         </nova:port>
Jul 31 15:14:17 user nova-compute[72239]:       </nova:ports>
Jul 31 15:14:17 user nova-compute[72239]:     </nova:instance>
Jul 31 15:14:17 user nova-compute[72239]:   </metadata>
Jul 31 15:14:17 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 15:14:17 user nova-compute[72239]:     <system>
Jul 31 15:14:17 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 15:14:17 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 15:14:17 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 15:14:17 user nova-compute[72239]:       <entry name="serial">f8b7d69e-f23a-4615-9f08-ce5fede9e4eb</entry>
Jul 31 15:14:17 user nova-compute[72239]:       <entry name="uuid">f8b7d69e-f23a-4615-9f08-ce5fede9e4eb</entry>
Jul 31 15:14:17 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 15:14:17 user nova-compute[72239]:     </system>
Jul 31 15:14:17 user nova-compute[72239]:   </sysinfo>
Jul 31 15:14:17 user nova-compute[72239]:   <os>
Jul 31 15:14:17 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 15:14:17 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 15:14:17 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 15:14:17 user nova-compute[72239]:   </os>
Jul 31 15:14:17 user nova-compute[72239]:   <features>
Jul 31 15:14:17 user nova-compute[72239]:     <acpi/>
Jul 31 15:14:17 user nova-compute[72239]:     <apic/>
Jul 31 15:14:17 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 15:14:17 user nova-compute[72239]:   </features>
Jul 31 15:14:17 user nova-compute[72239]:   <clock offset="utc">
Jul 31 15:14:17 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 15:14:17 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 15:14:17 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 15:14:17 user nova-compute[72239]:   </clock>
Jul 31 15:14:17 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 15:14:17 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 15:14:17 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 15:14:17 user nova-compute[72239]:   </cpu>
Jul 31 15:14:17 user nova-compute[72239]:   <devices>
Jul 31 15:14:17 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 15:14:17 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 15:14:17 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/f8b7d69e-f23a-4615-9f08-ce5fede9e4eb/disk"/>
Jul 31 15:14:17 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 15:14:17 user nova-compute[72239]:     </disk>
Jul 31 15:14:17 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 15:14:17 user nova-compute[72239]:       <mac address="fa:16:3e:cf:e2:1d"/>
Jul 31 15:14:17 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:14:17 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 15:14:17 user nova-compute[72239]:       <target dev="tapdade5b65-04"/>
Jul 31 15:14:17 user nova-compute[72239]:     </interface>
Jul 31 15:14:17 user nova-compute[72239]:     <serial type="pty">
Jul 31 15:14:17 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/f8b7d69e-f23a-4615-9f08-ce5fede9e4eb/console.log" append="off"/>
Jul 31 15:14:17 user nova-compute[72239]:     </serial>
Jul 31 15:14:17 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 15:14:17 user nova-compute[72239]:     <video>
Jul 31 15:14:17 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:14:17 user nova-compute[72239]:     </video>
Jul 31 15:14:17 user nova-compute[72239]:     <rng model="virtio">
Jul 31 15:14:17 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 15:14:17 user nova-compute[72239]:     </rng>
Jul 31 15:14:17 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 15:14:17 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 15:14:17 user nova-compute[72239]:       <stats period="10"/>
Jul 31 15:14:17 user nova-compute[72239]:     </memballoon>
Jul 31 15:14:17 user nova-compute[72239]:   </devices>
Jul 31 15:14:17 user nova-compute[72239]: </domain>
Jul 31 15:14:17 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:14:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1389812758',display_name='tempest-TestMinimumBasicScenario-server-1389812758',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1389812758',id=48,image_ref='01125b01-4b83-422d-b8ab-a9b86821978e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPB4PaX1aLez4CZP4ezZr+kmozP1OQIYFxiMKhZ28BG6oz32xLwAtJg0LaQl8b2kpCmZ7a86lBBv4vfq3UeeWJkLN6sDz7u9+q9DciQuvJHr9YWmCHdHcIznbJgteqOyA==',key_name='tempest-TestMinimumBasicScenario-1453227332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f37ae523240a47bb936ef4b54994de61',ramdisk_id='',reservation_id='r-pd9f956b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='01125b01-4b83-422d-b8ab-a9b86821978e',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-429761002',owner_user_name='tempest-TestMinimumBasicScenario-429761002-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T15:14:15Z,user_data=None,user_id='d0a629efb75a463892b841e95f6d4acf',uuid=f8b7d69e-f23a-4615-9f08-ce5fede9e4eb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dade5b65-0491-41c1-988b-d18a6613ec6d", "address": "fa:16:3e:cf:e2:1d", "network": {"id": "b9eb37b6-27e4-4d9e-bfb2-7e167766e547", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1162541993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37ae523240a47bb936ef4b54994de61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdade5b65-04", "ovs_interfaceid": "dade5b65-0491-41c1-988b-d18a6613ec6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Converting VIF {"id": "dade5b65-0491-41c1-988b-d18a6613ec6d", "address": "fa:16:3e:cf:e2:1d", "network": {"id": "b9eb37b6-27e4-4d9e-bfb2-7e167766e547", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1162541993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37ae523240a47bb936ef4b54994de61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdade5b65-04", "ovs_interfaceid": "dade5b65-0491-41c1-988b-d18a6613ec6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:e2:1d,bridge_name='br-int',has_traffic_filtering=True,id=dade5b65-0491-41c1-988b-d18a6613ec6d,network=Network(b9eb37b6-27e4-4d9e-bfb2-7e167766e547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdade5b65-04') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG os_vif [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:e2:1d,bridge_name='br-int',has_traffic_filtering=True,id=dade5b65-0491-41c1-988b-d18a6613ec6d,network=Network(b9eb37b6-27e4-4d9e-bfb2-7e167766e547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdade5b65-04') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdade5b65-04, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdade5b65-04, col_values=(('external_ids', {'iface-id': 'dade5b65-0491-41c1-988b-d18a6613ec6d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:e2:1d', 'vm-uuid': 'f8b7d69e-f23a-4615-9f08-ce5fede9e4eb'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:14:17 user nova-compute[72239]: INFO os_vif [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:e2:1d,bridge_name='br-int',has_traffic_filtering=True,id=dade5b65-0491-41c1-988b-d18a6613ec6d,network=Network(b9eb37b6-27e4-4d9e-bfb2-7e167766e547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdade5b65-04')
Jul 31 15:14:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] No VIF found with MAC fa:16:3e:cf:e2:1d, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG nova.network.neutron [req-94321592-ceae-48a8-8c3f-5dd3530188ac req-af94ced9-b1f9-4c25-bf59-e04ac784bb89 service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Updated VIF entry in instance network info cache for port dade5b65-0491-41c1-988b-d18a6613ec6d. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG nova.network.neutron [req-94321592-ceae-48a8-8c3f-5dd3530188ac req-af94ced9-b1f9-4c25-bf59-e04ac784bb89 service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Updating instance_info_cache with network_info: [{"id": "dade5b65-0491-41c1-988b-d18a6613ec6d", "address": "fa:16:3e:cf:e2:1d", "network": {"id": "b9eb37b6-27e4-4d9e-bfb2-7e167766e547", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1162541993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37ae523240a47bb936ef4b54994de61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdade5b65-04", "ovs_interfaceid": "dade5b65-0491-41c1-988b-d18a6613ec6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:14:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-94321592-ceae-48a8-8c3f-5dd3530188ac req-af94ced9-b1f9-4c25-bf59-e04ac784bb89 service nova] Releasing lock "refresh_cache-f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:14:18 user nova-compute[72239]: DEBUG nova.compute.manager [req-dc618d21-aaae-4d35-9004-b2716f74f18e req-63996c17-7212-4f3a-aa33-291db9b58271 service nova] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Received event network-changed-20a43068-68ab-4588-a2b1-4ca7d685e504 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:14:18 user nova-compute[72239]: DEBUG nova.compute.manager [req-dc618d21-aaae-4d35-9004-b2716f74f18e req-63996c17-7212-4f3a-aa33-291db9b58271 service nova] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Refreshing instance network info cache due to event network-changed-20a43068-68ab-4588-a2b1-4ca7d685e504. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:14:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-dc618d21-aaae-4d35-9004-b2716f74f18e req-63996c17-7212-4f3a-aa33-291db9b58271 service nova] Acquiring lock "refresh_cache-27004836-5fb4-49cc-8be9-db2afef945a7" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:14:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-dc618d21-aaae-4d35-9004-b2716f74f18e req-63996c17-7212-4f3a-aa33-291db9b58271 service nova] Acquired lock "refresh_cache-27004836-5fb4-49cc-8be9-db2afef945a7" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:14:18 user nova-compute[72239]: DEBUG nova.network.neutron [req-dc618d21-aaae-4d35-9004-b2716f74f18e req-63996c17-7212-4f3a-aa33-291db9b58271 service nova] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Refreshing network info cache for port 20a43068-68ab-4588-a2b1-4ca7d685e504 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:14:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:14:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:14:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:14:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-c26dd6d0-8dd4-4c0b-80fa-2a3f653740ef req-46971142-b27d-429b-8727-4baad616c2c7 service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Received event network-vif-plugged-dade5b65-0491-41c1-988b-d18a6613ec6d {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:14:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-c26dd6d0-8dd4-4c0b-80fa-2a3f653740ef req-46971142-b27d-429b-8727-4baad616c2c7 service nova] Acquiring lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:14:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-c26dd6d0-8dd4-4c0b-80fa-2a3f653740ef req-46971142-b27d-429b-8727-4baad616c2c7 service nova] Lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:14:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-c26dd6d0-8dd4-4c0b-80fa-2a3f653740ef req-46971142-b27d-429b-8727-4baad616c2c7 service nova] Lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:14:19 user nova-compute[72239]: DEBUG nova.compute.manager [req-c26dd6d0-8dd4-4c0b-80fa-2a3f653740ef req-46971142-b27d-429b-8727-4baad616c2c7 service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] No waiting events found dispatching network-vif-plugged-dade5b65-0491-41c1-988b-d18a6613ec6d {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:14:19 user nova-compute[72239]: WARNING nova.compute.manager [req-c26dd6d0-8dd4-4c0b-80fa-2a3f653740ef req-46971142-b27d-429b-8727-4baad616c2c7 service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Received unexpected event network-vif-plugged-dade5b65-0491-41c1-988b-d18a6613ec6d for instance with vm_state building and task_state spawning.
Jul 31 15:14:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "27004836-5fb4-49cc-8be9-db2afef945a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:14:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "27004836-5fb4-49cc-8be9-db2afef945a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:14:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "27004836-5fb4-49cc-8be9-db2afef945a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:14:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "27004836-5fb4-49cc-8be9-db2afef945a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:14:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "27004836-5fb4-49cc-8be9-db2afef945a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:14:19 user nova-compute[72239]: INFO nova.compute.manager [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Terminating instance
Jul 31 15:14:19 user nova-compute[72239]: DEBUG nova.compute.manager [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 15:14:19 user nova-compute[72239]: DEBUG nova.network.neutron [req-dc618d21-aaae-4d35-9004-b2716f74f18e req-63996c17-7212-4f3a-aa33-291db9b58271 service nova] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Updated VIF entry in instance network info cache for port 20a43068-68ab-4588-a2b1-4ca7d685e504. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:14:19 user nova-compute[72239]: DEBUG nova.network.neutron [req-dc618d21-aaae-4d35-9004-b2716f74f18e req-63996c17-7212-4f3a-aa33-291db9b58271 service nova] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Updating instance_info_cache with network_info: [{"id": "20a43068-68ab-4588-a2b1-4ca7d685e504", "address": "fa:16:3e:86:f7:39", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20a43068-68", "ovs_interfaceid": "20a43068-68ab-4588-a2b1-4ca7d685e504", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:14:19 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-dc618d21-aaae-4d35-9004-b2716f74f18e req-63996c17-7212-4f3a-aa33-291db9b58271 service nova] Releasing lock "refresh_cache-27004836-5fb4-49cc-8be9-db2afef945a7" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:14:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:14:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:14:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:14:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:14:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:14:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:14:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:14:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:14:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:14:20 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Instance destroyed successfully.
Jul 31 15:14:20 user nova-compute[72239]: DEBUG nova.objects.instance [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lazy-loading 'resources' on Instance uuid 27004836-5fb4-49cc-8be9-db2afef945a7 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:12:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1986330739',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1986330739',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1986330739',id=47,image_ref='a95cd1aa-ca86-42b9-a4de-7596e427fe1b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPaoPPLt66pWH3zE+GpPB2BEdOMFv/qPG5EbqzIXstwV/kjW3s5Z2NdK6wwRBqZIQfLd+t9vFJNxveBc96/VhhixJnD0MvqbOCyMn46h7Ph3CGLDBnI/NvjWYRZyDi1YyA==',key_name='tempest-keypair-1050593475',keypairs=<?>,launch_index=0,launched_at=2023-07-31T15:12:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='35aaefdc03aa4e43b4ba435eea373cc4',ramdisk_id='',reservation_id='r-7g46u3l2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1903261024',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1903261024-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1903261024',owner_user_name='tempest-TestVolumeBootPattern-1903261024-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T15:12:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a73969a32be54c8caf621290e8823134',uuid=27004836-5fb4-49cc-8be9-db2afef945a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20a43068-68ab-4588-a2b1-4ca7d685e504", "address": "fa:16:3e:86:f7:39", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20a43068-68", "ovs_interfaceid": "20a43068-68ab-4588-a2b1-4ca7d685e504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Converting VIF {"id": "20a43068-68ab-4588-a2b1-4ca7d685e504", "address": "fa:16:3e:86:f7:39", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20a43068-68", "ovs_interfaceid": "20a43068-68ab-4588-a2b1-4ca7d685e504", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:f7:39,bridge_name='br-int',has_traffic_filtering=True,id=20a43068-68ab-4588-a2b1-4ca7d685e504,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20a43068-68') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG os_vif [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:f7:39,bridge_name='br-int',has_traffic_filtering=True,id=20a43068-68ab-4588-a2b1-4ca7d685e504,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20a43068-68') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20a43068-68, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:14:20 user nova-compute[72239]: INFO os_vif [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:f7:39,bridge_name='br-int',has_traffic_filtering=True,id=20a43068-68ab-4588-a2b1-4ca7d685e504,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20a43068-68')
Jul 31 15:14:20 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yveElKGF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:14:20 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:14:20 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1938bd-8add-4656-8455-507e8d53483d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[45af6b42-ce4a-4ed3-bf4e-ee9d662224f5]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac (non-flash)
Jul 31 15:14:20 user nova-compute[72239]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8 (non-flash)
Jul 31 15:14:20 user nova-compute[72239]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 (non-flash)
Jul 31 15:14:20 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac (non-flash)
Jul 31 15:14:20 user nova-compute[72239]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8 (non-flash)
Jul 31 15:14:20 user nova-compute[72239]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 (non-flash)
Jul 31 15:14:20 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4120154f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8'): ({'sdb'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Removing single pathed devices sdb {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e0ca99-4b1a-49a7-a2a0-bd2e1b35549e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7e5f6f-ecda-44f0-b078-1267bc7b53f7]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Flushing IO for device /dev/sdb {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3854bd5-a016-409e-94ad-a8a76e52295c]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ad3b533-c025-43bf-98d7-9a1417d01de6]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da3ff23-bf3e-42fb-8ae1-955ffd5877bf]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8 -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[631633ab-24cb-44a4-9b53-e69346a749ac]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8, portal: 172.16.0.220,3260]
Jul 31 15:14:20 user nova-compute[72239]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8, portal: 172.16.0.220,3260] successful.
Jul 31 15:14:20 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8 -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ef107601-5f4e-462d-ac0e-9023530cefc8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d81981-cff8-49b8-8a36-a24420b478e7]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] <== disconnect_volume: return (324ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 15:14:20 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Deleting instance files /opt/stack/data/nova/instances/27004836-5fb4-49cc-8be9-db2afef945a7_del
Jul 31 15:14:20 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Deletion of /opt/stack/data/nova/instances/27004836-5fb4-49cc-8be9-db2afef945a7_del complete
Jul 31 15:14:20 user nova-compute[72239]: INFO nova.compute.manager [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Took 1.26 seconds to destroy the instance on the hypervisor.
Jul 31 15:14:20 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 15:14:20 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 15:14:21 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690816461.2415588, f8b7d69e-f23a-4615-9f08-ce5fede9e4eb => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:14:21 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] VM Resumed (Lifecycle Event)
Jul 31 15:14:21 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 15:14:21 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 15:14:21 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Instance spawned successfully.
Jul 31 15:14:21 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 15:14:21 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:14:21 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:14:21 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:14:21 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:14:21 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:14:21 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:14:21 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:14:21 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:14:21 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 15:14:21 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690816461.2445018, f8b7d69e-f23a-4615-9f08-ce5fede9e4eb => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:14:21 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] VM Started (Lifecycle Event)
Jul 31 15:14:21 user nova-compute[72239]: INFO nova.compute.manager [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Took 6.29 seconds to spawn the instance on the hypervisor.
Jul 31 15:14:21 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:14:21 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:14:21 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:14:21 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 15:14:21 user nova-compute[72239]: INFO nova.compute.manager [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Took 6.87 seconds to build instance.
Jul 31 15:14:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-1b0e96ba-d923-4335-8a5e-544725ebdf34 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.973s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:14:21 user nova-compute[72239]: DEBUG nova.compute.manager [req-52814eda-8267-4bd0-990f-b0a0eee83725 req-fa5f3271-5c41-475c-a48e-beb280b76276 service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Received event network-vif-plugged-dade5b65-0491-41c1-988b-d18a6613ec6d {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:14:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-52814eda-8267-4bd0-990f-b0a0eee83725 req-fa5f3271-5c41-475c-a48e-beb280b76276 service nova] Acquiring lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:14:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-52814eda-8267-4bd0-990f-b0a0eee83725 req-fa5f3271-5c41-475c-a48e-beb280b76276 service nova] Lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:14:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-52814eda-8267-4bd0-990f-b0a0eee83725 req-fa5f3271-5c41-475c-a48e-beb280b76276 service nova] Lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:14:21 user nova-compute[72239]: DEBUG nova.compute.manager [req-52814eda-8267-4bd0-990f-b0a0eee83725 req-fa5f3271-5c41-475c-a48e-beb280b76276 service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] No waiting events found dispatching network-vif-plugged-dade5b65-0491-41c1-988b-d18a6613ec6d {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:14:21 user nova-compute[72239]: WARNING nova.compute.manager [req-52814eda-8267-4bd0-990f-b0a0eee83725 req-fa5f3271-5c41-475c-a48e-beb280b76276 service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Received unexpected event network-vif-plugged-dade5b65-0491-41c1-988b-d18a6613ec6d for instance with vm_state active and task_state None.
Jul 31 15:14:21 user nova-compute[72239]: DEBUG nova.compute.manager [req-52814eda-8267-4bd0-990f-b0a0eee83725 req-fa5f3271-5c41-475c-a48e-beb280b76276 service nova] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Received event network-vif-unplugged-20a43068-68ab-4588-a2b1-4ca7d685e504 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:14:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-52814eda-8267-4bd0-990f-b0a0eee83725 req-fa5f3271-5c41-475c-a48e-beb280b76276 service nova] Acquiring lock "27004836-5fb4-49cc-8be9-db2afef945a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:14:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-52814eda-8267-4bd0-990f-b0a0eee83725 req-fa5f3271-5c41-475c-a48e-beb280b76276 service nova] Lock "27004836-5fb4-49cc-8be9-db2afef945a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:14:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-52814eda-8267-4bd0-990f-b0a0eee83725 req-fa5f3271-5c41-475c-a48e-beb280b76276 service nova] Lock "27004836-5fb4-49cc-8be9-db2afef945a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:14:21 user nova-compute[72239]: DEBUG nova.compute.manager [req-52814eda-8267-4bd0-990f-b0a0eee83725 req-fa5f3271-5c41-475c-a48e-beb280b76276 service nova] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] No waiting events found dispatching network-vif-unplugged-20a43068-68ab-4588-a2b1-4ca7d685e504 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:14:21 user nova-compute[72239]: DEBUG nova.compute.manager [req-52814eda-8267-4bd0-990f-b0a0eee83725 req-fa5f3271-5c41-475c-a48e-beb280b76276 service nova] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Received event network-vif-unplugged-20a43068-68ab-4588-a2b1-4ca7d685e504 for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 15:14:21 user nova-compute[72239]: DEBUG nova.compute.manager [req-52814eda-8267-4bd0-990f-b0a0eee83725 req-fa5f3271-5c41-475c-a48e-beb280b76276 service nova] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Received event network-vif-plugged-20a43068-68ab-4588-a2b1-4ca7d685e504 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:14:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-52814eda-8267-4bd0-990f-b0a0eee83725 req-fa5f3271-5c41-475c-a48e-beb280b76276 service nova] Acquiring lock "27004836-5fb4-49cc-8be9-db2afef945a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:14:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-52814eda-8267-4bd0-990f-b0a0eee83725 req-fa5f3271-5c41-475c-a48e-beb280b76276 service nova] Lock "27004836-5fb4-49cc-8be9-db2afef945a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:14:21 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-52814eda-8267-4bd0-990f-b0a0eee83725 req-fa5f3271-5c41-475c-a48e-beb280b76276 service nova] Lock "27004836-5fb4-49cc-8be9-db2afef945a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:14:21 user nova-compute[72239]: DEBUG nova.compute.manager [req-52814eda-8267-4bd0-990f-b0a0eee83725 req-fa5f3271-5c41-475c-a48e-beb280b76276 service nova] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] No waiting events found dispatching network-vif-plugged-20a43068-68ab-4588-a2b1-4ca7d685e504 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:14:21 user nova-compute[72239]: WARNING nova.compute.manager [req-52814eda-8267-4bd0-990f-b0a0eee83725 req-fa5f3271-5c41-475c-a48e-beb280b76276 service nova] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Received unexpected event network-vif-plugged-20a43068-68ab-4588-a2b1-4ca7d685e504 for instance with vm_state active and task_state deleting.
Jul 31 15:14:21 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:14:21 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Took 1.21 seconds to deallocate network for instance.
Jul 31 15:14:22 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:14:22 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 15:14:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-fc5e6dfe-def8-47cb-8639-d93a39cfeeaa" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:14:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-fc5e6dfe-def8-47cb-8639-d93a39cfeeaa" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:14:22 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 15:14:22 user nova-compute[72239]: INFO nova.compute.manager [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Took 0.81 seconds to detach 1 volumes for instance.
Jul 31 15:14:22 user nova-compute[72239]: DEBUG nova.compute.manager [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Deleting volume: ef107601-5f4e-462d-ac0e-9023530cefc8 {{(pid=72239) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 31 15:14:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:14:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:14:23 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:14:23 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Updating instance_info_cache with network_info: [{"id": "21545375-78db-48b9-b32d-37349f2f809b", "address": "fa:16:3e:96:5d:34", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21545375-78", "ovs_interfaceid": "21545375-78db-48b9-b32d-37349f2f809b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:14:23 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:14:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-fc5e6dfe-def8-47cb-8639-d93a39cfeeaa" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:14:23 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 15:14:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.233s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:14:23 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Deleted allocations for instance 27004836-5fb4-49cc-8be9-db2afef945a7
Jul 31 15:14:23 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d68f0cfe-4975-437e-8473-6f34f3eed73b tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "27004836-5fb4-49cc-8be9-db2afef945a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.809s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:14:23 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:14:23 user nova-compute[72239]: DEBUG nova.compute.manager [req-f83f2bcb-d8c8-4367-b564-32cf531d3ead req-c4afe68d-8f39-4b1c-b3f2-5e6d2b95f471 service nova] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Received event network-vif-deleted-20a43068-68ab-4588-a2b1-4ca7d685e504 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:14:24 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:14:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:14:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:14:26 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:14:27 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:14:28 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:14:28 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 15:14:29 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:14:29 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:14:29 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:14:29 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:14:29 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 15:14:29 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8b7d69e-f23a-4615-9f08-ce5fede9e4eb/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:14:29 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8b7d69e-f23a-4615-9f08-ce5fede9e4eb/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:14:29 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8b7d69e-f23a-4615-9f08-ce5fede9e4eb/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:14:29 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8b7d69e-f23a-4615-9f08-ce5fede9e4eb/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:14:29 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 15:14:29 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 15:14:30 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:14:30 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:14:30 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=8502MB free_disk=25.13904571533203GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 15:14:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:14:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:14:30 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:14:30 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance fc5e6dfe-def8-47cb-8639-d93a39cfeeaa actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:14:30 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:14:30 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance f8b7d69e-f23a-4615-9f08-ce5fede9e4eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:14:30 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 15:14:30 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 15:14:30 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:14:30 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:14:30 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 15:14:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.250s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:14:35 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690816460.25662, 27004836-5fb4-49cc-8be9-db2afef945a7 => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:14:35 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] VM Stopped (Lifecycle Event)
Jul 31 15:14:35 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1ab49b81-5448-4fa6-97ef-f090b227b752 None None] [instance: 27004836-5fb4-49cc-8be9-db2afef945a7] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:14:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:14:40 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:14:40 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:14:41 user nova-compute[72239]: DEBUG nova.compute.manager [req-6912ac7f-0156-4d17-b779-92c9110e8c13 req-1e72c76d-1b9c-4ff0-a001-05749ff22bac service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Received event network-changed-64213693-d706-4784-81b5-74a181309dd4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:14:41 user nova-compute[72239]: DEBUG nova.compute.manager [req-6912ac7f-0156-4d17-b779-92c9110e8c13 req-1e72c76d-1b9c-4ff0-a001-05749ff22bac service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Refreshing instance network info cache due to event network-changed-64213693-d706-4784-81b5-74a181309dd4. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:14:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-6912ac7f-0156-4d17-b779-92c9110e8c13 req-1e72c76d-1b9c-4ff0-a001-05749ff22bac service nova] Acquiring lock "refresh_cache-f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:14:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-6912ac7f-0156-4d17-b779-92c9110e8c13 req-1e72c76d-1b9c-4ff0-a001-05749ff22bac service nova] Acquired lock "refresh_cache-f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:14:41 user nova-compute[72239]: DEBUG nova.network.neutron [req-6912ac7f-0156-4d17-b779-92c9110e8c13 req-1e72c76d-1b9c-4ff0-a001-05749ff22bac service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Refreshing network info cache for port 64213693-d706-4784-81b5-74a181309dd4 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:14:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Acquiring lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:14:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:14:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Acquiring lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:14:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:14:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:14:41 user nova-compute[72239]: INFO nova.compute.manager [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Terminating instance
Jul 31 15:14:41 user nova-compute[72239]: DEBUG nova.compute.manager [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 15:14:41 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:14:41 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:14:41 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG nova.compute.manager [req-b3ec1d9d-daa7-43fd-b532-f6aade7f64f5 req-37e271cd-4304-4f47-987a-37b93e0893fe service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Received event network-vif-unplugged-64213693-d706-4784-81b5-74a181309dd4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b3ec1d9d-daa7-43fd-b532-f6aade7f64f5 req-37e271cd-4304-4f47-987a-37b93e0893fe service nova] Acquiring lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b3ec1d9d-daa7-43fd-b532-f6aade7f64f5 req-37e271cd-4304-4f47-987a-37b93e0893fe service nova] Lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b3ec1d9d-daa7-43fd-b532-f6aade7f64f5 req-37e271cd-4304-4f47-987a-37b93e0893fe service nova] Lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG nova.compute.manager [req-b3ec1d9d-daa7-43fd-b532-f6aade7f64f5 req-37e271cd-4304-4f47-987a-37b93e0893fe service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] No waiting events found dispatching network-vif-unplugged-64213693-d706-4784-81b5-74a181309dd4 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG nova.compute.manager [req-b3ec1d9d-daa7-43fd-b532-f6aade7f64f5 req-37e271cd-4304-4f47-987a-37b93e0893fe service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Received event network-vif-unplugged-64213693-d706-4784-81b5-74a181309dd4 for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG nova.network.neutron [req-6912ac7f-0156-4d17-b779-92c9110e8c13 req-1e72c76d-1b9c-4ff0-a001-05749ff22bac service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Updated VIF entry in instance network info cache for port 64213693-d706-4784-81b5-74a181309dd4. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG nova.network.neutron [req-6912ac7f-0156-4d17-b779-92c9110e8c13 req-1e72c76d-1b9c-4ff0-a001-05749ff22bac service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Updating instance_info_cache with network_info: [{"id": "64213693-d706-4784-81b5-74a181309dd4", "address": "fa:16:3e:b2:e3:7d", "network": {"id": "cbc10aaa-d0d9-4abe-bf51-17206a8f085a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1222279697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba645b8f83ca4a15a1a6659572778375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64213693-d7", "ovs_interfaceid": "64213693-d706-4784-81b5-74a181309dd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:14:42 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Instance destroyed successfully.
Jul 31 15:14:42 user nova-compute[72239]: DEBUG nova.objects.instance [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lazy-loading 'resources' on Instance uuid f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-31T15:09:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1994135225',display_name='tempest-TestShelveInstance-server-1994135225',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1994135225',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP3qQ5EyJIarsxl7CaYOuVPwwqk4C7G4wSQwfzuItUZmVtlZcdALH0os05s05+hzmMpQ5fVwLwISvjkca5M9UBRVUUk+gNi7cnH1xg8jF0VqKa4OiRnwlx8eP9rTGwh+wQ==',key_name='tempest-TestShelveInstance-2002616022',keypairs=<?>,launch_index=0,launched_at=2023-07-31T15:13:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ba645b8f83ca4a15a1a6659572778375',ramdisk_id='',reservation_id='r-96pfnsos',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1245549841',owner_user_name='tempest-TestShelveInstance-1245549841-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T15:13:06Z,user_data=None,user_id='8138394ef7f641309224d84d8789c831',uuid=f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64213693-d706-4784-81b5-74a181309dd4", "address": "fa:16:3e:b2:e3:7d", "network": {"id": "cbc10aaa-d0d9-4abe-bf51-17206a8f085a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1222279697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba645b8f83ca4a15a1a6659572778375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64213693-d7", "ovs_interfaceid": "64213693-d706-4784-81b5-74a181309dd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Converting VIF {"id": "64213693-d706-4784-81b5-74a181309dd4", "address": "fa:16:3e:b2:e3:7d", "network": {"id": "cbc10aaa-d0d9-4abe-bf51-17206a8f085a", "bridge": "br-int", "label": "tempest-TestShelveInstance-1222279697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.25", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ba645b8f83ca4a15a1a6659572778375", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64213693-d7", "ovs_interfaceid": "64213693-d706-4784-81b5-74a181309dd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b2:e3:7d,bridge_name='br-int',has_traffic_filtering=True,id=64213693-d706-4784-81b5-74a181309dd4,network=Network(cbc10aaa-d0d9-4abe-bf51-17206a8f085a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64213693-d7') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG os_vif [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:e3:7d,bridge_name='br-int',has_traffic_filtering=True,id=64213693-d706-4784-81b5-74a181309dd4,network=Network(cbc10aaa-d0d9-4abe-bf51-17206a8f085a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64213693-d7') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-6912ac7f-0156-4d17-b779-92c9110e8c13 req-1e72c76d-1b9c-4ff0-a001-05749ff22bac service nova] Releasing lock "refresh_cache-f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64213693-d7, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:14:42 user nova-compute[72239]: INFO os_vif [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b2:e3:7d,bridge_name='br-int',has_traffic_filtering=True,id=64213693-d706-4784-81b5-74a181309dd4,network=Network(cbc10aaa-d0d9-4abe-bf51-17206a8f085a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64213693-d7')
Jul 31 15:14:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'moMrhZRv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:14:42 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:14:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a858e7-b401-4658-89d3-0b158535811c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[775ca34d-5ccd-4b1f-99e7-478889eed149]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac (non-flash)
Jul 31 15:14:42 user nova-compute[72239]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 (non-flash)
Jul 31 15:14:42 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac (non-flash)
Jul 31 15:14:42 user nova-compute[72239]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 (non-flash)
Jul 31 15:14:42 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41202475b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723'): ({'sdc'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Removing single pathed devices sdc {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[12dc25c2-6438-4761-9a4a-652a6f6ba47e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[022b6225-f1a3-4327-bfb3-d33ec2ccce81]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Flushing IO for device /dev/sdc {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6cc0b0-05f7-4b20-a860-91c2e1769a62]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b7ef28-d431-4d89-a95d-1fef0a0f2bd6]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] SCSI volumes sdc have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26433366461323735', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_50826f93', '/dev/disk/by-id/scsi-1SCST_BIO50826f93-d36da2756e1fb135') {{(pid=83493) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dfd8426-8d90-4a5d-88b9-fc28fc13a9da]: (4, None) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a96bab4-1fb7-461e-b85f-1433311a4a7e]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[75857c90-1cc2-4c7e-b001-b7e68e208ec4]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723, portal: 172.16.0.220,3260]
Jul 31 15:14:42 user nova-compute[72239]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723, portal: 172.16.0.220,3260] successful.
Jul 31 15:14:42 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7d836cb-af79-406d-8b9a-eadcda156723 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[52329719-69e1-4917-9fbb-439a1333c762]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] <== disconnect_volume: return (300ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 15:14:42 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Deleting instance files /opt/stack/data/nova/instances/f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0_del
Jul 31 15:14:42 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Deletion of /opt/stack/data/nova/instances/f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0_del complete
Jul 31 15:14:42 user nova-compute[72239]: INFO nova.compute.manager [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Took 1.18 seconds to destroy the instance on the hypervisor.
Jul 31 15:14:42 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 15:14:42 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 15:14:43 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:14:43 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Took 0.56 seconds to deallocate network for instance.
Jul 31 15:14:43 user nova-compute[72239]: INFO nova.compute.manager [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Took 0.83 seconds to detach 1 volumes for instance.
Jul 31 15:14:43 user nova-compute[72239]: DEBUG nova.compute.manager [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Deleting volume: d7d836cb-af79-406d-8b9a-eadcda156723 {{(pid=72239) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 31 15:14:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:14:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:14:44 user nova-compute[72239]: DEBUG nova.compute.manager [req-51c72016-a70f-494b-aeee-89b68cf74842 req-ff0b216b-7626-45de-be13-6fe27b5175ce service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Received event network-vif-plugged-64213693-d706-4784-81b5-74a181309dd4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:14:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-51c72016-a70f-494b-aeee-89b68cf74842 req-ff0b216b-7626-45de-be13-6fe27b5175ce service nova] Acquiring lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:14:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-51c72016-a70f-494b-aeee-89b68cf74842 req-ff0b216b-7626-45de-be13-6fe27b5175ce service nova] Lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:14:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-51c72016-a70f-494b-aeee-89b68cf74842 req-ff0b216b-7626-45de-be13-6fe27b5175ce service nova] Lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:14:44 user nova-compute[72239]: DEBUG nova.compute.manager [req-51c72016-a70f-494b-aeee-89b68cf74842 req-ff0b216b-7626-45de-be13-6fe27b5175ce service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] No waiting events found dispatching network-vif-plugged-64213693-d706-4784-81b5-74a181309dd4 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:14:44 user nova-compute[72239]: WARNING nova.compute.manager [req-51c72016-a70f-494b-aeee-89b68cf74842 req-ff0b216b-7626-45de-be13-6fe27b5175ce service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Received unexpected event network-vif-plugged-64213693-d706-4784-81b5-74a181309dd4 for instance with vm_state deleted and task_state None.
Jul 31 15:14:44 user nova-compute[72239]: DEBUG nova.compute.manager [req-51c72016-a70f-494b-aeee-89b68cf74842 req-ff0b216b-7626-45de-be13-6fe27b5175ce service nova] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Received event network-vif-deleted-64213693-d706-4784-81b5-74a181309dd4 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:14:44 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:14:44 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:14:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.209s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:14:44 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Deleted allocations for instance f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0
Jul 31 15:14:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b864d67b-1d7e-4a49-9b4f-175adb07cc9f tempest-TestShelveInstance-1245549841 tempest-TestShelveInstance-1245549841-project-member] Lock "f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.031s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:14:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:14:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:14:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:14:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:14:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:14:57 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690816482.1433947, f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0 => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:14:57 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] VM Stopped (Lifecycle Event)
Jul 31 15:14:57 user nova-compute[72239]: DEBUG nova.compute.manager [None req-72368ebc-bceb-49db-a4ab-160c1f98fbba None None] [instance: f2fbfdf2-ad6e-4304-b9fc-7576c92bcbd0] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:14:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:15:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:15:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:15:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:15:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:15:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:15:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:15:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:15:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:15:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "fc5e6dfe-def8-47cb-8639-d93a39cfeeaa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:15:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "fc5e6dfe-def8-47cb-8639-d93a39cfeeaa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:15:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "fc5e6dfe-def8-47cb-8639-d93a39cfeeaa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:15:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "fc5e6dfe-def8-47cb-8639-d93a39cfeeaa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:15:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "fc5e6dfe-def8-47cb-8639-d93a39cfeeaa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:15:13 user nova-compute[72239]: INFO nova.compute.manager [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Terminating instance
Jul 31 15:15:13 user nova-compute[72239]: DEBUG nova.compute.manager [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 15:15:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:15:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:15:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:15:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:15:13 user nova-compute[72239]: DEBUG nova.compute.manager [req-927ff1c5-e2bf-4106-951e-532688ff5bf8 req-ff3de834-cbca-4820-8e46-810d53882427 service nova] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Received event network-vif-unplugged-21545375-78db-48b9-b32d-37349f2f809b {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:15:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-927ff1c5-e2bf-4106-951e-532688ff5bf8 req-ff3de834-cbca-4820-8e46-810d53882427 service nova] Acquiring lock "fc5e6dfe-def8-47cb-8639-d93a39cfeeaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:15:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-927ff1c5-e2bf-4106-951e-532688ff5bf8 req-ff3de834-cbca-4820-8e46-810d53882427 service nova] Lock "fc5e6dfe-def8-47cb-8639-d93a39cfeeaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:15:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-927ff1c5-e2bf-4106-951e-532688ff5bf8 req-ff3de834-cbca-4820-8e46-810d53882427 service nova] Lock "fc5e6dfe-def8-47cb-8639-d93a39cfeeaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:15:13 user nova-compute[72239]: DEBUG nova.compute.manager [req-927ff1c5-e2bf-4106-951e-532688ff5bf8 req-ff3de834-cbca-4820-8e46-810d53882427 service nova] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] No waiting events found dispatching network-vif-unplugged-21545375-78db-48b9-b32d-37349f2f809b {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:15:13 user nova-compute[72239]: DEBUG nova.compute.manager [req-927ff1c5-e2bf-4106-951e-532688ff5bf8 req-ff3de834-cbca-4820-8e46-810d53882427 service nova] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Received event network-vif-unplugged-21545375-78db-48b9-b32d-37349f2f809b for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 15:15:13 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Instance destroyed successfully.
Jul 31 15:15:13 user nova-compute[72239]: DEBUG nova.objects.instance [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lazy-loading 'resources' on Instance uuid fc5e6dfe-def8-47cb-8639-d93a39cfeeaa {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:15:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:10:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1972320020',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1972320020',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1972320020',id=46,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCAYA8orIqYdvT0NtuugFJ4sGqt3q+via2daMBXsXRl1bzr9FbJ6moNijUFQb9n5WqtSGRz9T++3yYY7vi3weuhPIqYlZv3cC6T5j1nr1p87d1QI7NMD0d62lKR9ff/kJQ==',key_name='tempest-keypair-730554026',keypairs=<?>,launch_index=0,launched_at=2023-07-31T15:10:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='35aaefdc03aa4e43b4ba435eea373cc4',ramdisk_id='',reservation_id='r-e2e830w9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1903261024',owner_user_name='tempest-TestVolumeBootPattern-1903261024-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T15:10:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a73969a32be54c8caf621290e8823134',uuid=fc5e6dfe-def8-47cb-8639-d93a39cfeeaa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "21545375-78db-48b9-b32d-37349f2f809b", "address": "fa:16:3e:96:5d:34", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21545375-78", "ovs_interfaceid": "21545375-78db-48b9-b32d-37349f2f809b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 15:15:13 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Converting VIF {"id": "21545375-78db-48b9-b32d-37349f2f809b", "address": "fa:16:3e:96:5d:34", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap21545375-78", "ovs_interfaceid": "21545375-78db-48b9-b32d-37349f2f809b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:15:13 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:96:5d:34,bridge_name='br-int',has_traffic_filtering=True,id=21545375-78db-48b9-b32d-37349f2f809b,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21545375-78') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:15:13 user nova-compute[72239]: DEBUG os_vif [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:5d:34,bridge_name='br-int',has_traffic_filtering=True,id=21545375-78db-48b9-b32d-37349f2f809b,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21545375-78') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 15:15:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:15:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap21545375-78, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:15:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:15:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:15:13 user nova-compute[72239]: INFO os_vif [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:96:5d:34,bridge_name='br-int',has_traffic_filtering=True,id=21545375-78db-48b9-b32d-37349f2f809b,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap21545375-78')
Jul 31 15:15:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 15:15:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LlRwhzXP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:15:13 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:15:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:15:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:15:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 15:15:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:15:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:15:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[541f3eaf-d5e3-4e0c-89f4-ffb2952532fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:15:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:15:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:15:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ae5fca-a5c9-4224-b87f-ddb74040f773]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:15:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac (non-flash)
Jul 31 15:15:13 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:15:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac (non-flash)
Jul 31 15:15:13 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:15:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41201cf9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac'): ({'sdd'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 15:15:13 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Removing single pathed devices sdd {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 15:15:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:15:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:15:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c876dab2-7fb1-490d-8ad9-324d4759183c]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:15:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:15:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:15:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f662d4-319f-4ef1-863b-2a8f9defab0b]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:15:14 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Flushing IO for device /dev/sdd {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 15:15:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:15:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:15:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[281914d7-841a-4b9d-b651-9af49de6e905]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:15:14 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 15:15:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:15:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:15:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea909cc3-653e-4437-9c49-49fa0caa79de]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:15:14 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 15:15:14 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] SCSI volumes sdd have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 15:15:14 user nova-compute[72239]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_8b9eb868', '/dev/disk/by-id/scsi-23661303364653339', '/dev/disk/by-id/scsi-1SCST_BIO8b9eb868-6a03de392c21c0e1') {{(pid=83493) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 31 15:15:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[82051cda-c260-4ebf-8ef5-93a54e4f12ba]: (4, None) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:15:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 15:15:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:15:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:15:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[822227f4-225a-4085-9a01-98cc2ab2347a]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:15:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:15:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:15:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:15:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2af5b7f-2b2d-47fb-ae12-5eff11ba917f]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:15:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac, portal: 172.16.0.220,3260]
Jul 31 15:15:14 user nova-compute[72239]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac, portal: 172.16.0.220,3260] successful.
Jul 31 15:15:14 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:15:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:15:14 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:23b8f653-d0da-48f4-a96a-c9ee06333dac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:15:14 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67ef71a-ff4e-4f6e-8c16-f414f33d2c09]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:15:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:15:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:15:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] <== disconnect_volume: return (328ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:15:14 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 15:15:14 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Deleting instance files /opt/stack/data/nova/instances/fc5e6dfe-def8-47cb-8639-d93a39cfeeaa_del
Jul 31 15:15:14 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Deletion of /opt/stack/data/nova/instances/fc5e6dfe-def8-47cb-8639-d93a39cfeeaa_del complete
Jul 31 15:15:14 user nova-compute[72239]: INFO nova.compute.manager [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Took 1.28 seconds to destroy the instance on the hypervisor.
Jul 31 15:15:14 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 15:15:14 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 15:15:14 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 15:15:15 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:15:15 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Took 0.85 seconds to deallocate network for instance.
Jul 31 15:15:15 user nova-compute[72239]: DEBUG nova.compute.manager [req-e8bf982f-cc82-4952-865b-d5e6f3b2624f req-24922574-dabf-444b-8754-089715112a07 service nova] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Received event network-vif-plugged-21545375-78db-48b9-b32d-37349f2f809b {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:15:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e8bf982f-cc82-4952-865b-d5e6f3b2624f req-24922574-dabf-444b-8754-089715112a07 service nova] Acquiring lock "fc5e6dfe-def8-47cb-8639-d93a39cfeeaa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:15:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e8bf982f-cc82-4952-865b-d5e6f3b2624f req-24922574-dabf-444b-8754-089715112a07 service nova] Lock "fc5e6dfe-def8-47cb-8639-d93a39cfeeaa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:15:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e8bf982f-cc82-4952-865b-d5e6f3b2624f req-24922574-dabf-444b-8754-089715112a07 service nova] Lock "fc5e6dfe-def8-47cb-8639-d93a39cfeeaa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:15:15 user nova-compute[72239]: DEBUG nova.compute.manager [req-e8bf982f-cc82-4952-865b-d5e6f3b2624f req-24922574-dabf-444b-8754-089715112a07 service nova] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] No waiting events found dispatching network-vif-plugged-21545375-78db-48b9-b32d-37349f2f809b {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:15:15 user nova-compute[72239]: WARNING nova.compute.manager [req-e8bf982f-cc82-4952-865b-d5e6f3b2624f req-24922574-dabf-444b-8754-089715112a07 service nova] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Received unexpected event network-vif-plugged-21545375-78db-48b9-b32d-37349f2f809b for instance with vm_state active and task_state deleting.
Jul 31 15:15:15 user nova-compute[72239]: DEBUG nova.compute.manager [req-e8bf982f-cc82-4952-865b-d5e6f3b2624f req-24922574-dabf-444b-8754-089715112a07 service nova] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Received event network-vif-deleted-21545375-78db-48b9-b32d-37349f2f809b {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:15:16 user nova-compute[72239]: INFO nova.compute.manager [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Took 0.73 seconds to detach 1 volumes for instance.
Jul 31 15:15:16 user nova-compute[72239]: DEBUG nova.compute.manager [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Deleting volume: 23b8f653-d0da-48f4-a96a-c9ee06333dac {{(pid=72239) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 31 15:15:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:15:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:15:16 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:15:16 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:15:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.171s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:15:16 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Deleted allocations for instance fc5e6dfe-def8-47cb-8639-d93a39cfeeaa
Jul 31 15:15:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ddfe7bd4-69b1-495d-a6cf-043ffc8f3a6a tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "fc5e6dfe-def8-47cb-8639-d93a39cfeeaa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.288s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:15:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:15:18 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:15:18 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:15:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:15:22 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:15:22 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:15:22 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 15:15:22 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Didn't find any instances for network info cache update. {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 15:15:23 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:15:23 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:15:23 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:15:23 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:15:23 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:15:23 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:15:25 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:15:27 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:15:28 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:15:28 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:15:28 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 15:15:28 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690816513.8723269, fc5e6dfe-def8-47cb-8639-d93a39cfeeaa => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:15:28 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] VM Stopped (Lifecycle Event)
Jul 31 15:15:28 user nova-compute[72239]: DEBUG nova.compute.manager [None req-83d05026-dd8f-43b0-8dc4-971131d74de6 None None] [instance: fc5e6dfe-def8-47cb-8639-d93a39cfeeaa] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:15:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:15:30 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:15:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:15:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:15:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:15:30 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 15:15:30 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8b7d69e-f23a-4615-9f08-ce5fede9e4eb/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:15:30 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8b7d69e-f23a-4615-9f08-ce5fede9e4eb/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:15:30 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8b7d69e-f23a-4615-9f08-ce5fede9e4eb/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:15:30 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8b7d69e-f23a-4615-9f08-ce5fede9e4eb/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:15:31 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:15:31 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:15:31 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=8632MB free_disk=25.100719451904297GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 15:15:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:15:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:15:31 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance f8b7d69e-f23a-4615-9f08-ce5fede9e4eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:15:31 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 15:15:31 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 15:15:31 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Refreshing inventories for resource provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 15:15:31 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Updating ProviderTree inventory for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 15:15:31 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Updating inventory in ProviderTree for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 15:15:31 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Refreshing aggregate associations for resource provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e, aggregates: None {{(pid=72239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 15:15:31 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Refreshing trait associations for resource provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI {{(pid=72239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 15:15:31 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:15:31 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:15:31 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 15:15:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.454s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:15:32 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:15:32 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Cleaning up deleted instances {{(pid=72239) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 15:15:32 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] There are 0 instances to clean {{(pid=72239) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 15:15:33 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:15:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:15:38 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:15:38 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:15:40 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:15:41 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:15:41 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Cleaning up deleted instances with incomplete migration  {{(pid=72239) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 15:15:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:15:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:15:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:15:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:15:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:15:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:15:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:15:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:15:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:16:03 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:16:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:16:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquiring lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:16:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:16:09 user nova-compute[72239]: DEBUG nova.objects.instance [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lazy-loading 'flavor' on Instance uuid f8b7d69e-f23a-4615-9f08-ce5fede9e4eb {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:16:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:16:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquiring lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:16:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:16:09 user nova-compute[72239]: INFO nova.compute.manager [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Attaching volume 89b87676-c2ea-443a-837d-4e4fb1057224 to /dev/vdb
Jul 31 15:16:09 user nova-compute[72239]: DEBUG os_brick.utils [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:16:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:16:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:16:09 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fced067f-5728-4135-9929-dc41ffb9583d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:16:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:16:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:16:09 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69e2e09-5d4d-4762-9c56-ffe49b84243c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:16:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:16:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:16:09 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b027c32f-14c3-4845-bf52-d783a95579e3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:16:09 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a46eef8-5843-4acd-b348-5bf830ac6ced]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:16:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:16:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:16:09 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 15:16:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:16:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:16:09 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 15:16:09 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c3bbd0-2720-4d62-ba99-19dd29ec780a]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:16:09 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 15:16:09 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 15:16:09 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 15:16:09 user nova-compute[72239]: DEBUG os_brick.utils [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:16:09 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Updating existing volume attachment record: 001fb811-c8dd-4335-96ba-58b06dfbe2fe {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 15:16:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:16:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "97a662be-f1cf-4cd7-a98d-d22996f6282e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:16:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "97a662be-f1cf-4cd7-a98d-d22996f6282e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:16:14 user nova-compute[72239]: DEBUG nova.compute.manager [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 15:16:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:16:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:16:14 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 15:16:14 user nova-compute[72239]: INFO nova.compute.claims [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Claim successful on node user
Jul 31 15:16:14 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:16:14 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:16:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.203s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:16:14 user nova-compute[72239]: DEBUG nova.compute.manager [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 15:16:14 user nova-compute[72239]: DEBUG nova.compute.manager [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 15:16:14 user nova-compute[72239]: DEBUG nova.network.neutron [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 15:16:14 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 15:16:14 user nova-compute[72239]: DEBUG nova.compute.manager [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 15:16:15 user nova-compute[72239]: INFO nova.virt.block_device [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Booting with volume f439f64a-a30f-4ab8-811f-65673bcb1bbc at /dev/vda
Jul 31 15:16:15 user nova-compute[72239]: DEBUG nova.policy [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a73969a32be54c8caf621290e8823134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aaefdc03aa4e43b4ba435eea373cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 15:16:15 user nova-compute[72239]: DEBUG os_brick.utils [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:16:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:16:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:16:15 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[47effeef-6f13-462f-bfd8-c3b7696642ae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:16:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:16:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:16:15 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5975402a-9a05-4a74-ad9e-a136d362bafe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:16:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:16:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:16:15 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d4a4d7-a35a-4a24-ad2a-7f353c3bcc87]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:16:15 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17a4d76-1fa8-47b3-8c93-d57fbe1ddecd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:16:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:16:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:16:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 15:16:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:16:15 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:16:15 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 15:16:15 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[890448d2-1fec-4a52-9f56-90dee6e173d9]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:16:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 15:16:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 15:16:15 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 15:16:15 user nova-compute[72239]: DEBUG os_brick.utils [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:16:15 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Updating existing volume attachment record: e4d3411a-2447-44fe-9aec-215104ae9f36 {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 15:16:16 user nova-compute[72239]: DEBUG nova.network.neutron [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Successfully created port: b70a659a-8d31-407d-b2af-9ae98bd349ea {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 15:16:16 user nova-compute[72239]: DEBUG nova.network.neutron [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Successfully updated port: b70a659a-8d31-407d-b2af-9ae98bd349ea {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 15:16:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "refresh_cache-97a662be-f1cf-4cd7-a98d-d22996f6282e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:16:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquired lock "refresh_cache-97a662be-f1cf-4cd7-a98d-d22996f6282e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:16:16 user nova-compute[72239]: DEBUG nova.network.neutron [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 15:16:16 user nova-compute[72239]: DEBUG nova.compute.manager [req-0b89696f-eb71-40c0-881a-4bb5e7177abf req-3987c7d6-a174-4b0d-b489-54cfe6d97e8c service nova] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Received event network-changed-b70a659a-8d31-407d-b2af-9ae98bd349ea {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:16:16 user nova-compute[72239]: DEBUG nova.compute.manager [req-0b89696f-eb71-40c0-881a-4bb5e7177abf req-3987c7d6-a174-4b0d-b489-54cfe6d97e8c service nova] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Refreshing instance network info cache due to event network-changed-b70a659a-8d31-407d-b2af-9ae98bd349ea. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:16:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0b89696f-eb71-40c0-881a-4bb5e7177abf req-3987c7d6-a174-4b0d-b489-54cfe6d97e8c service nova] Acquiring lock "refresh_cache-97a662be-f1cf-4cd7-a98d-d22996f6282e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:16:16 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 15:16:16 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WXHIpoNQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:16:16 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:16:16 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:16:16 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:16:16 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:16:16 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:16:16 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:16:16 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 15:16:16 user nova-compute[72239]: DEBUG nova.network.neutron [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 15:16:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224 -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:16:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:16:16 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3dabb1-c423-4e91-89ad-c0c007190475]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:16:16 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 15:16:16 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:16:16 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224 -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[02eeb011-7683-4130-b388-b782993ab28b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224] added
Jul 31 15:16:17 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40ca304-c022-4ad6-9b78-4dd4ec080772]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6aa6da7-da39-47ea-bec3-7a7989e26e50]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WXHIpoNQ {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WXHIpoNQ" returned: 0 in 0.025s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[82ba7b3e-7123-4ee3-ba40-a66aeb7db34b]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WXHIpoNQ'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f579ff78-2026-4821-abbb-e120009a94ac]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[94611212-480f-4815-b89e-d93cee21fd26]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 15:16:17 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 15:16:17 user nova-compute[72239]:  {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:16:17 user nova-compute[72239]: WARNING os_brick.initiator.connectors.iscsi [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 15:16:17 user nova-compute[72239]: 
Jul 31 15:16:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224 -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be3b16d-3afd-46f7-9b21-831c7a8f8e3d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224, portal: 172.16.0.220,3260]
Jul 31 15:16:17 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224, portal: 172.16.0.220,3260] successful.
Jul 31 15:16:17 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc2771e-68b0-4ec3-bb05-2d184a9f08b1]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0212f251-6e6c-43b5-999d-44fc29b9bcad]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224 (non-flash)
Jul 31 15:16:17 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224 (non-flash)
Jul 31 15:16:17 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28b2fd3-e5f3-4431-9a8d-f93b1416a69d]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WXHIpoNQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG nova.network.neutron [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Updating instance_info_cache with network_info: [{"id": "b70a659a-8d31-407d-b2af-9ae98bd349ea", "address": "fa:16:3e:ac:9d:39", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70a659a-8d", "ovs_interfaceid": "b70a659a-8d31-407d-b2af-9ae98bd349ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Releasing lock "refresh_cache-97a662be-f1cf-4cd7-a98d-d22996f6282e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG nova.compute.manager [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Instance network_info: |[{"id": "b70a659a-8d31-407d-b2af-9ae98bd349ea", "address": "fa:16:3e:ac:9d:39", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70a659a-8d", "ovs_interfaceid": "b70a659a-8d31-407d-b2af-9ae98bd349ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0b89696f-eb71-40c0-881a-4bb5e7177abf req-3987c7d6-a174-4b0d-b489-54cfe6d97e8c service nova] Acquired lock "refresh_cache-97a662be-f1cf-4cd7-a98d-d22996f6282e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG nova.network.neutron [req-0b89696f-eb71-40c0-881a-4bb5e7177abf req-3987c7d6-a174-4b0d-b489-54cfe6d97e8c service nova] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Refreshing network info cache for port b70a659a-8d31-407d-b2af-9ae98bd349ea {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG nova.network.neutron [req-0b89696f-eb71-40c0-881a-4bb5e7177abf req-3987c7d6-a174-4b0d-b489-54cfe6d97e8c service nova] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Updated VIF entry in instance network info cache for port b70a659a-8d31-407d-b2af-9ae98bd349ea. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG nova.network.neutron [req-0b89696f-eb71-40c0-881a-4bb5e7177abf req-3987c7d6-a174-4b0d-b489-54cfe6d97e8c service nova] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Updating instance_info_cache with network_info: [{"id": "b70a659a-8d31-407d-b2af-9ae98bd349ea", "address": "fa:16:3e:ac:9d:39", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70a659a-8d", "ovs_interfaceid": "b70a659a-8d31-407d-b2af-9ae98bd349ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:16:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-0b89696f-eb71-40c0-881a-4bb5e7177abf req-3987c7d6-a174-4b0d-b489-54cfe6d97e8c service nova] Releasing lock "refresh_cache-97a662be-f1cf-4cd7-a98d-d22996f6282e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:16:18 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.300s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:16:18 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23739386337376535', 'path': '/dev/sdb'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:16:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739386337376535', 'path': '/dev/sdb'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 15:16:18 user nova-compute[72239]: DEBUG nova.objects.instance [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lazy-loading 'flavor' on Instance uuid f8b7d69e-f23a-4615-9f08-ce5fede9e4eb {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:16:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 15:16:18 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:16:18 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 15:16:18 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 15:16:18 user nova-compute[72239]:   <serial>89b87676-c2ea-443a-837d-4e4fb1057224</serial>
Jul 31 15:16:18 user nova-compute[72239]: </disk>
Jul 31 15:16:18 user nova-compute[72239]:  {{(pid=72239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 15:16:18 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:16:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:16:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:16:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] No VIF found with MAC fa:16:3e:cf:e2:1d, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 15:16:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a40ec44c-28de-44cd-a14e-7881ab7293dc tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.287s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:16:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:16:20 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:16:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG nova.compute.manager [req-25228e89-a28c-4fee-9c2e-067ff1264e10 req-d2571837-1412-4749-91dd-2cbeb50ae6dc service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Received event network-changed-dade5b65-0491-41c1-988b-d18a6613ec6d {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG nova.compute.manager [req-25228e89-a28c-4fee-9c2e-067ff1264e10 req-d2571837-1412-4749-91dd-2cbeb50ae6dc service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Refreshing instance network info cache due to event network-changed-dade5b65-0491-41c1-988b-d18a6613ec6d. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-25228e89-a28c-4fee-9c2e-067ff1264e10 req-d2571837-1412-4749-91dd-2cbeb50ae6dc service nova] Acquiring lock "refresh_cache-f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-25228e89-a28c-4fee-9c2e-067ff1264e10 req-d2571837-1412-4749-91dd-2cbeb50ae6dc service nova] Acquired lock "refresh_cache-f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG nova.network.neutron [req-25228e89-a28c-4fee-9c2e-067ff1264e10 req-d2571837-1412-4749-91dd-2cbeb50ae6dc service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Refreshing network info cache for port dade5b65-0491-41c1-988b-d18a6613ec6d {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG nova.network.neutron [req-25228e89-a28c-4fee-9c2e-067ff1264e10 req-d2571837-1412-4749-91dd-2cbeb50ae6dc service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Updated VIF entry in instance network info cache for port dade5b65-0491-41c1-988b-d18a6613ec6d. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG nova.network.neutron [req-25228e89-a28c-4fee-9c2e-067ff1264e10 req-d2571837-1412-4749-91dd-2cbeb50ae6dc service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Updating instance_info_cache with network_info: [{"id": "dade5b65-0491-41c1-988b-d18a6613ec6d", "address": "fa:16:3e:cf:e2:1d", "network": {"id": "b9eb37b6-27e4-4d9e-bfb2-7e167766e547", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1162541993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37ae523240a47bb936ef4b54994de61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdade5b65-04", "ovs_interfaceid": "dade5b65-0491-41c1-988b-d18a6613ec6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-25228e89-a28c-4fee-9c2e-067ff1264e10 req-d2571837-1412-4749-91dd-2cbeb50ae6dc service nova] Releasing lock "refresh_cache-f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG nova.compute.manager [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 15:16:22 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Creating image(s)
Jul 31 15:16:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Did not create local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Ensure instance console log exists: /opt/stack/data/nova/instances/97a662be-f1cf-4cd7-a98d-d22996f6282e/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Start _get_guest_xml network_info=[{"id": "b70a659a-8d31-407d-b2af-9ae98bd349ea", "address": "fa:16:3e:ac:9d:39", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70a659a-8d", "ovs_interfaceid": "b70a659a-8d31-407d-b2af-9ae98bd349ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'e4d3411a-2447-44fe-9aec-215104ae9f36', 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VqRajYtz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '97a662be-f1cf-4cd7-a98d-d22996f6282e', 'attached_at': '', 'detached_at': '', 'volume_id': 'f439f64a-a30f-4ab8-811f-65673bcb1bbc', 'serial': 'f439f64a-a30f-4ab8-811f-65673bcb1bbc'}, 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 15:16:22 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:16:22 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:16:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VqRajYtz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:16:22 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:16:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:16:22 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:16:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:16:22 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 15:16:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[92425515-7229-40b6-8098-839a5d24e342]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 15:16:22 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e910080-5e6b-4f10-b8e1-2c628450fe3a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc] added
Jul 31 15:16:22 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[746cf2e9-11d7-47c6-85de-29a0186bfb50]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[20199ba3-fda9-4764-aaf0-76ce7156d3f5]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VqRajYtz {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VqRajYtz" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddabd5c6-cd0e-4fd9-8a02-e8122bed5511]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VqRajYtz'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc21c84f-56f2-4ea9-9a81-734518555947]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e3d4c31-3b0e-47db-a9f0-199fcf3f0710]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224 (non-flash)
Jul 31 15:16:22 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224 (non-flash)
Jul 31 15:16:22 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:16:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:16:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:16:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1552636-8281-4b17-9033-328167a1d775]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:16:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc, portal: 172.16.0.220,3260]
Jul 31 15:16:23 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc, portal: 172.16.0.220,3260] successful.
Jul 31 15:16:23 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:16:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:16:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:16:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[58473cb5-7b43-462c-85e9-215e355d14cb]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:16:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:16:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:16:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:16:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[155d2465-394e-4a4e-80fc-5fe5fc4ba538]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:16:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224 (non-flash)
Jul 31 15:16:23 user nova-compute[72239]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc (non-flash)
Jul 31 15:16:23 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:16:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224 (non-flash)
Jul 31 15:16:23 user nova-compute[72239]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc (non-flash)
Jul 31 15:16:23 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:16:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:16:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 15:16:23 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 15:16:23 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 15:16:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:16:23 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:16:23 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cbd34e-eac7-4755-b08b-141cb7ca634f]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:16:23 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 15:16:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VqRajYtz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 15:16:23 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:16:23 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:16:24 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:16:24 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23534386233313936', 'path': '/dev/sdc'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:16:24 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534386233313936', 'path': '/dev/sdc'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 15:16:24 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:16:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1486671920',display_name='tempest-TestVolumeBootPattern-server-1486671920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1486671920',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCY3vLYjwCj2oqQSBolW7c+OcVO1ul/eTZat0QSfOYuU0YxIpJAnnDmoUxQPBXaqflB5z610Pc9fwuWzrnOXKK97zfH7u+iQLjb5dXhWdA4VmffAJRc95WJmSak/jG2I9g==',key_name='tempest-TestVolumeBootPattern-1846536962',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35aaefdc03aa4e43b4ba435eea373cc4',ramdisk_id='',reservation_id='r-j0xdwzkf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1903261024',owner_user_name='tempest-TestVolumeBootPattern-1903261024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T15:16:15Z,user_data=None,user_id='a73969a32be54c8caf621290e8823134',uuid=97a662be-f1cf-4cd7-a98d-d22996f6282e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b70a659a-8d31-407d-b2af-9ae98bd349ea", "address": "fa:16:3e:ac:9d:39", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70a659a-8d", "ovs_interfaceid": "b70a659a-8d31-407d-b2af-9ae98bd349ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 15:16:24 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Converting VIF {"id": "b70a659a-8d31-407d-b2af-9ae98bd349ea", "address": "fa:16:3e:ac:9d:39", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70a659a-8d", "ovs_interfaceid": "b70a659a-8d31-407d-b2af-9ae98bd349ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:16:24 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:9d:39,bridge_name='br-int',has_traffic_filtering=True,id=b70a659a-8d31-407d-b2af-9ae98bd349ea,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb70a659a-8d') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:16:24 user nova-compute[72239]: DEBUG nova.objects.instance [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lazy-loading 'pci_devices' on Instance uuid 97a662be-f1cf-4cd7-a98d-d22996f6282e {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:16:24 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] End _get_guest_xml xml=<domain type="kvm">
Jul 31 15:16:24 user nova-compute[72239]:   <uuid>97a662be-f1cf-4cd7-a98d-d22996f6282e</uuid>
Jul 31 15:16:24 user nova-compute[72239]:   <name>instance-00000031</name>
Jul 31 15:16:24 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 15:16:24 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 15:16:24 user nova-compute[72239]:   <metadata>
Jul 31 15:16:24 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 15:16:24 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 15:16:24 user nova-compute[72239]:       <nova:name>tempest-TestVolumeBootPattern-server-1486671920</nova:name>
Jul 31 15:16:24 user nova-compute[72239]:       <nova:creationTime>2023-07-31 15:16:22</nova:creationTime>
Jul 31 15:16:24 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 15:16:24 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 15:16:24 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 15:16:24 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 15:16:24 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 15:16:24 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 15:16:24 user nova-compute[72239]:       </nova:flavor>
Jul 31 15:16:24 user nova-compute[72239]:       <nova:owner>
Jul 31 15:16:24 user nova-compute[72239]:         <nova:user uuid="a73969a32be54c8caf621290e8823134">tempest-TestVolumeBootPattern-1903261024-project-member</nova:user>
Jul 31 15:16:24 user nova-compute[72239]:         <nova:project uuid="35aaefdc03aa4e43b4ba435eea373cc4">tempest-TestVolumeBootPattern-1903261024</nova:project>
Jul 31 15:16:24 user nova-compute[72239]:       </nova:owner>
Jul 31 15:16:24 user nova-compute[72239]:       <nova:ports>
Jul 31 15:16:24 user nova-compute[72239]:         <nova:port uuid="b70a659a-8d31-407d-b2af-9ae98bd349ea">
Jul 31 15:16:24 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 31 15:16:24 user nova-compute[72239]:         </nova:port>
Jul 31 15:16:24 user nova-compute[72239]:       </nova:ports>
Jul 31 15:16:24 user nova-compute[72239]:     </nova:instance>
Jul 31 15:16:24 user nova-compute[72239]:   </metadata>
Jul 31 15:16:24 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 15:16:24 user nova-compute[72239]:     <system>
Jul 31 15:16:24 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 15:16:24 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 15:16:24 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 15:16:24 user nova-compute[72239]:       <entry name="serial">97a662be-f1cf-4cd7-a98d-d22996f6282e</entry>
Jul 31 15:16:24 user nova-compute[72239]:       <entry name="uuid">97a662be-f1cf-4cd7-a98d-d22996f6282e</entry>
Jul 31 15:16:24 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 15:16:24 user nova-compute[72239]:     </system>
Jul 31 15:16:24 user nova-compute[72239]:   </sysinfo>
Jul 31 15:16:24 user nova-compute[72239]:   <os>
Jul 31 15:16:24 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 15:16:24 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 15:16:24 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 15:16:24 user nova-compute[72239]:   </os>
Jul 31 15:16:24 user nova-compute[72239]:   <features>
Jul 31 15:16:24 user nova-compute[72239]:     <acpi/>
Jul 31 15:16:24 user nova-compute[72239]:     <apic/>
Jul 31 15:16:24 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 15:16:24 user nova-compute[72239]:   </features>
Jul 31 15:16:24 user nova-compute[72239]:   <clock offset="utc">
Jul 31 15:16:24 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 15:16:24 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 15:16:24 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 15:16:24 user nova-compute[72239]:   </clock>
Jul 31 15:16:24 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 15:16:24 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 15:16:24 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 15:16:24 user nova-compute[72239]:   </cpu>
Jul 31 15:16:24 user nova-compute[72239]:   <devices>
Jul 31 15:16:24 user nova-compute[72239]:     <disk type="block" device="disk">
Jul 31 15:16:24 user nova-compute[72239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:16:24 user nova-compute[72239]:       <source dev="/dev/sdc"/>
Jul 31 15:16:24 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 15:16:24 user nova-compute[72239]:       <serial>f439f64a-a30f-4ab8-811f-65673bcb1bbc</serial>
Jul 31 15:16:24 user nova-compute[72239]:     </disk>
Jul 31 15:16:24 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 15:16:24 user nova-compute[72239]:       <mac address="fa:16:3e:ac:9d:39"/>
Jul 31 15:16:24 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:16:24 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 15:16:24 user nova-compute[72239]:       <target dev="tapb70a659a-8d"/>
Jul 31 15:16:24 user nova-compute[72239]:     </interface>
Jul 31 15:16:24 user nova-compute[72239]:     <serial type="pty">
Jul 31 15:16:24 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/97a662be-f1cf-4cd7-a98d-d22996f6282e/console.log" append="off"/>
Jul 31 15:16:24 user nova-compute[72239]:     </serial>
Jul 31 15:16:24 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 15:16:24 user nova-compute[72239]:     <video>
Jul 31 15:16:24 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:16:24 user nova-compute[72239]:     </video>
Jul 31 15:16:24 user nova-compute[72239]:     <rng model="virtio">
Jul 31 15:16:24 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 15:16:24 user nova-compute[72239]:     </rng>
Jul 31 15:16:24 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 15:16:24 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 15:16:24 user nova-compute[72239]:       <stats period="10"/>
Jul 31 15:16:24 user nova-compute[72239]:     </memballoon>
Jul 31 15:16:24 user nova-compute[72239]:   </devices>
Jul 31 15:16:24 user nova-compute[72239]: </domain>
Jul 31 15:16:24 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 15:16:24 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:16:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1486671920',display_name='tempest-TestVolumeBootPattern-server-1486671920',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1486671920',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCY3vLYjwCj2oqQSBolW7c+OcVO1ul/eTZat0QSfOYuU0YxIpJAnnDmoUxQPBXaqflB5z610Pc9fwuWzrnOXKK97zfH7u+iQLjb5dXhWdA4VmffAJRc95WJmSak/jG2I9g==',key_name='tempest-TestVolumeBootPattern-1846536962',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35aaefdc03aa4e43b4ba435eea373cc4',ramdisk_id='',reservation_id='r-j0xdwzkf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1903261024',owner_user_name='tempest-TestVolumeBootPattern-1903261024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T15:16:15Z,user_data=None,user_id='a73969a32be54c8caf621290e8823134',uuid=97a662be-f1cf-4cd7-a98d-d22996f6282e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b70a659a-8d31-407d-b2af-9ae98bd349ea", "address": "fa:16:3e:ac:9d:39", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70a659a-8d", "ovs_interfaceid": "b70a659a-8d31-407d-b2af-9ae98bd349ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 15:16:24 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Converting VIF {"id": "b70a659a-8d31-407d-b2af-9ae98bd349ea", "address": "fa:16:3e:ac:9d:39", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70a659a-8d", "ovs_interfaceid": "b70a659a-8d31-407d-b2af-9ae98bd349ea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:16:24 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:9d:39,bridge_name='br-int',has_traffic_filtering=True,id=b70a659a-8d31-407d-b2af-9ae98bd349ea,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb70a659a-8d') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:16:24 user nova-compute[72239]: DEBUG os_vif [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:9d:39,bridge_name='br-int',has_traffic_filtering=True,id=b70a659a-8d31-407d-b2af-9ae98bd349ea,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb70a659a-8d') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 15:16:24 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:16:24 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:16:24 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 15:16:24 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:16:24 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb70a659a-8d, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:16:24 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb70a659a-8d, col_values=(('external_ids', {'iface-id': 'b70a659a-8d31-407d-b2af-9ae98bd349ea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:9d:39', 'vm-uuid': '97a662be-f1cf-4cd7-a98d-d22996f6282e'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:16:24 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:16:24 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:16:24 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:16:24 user nova-compute[72239]: INFO os_vif [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:9d:39,bridge_name='br-int',has_traffic_filtering=True,id=b70a659a-8d31-407d-b2af-9ae98bd349ea,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb70a659a-8d')
Jul 31 15:16:24 user nova-compute[72239]: DEBUG nova.compute.manager [req-ad2fd956-00c3-48ba-b23d-f7c039283a00 req-734fba49-35a9-4930-9a7f-551e815ebee6 service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Received event network-changed-dade5b65-0491-41c1-988b-d18a6613ec6d {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:16:24 user nova-compute[72239]: DEBUG nova.compute.manager [req-ad2fd956-00c3-48ba-b23d-f7c039283a00 req-734fba49-35a9-4930-9a7f-551e815ebee6 service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Refreshing instance network info cache due to event network-changed-dade5b65-0491-41c1-988b-d18a6613ec6d. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:16:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ad2fd956-00c3-48ba-b23d-f7c039283a00 req-734fba49-35a9-4930-9a7f-551e815ebee6 service nova] Acquiring lock "refresh_cache-f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:16:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ad2fd956-00c3-48ba-b23d-f7c039283a00 req-734fba49-35a9-4930-9a7f-551e815ebee6 service nova] Acquired lock "refresh_cache-f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:16:24 user nova-compute[72239]: DEBUG nova.network.neutron [req-ad2fd956-00c3-48ba-b23d-f7c039283a00 req-734fba49-35a9-4930-9a7f-551e815ebee6 service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Refreshing network info cache for port dade5b65-0491-41c1-988b-d18a6613ec6d {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:16:24 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:16:24 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] No VIF found with MAC fa:16:3e:ac:9d:39, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 15:16:24 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:16:24 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 15:16:24 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Rebuilding the list of instances to heal {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 15:16:24 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Skipping network cache update for instance because it is Building. {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Jul 31 15:16:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:16:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-faf8c398-f048-4414-aa5b-6acb57eeff54 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquiring lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:16:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-faf8c398-f048-4414-aa5b-6acb57eeff54 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:16:24 user nova-compute[72239]: INFO nova.compute.manager [None req-faf8c398-f048-4414-aa5b-6acb57eeff54 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Rebooting instance
Jul 31 15:16:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-faf8c398-f048-4414-aa5b-6acb57eeff54 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquiring lock "refresh_cache-f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:16:24 user nova-compute[72239]: DEBUG nova.network.neutron [req-ad2fd956-00c3-48ba-b23d-f7c039283a00 req-734fba49-35a9-4930-9a7f-551e815ebee6 service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Updated VIF entry in instance network info cache for port dade5b65-0491-41c1-988b-d18a6613ec6d. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:16:24 user nova-compute[72239]: DEBUG nova.network.neutron [req-ad2fd956-00c3-48ba-b23d-f7c039283a00 req-734fba49-35a9-4930-9a7f-551e815ebee6 service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Updating instance_info_cache with network_info: [{"id": "dade5b65-0491-41c1-988b-d18a6613ec6d", "address": "fa:16:3e:cf:e2:1d", "network": {"id": "b9eb37b6-27e4-4d9e-bfb2-7e167766e547", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1162541993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37ae523240a47bb936ef4b54994de61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdade5b65-04", "ovs_interfaceid": "dade5b65-0491-41c1-988b-d18a6613ec6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:16:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ad2fd956-00c3-48ba-b23d-f7c039283a00 req-734fba49-35a9-4930-9a7f-551e815ebee6 service nova] Releasing lock "refresh_cache-f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:16:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:16:24 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 15:16:24 user nova-compute[72239]: DEBUG nova.objects.instance [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lazy-loading 'info_cache' on Instance uuid f8b7d69e-f23a-4615-9f08-ce5fede9e4eb {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:16:25 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Updating instance_info_cache with network_info: [{"id": "dade5b65-0491-41c1-988b-d18a6613ec6d", "address": "fa:16:3e:cf:e2:1d", "network": {"id": "b9eb37b6-27e4-4d9e-bfb2-7e167766e547", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1162541993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37ae523240a47bb936ef4b54994de61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdade5b65-04", "ovs_interfaceid": "dade5b65-0491-41c1-988b-d18a6613ec6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:16:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:16:25 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 15:16:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-faf8c398-f048-4414-aa5b-6acb57eeff54 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquired lock "refresh_cache-f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:16:25 user nova-compute[72239]: DEBUG nova.network.neutron [None req-faf8c398-f048-4414-aa5b-6acb57eeff54 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 15:16:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:16:25 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:16:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:16:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:16:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:16:25 user nova-compute[72239]: DEBUG nova.network.neutron [None req-faf8c398-f048-4414-aa5b-6acb57eeff54 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Updating instance_info_cache with network_info: [{"id": "dade5b65-0491-41c1-988b-d18a6613ec6d", "address": "fa:16:3e:cf:e2:1d", "network": {"id": "b9eb37b6-27e4-4d9e-bfb2-7e167766e547", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1162541993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37ae523240a47bb936ef4b54994de61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdade5b65-04", "ovs_interfaceid": "dade5b65-0491-41c1-988b-d18a6613ec6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:16:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-faf8c398-f048-4414-aa5b-6acb57eeff54 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Releasing lock "refresh_cache-f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:16:25 user nova-compute[72239]: DEBUG nova.compute.manager [None req-faf8c398-f048-4414-aa5b-6acb57eeff54 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:16:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:16:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:16:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:16:26 user nova-compute[72239]: DEBUG nova.compute.manager [req-ff78efa6-72a4-42f1-8644-81e0257b7770 req-57818c7d-a1f3-479f-80e1-af79544a23bd service nova] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Received event network-vif-plugged-b70a659a-8d31-407d-b2af-9ae98bd349ea {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:16:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ff78efa6-72a4-42f1-8644-81e0257b7770 req-57818c7d-a1f3-479f-80e1-af79544a23bd service nova] Acquiring lock "97a662be-f1cf-4cd7-a98d-d22996f6282e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:16:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ff78efa6-72a4-42f1-8644-81e0257b7770 req-57818c7d-a1f3-479f-80e1-af79544a23bd service nova] Lock "97a662be-f1cf-4cd7-a98d-d22996f6282e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:16:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ff78efa6-72a4-42f1-8644-81e0257b7770 req-57818c7d-a1f3-479f-80e1-af79544a23bd service nova] Lock "97a662be-f1cf-4cd7-a98d-d22996f6282e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:16:26 user nova-compute[72239]: DEBUG nova.compute.manager [req-ff78efa6-72a4-42f1-8644-81e0257b7770 req-57818c7d-a1f3-479f-80e1-af79544a23bd service nova] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] No waiting events found dispatching network-vif-plugged-b70a659a-8d31-407d-b2af-9ae98bd349ea {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:16:26 user nova-compute[72239]: WARNING nova.compute.manager [req-ff78efa6-72a4-42f1-8644-81e0257b7770 req-57818c7d-a1f3-479f-80e1-af79544a23bd service nova] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Received unexpected event network-vif-plugged-b70a659a-8d31-407d-b2af-9ae98bd349ea for instance with vm_state building and task_state spawning.
Jul 31 15:16:26 user nova-compute[72239]: DEBUG nova.compute.manager [req-ff78efa6-72a4-42f1-8644-81e0257b7770 req-57818c7d-a1f3-479f-80e1-af79544a23bd service nova] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Received event network-vif-plugged-b70a659a-8d31-407d-b2af-9ae98bd349ea {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:16:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ff78efa6-72a4-42f1-8644-81e0257b7770 req-57818c7d-a1f3-479f-80e1-af79544a23bd service nova] Acquiring lock "97a662be-f1cf-4cd7-a98d-d22996f6282e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:16:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ff78efa6-72a4-42f1-8644-81e0257b7770 req-57818c7d-a1f3-479f-80e1-af79544a23bd service nova] Lock "97a662be-f1cf-4cd7-a98d-d22996f6282e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:16:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ff78efa6-72a4-42f1-8644-81e0257b7770 req-57818c7d-a1f3-479f-80e1-af79544a23bd service nova] Lock "97a662be-f1cf-4cd7-a98d-d22996f6282e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:16:26 user nova-compute[72239]: DEBUG nova.compute.manager [req-ff78efa6-72a4-42f1-8644-81e0257b7770 req-57818c7d-a1f3-479f-80e1-af79544a23bd service nova] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] No waiting events found dispatching network-vif-plugged-b70a659a-8d31-407d-b2af-9ae98bd349ea {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:16:26 user nova-compute[72239]: WARNING nova.compute.manager [req-ff78efa6-72a4-42f1-8644-81e0257b7770 req-57818c7d-a1f3-479f-80e1-af79544a23bd service nova] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Received unexpected event network-vif-plugged-b70a659a-8d31-407d-b2af-9ae98bd349ea for instance with vm_state building and task_state spawning.
Jul 31 15:16:27 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:16:27 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:16:27 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690816587.5533144, 97a662be-f1cf-4cd7-a98d-d22996f6282e => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:16:27 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] VM Resumed (Lifecycle Event)
Jul 31 15:16:27 user nova-compute[72239]: DEBUG nova.compute.manager [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 15:16:27 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 15:16:27 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Instance spawned successfully.
Jul 31 15:16:27 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 15:16:27 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:16:27 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:16:27 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:16:27 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:16:27 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:16:27 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:16:27 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:16:27 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:16:27 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 15:16:27 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690816587.5555458, 97a662be-f1cf-4cd7-a98d-d22996f6282e => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:16:27 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] VM Started (Lifecycle Event)
Jul 31 15:16:27 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:16:27 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:16:27 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 15:16:27 user nova-compute[72239]: INFO nova.compute.manager [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Took 4.91 seconds to spawn the instance on the hypervisor.
Jul 31 15:16:27 user nova-compute[72239]: DEBUG nova.compute.manager [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:16:27 user nova-compute[72239]: INFO nova.compute.manager [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Took 13.09 seconds to build instance.
Jul 31 15:16:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-50f00424-5f05-49b2-83d1-42d121d17c45 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "97a662be-f1cf-4cd7-a98d-d22996f6282e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.193s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:16:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:16:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:16:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:16:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:16:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:16:28 user nova-compute[72239]: DEBUG nova.compute.manager [req-351ef0d0-e379-427d-8d13-932dc77018e8 req-11abb643-3cc4-4af6-af61-da0b72cb6ee2 service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Received event network-vif-unplugged-dade5b65-0491-41c1-988b-d18a6613ec6d {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:16:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-351ef0d0-e379-427d-8d13-932dc77018e8 req-11abb643-3cc4-4af6-af61-da0b72cb6ee2 service nova] Acquiring lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:16:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-351ef0d0-e379-427d-8d13-932dc77018e8 req-11abb643-3cc4-4af6-af61-da0b72cb6ee2 service nova] Lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:16:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-351ef0d0-e379-427d-8d13-932dc77018e8 req-11abb643-3cc4-4af6-af61-da0b72cb6ee2 service nova] Lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:16:28 user nova-compute[72239]: DEBUG nova.compute.manager [req-351ef0d0-e379-427d-8d13-932dc77018e8 req-11abb643-3cc4-4af6-af61-da0b72cb6ee2 service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] No waiting events found dispatching network-vif-unplugged-dade5b65-0491-41c1-988b-d18a6613ec6d {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:16:28 user nova-compute[72239]: WARNING nova.compute.manager [req-351ef0d0-e379-427d-8d13-932dc77018e8 req-11abb643-3cc4-4af6-af61-da0b72cb6ee2 service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Received unexpected event network-vif-unplugged-dade5b65-0491-41c1-988b-d18a6613ec6d for instance with vm_state active and task_state reboot_started.
Jul 31 15:16:28 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:16:28 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 15:16:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:16:28 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-faf8c398-f048-4414-aa5b-6acb57eeff54 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Instance shutdown successfully.
Jul 31 15:16:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:16:30 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:16:30 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:16:30 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:16:30 user nova-compute[72239]: DEBUG nova.compute.manager [req-95ada4f8-e76c-47b9-bae4-a93f3a841728 req-c137fd39-e381-43a6-9522-2f1ef39bc363 service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Received event network-vif-plugged-dade5b65-0491-41c1-988b-d18a6613ec6d {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:16:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-95ada4f8-e76c-47b9-bae4-a93f3a841728 req-c137fd39-e381-43a6-9522-2f1ef39bc363 service nova] Acquiring lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:16:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-95ada4f8-e76c-47b9-bae4-a93f3a841728 req-c137fd39-e381-43a6-9522-2f1ef39bc363 service nova] Lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:16:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-95ada4f8-e76c-47b9-bae4-a93f3a841728 req-c137fd39-e381-43a6-9522-2f1ef39bc363 service nova] Lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:16:30 user nova-compute[72239]: DEBUG nova.compute.manager [req-95ada4f8-e76c-47b9-bae4-a93f3a841728 req-c137fd39-e381-43a6-9522-2f1ef39bc363 service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] No waiting events found dispatching network-vif-plugged-dade5b65-0491-41c1-988b-d18a6613ec6d {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:16:30 user nova-compute[72239]: WARNING nova.compute.manager [req-95ada4f8-e76c-47b9-bae4-a93f3a841728 req-c137fd39-e381-43a6-9522-2f1ef39bc363 service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Received unexpected event network-vif-plugged-dade5b65-0491-41c1-988b-d18a6613ec6d for instance with vm_state active and task_state reboot_started.
Jul 31 15:16:30 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:16:30 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:16:30 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:16:30 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:16:31 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:16:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:16:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:16:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:16:31 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 15:16:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8b7d69e-f23a-4615-9f08-ce5fede9e4eb/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:16:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8b7d69e-f23a-4615-9f08-ce5fede9e4eb/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:16:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8b7d69e-f23a-4615-9f08-ce5fede9e4eb/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:16:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8b7d69e-f23a-4615-9f08-ce5fede9e4eb/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:16:31 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 15:16:31 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 15:16:32 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Removed pending event for f8b7d69e-f23a-4615-9f08-ce5fede9e4eb due to event {{(pid=72239) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 31 15:16:32 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690816592.3441541, f8b7d69e-f23a-4615-9f08-ce5fede9e4eb => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:16:32 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] VM Resumed (Lifecycle Event)
Jul 31 15:16:32 user nova-compute[72239]: DEBUG nova.compute.manager [req-861e7792-5a96-461a-8621-9d262718e439 req-d2486662-1989-4692-b1c8-cf2018dbebaf service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Received event network-vif-plugged-dade5b65-0491-41c1-988b-d18a6613ec6d {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:16:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-861e7792-5a96-461a-8621-9d262718e439 req-d2486662-1989-4692-b1c8-cf2018dbebaf service nova] Acquiring lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:16:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-861e7792-5a96-461a-8621-9d262718e439 req-d2486662-1989-4692-b1c8-cf2018dbebaf service nova] Lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:16:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-861e7792-5a96-461a-8621-9d262718e439 req-d2486662-1989-4692-b1c8-cf2018dbebaf service nova] Lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:16:32 user nova-compute[72239]: DEBUG nova.compute.manager [req-861e7792-5a96-461a-8621-9d262718e439 req-d2486662-1989-4692-b1c8-cf2018dbebaf service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] No waiting events found dispatching network-vif-plugged-dade5b65-0491-41c1-988b-d18a6613ec6d {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:16:32 user nova-compute[72239]: WARNING nova.compute.manager [req-861e7792-5a96-461a-8621-9d262718e439 req-d2486662-1989-4692-b1c8-cf2018dbebaf service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Received unexpected event network-vif-plugged-dade5b65-0491-41c1-988b-d18a6613ec6d for instance with vm_state active and task_state reboot_started.
Jul 31 15:16:32 user nova-compute[72239]: DEBUG nova.compute.manager [req-861e7792-5a96-461a-8621-9d262718e439 req-d2486662-1989-4692-b1c8-cf2018dbebaf service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Received event network-vif-plugged-dade5b65-0491-41c1-988b-d18a6613ec6d {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:16:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-861e7792-5a96-461a-8621-9d262718e439 req-d2486662-1989-4692-b1c8-cf2018dbebaf service nova] Acquiring lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:16:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-861e7792-5a96-461a-8621-9d262718e439 req-d2486662-1989-4692-b1c8-cf2018dbebaf service nova] Lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:16:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-861e7792-5a96-461a-8621-9d262718e439 req-d2486662-1989-4692-b1c8-cf2018dbebaf service nova] Lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:16:32 user nova-compute[72239]: DEBUG nova.compute.manager [req-861e7792-5a96-461a-8621-9d262718e439 req-d2486662-1989-4692-b1c8-cf2018dbebaf service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] No waiting events found dispatching network-vif-plugged-dade5b65-0491-41c1-988b-d18a6613ec6d {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:16:32 user nova-compute[72239]: WARNING nova.compute.manager [req-861e7792-5a96-461a-8621-9d262718e439 req-d2486662-1989-4692-b1c8-cf2018dbebaf service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Received unexpected event network-vif-plugged-dade5b65-0491-41c1-988b-d18a6613ec6d for instance with vm_state active and task_state reboot_started.
Jul 31 15:16:32 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:16:32 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:16:32 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:16:32 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=8772MB free_disk=25.095535278320312GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 15:16:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:16:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:16:32 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Instance running successfully.
Jul 31 15:16:32 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-faf8c398-f048-4414-aa5b-6acb57eeff54 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Instance soft rebooted successfully.
Jul 31 15:16:32 user nova-compute[72239]: DEBUG nova.compute.manager [None req-faf8c398-f048-4414-aa5b-6acb57eeff54 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:16:32 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:16:32 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] During sync_power_state the instance has a pending task (reboot_started). Skip.
Jul 31 15:16:32 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690816592.3458922, f8b7d69e-f23a-4615-9f08-ce5fede9e4eb => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:16:32 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] VM Started (Lifecycle Event)
Jul 31 15:16:32 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:16:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-faf8c398-f048-4414-aa5b-6acb57eeff54 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.156s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:16:32 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:16:32 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance f8b7d69e-f23a-4615-9f08-ce5fede9e4eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:16:32 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 97a662be-f1cf-4cd7-a98d-d22996f6282e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:16:32 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 15:16:32 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 15:16:32 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:16:32 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:16:32 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 15:16:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.235s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:16:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:16:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:16:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:16:40 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:16:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:16:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:16:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:16:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:16:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:16:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:16:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:17:00 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:17:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:17:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:17:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:17:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:17:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:17:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:17:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:17:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:17:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:17:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:17:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:17:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:17:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:17:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:17:21 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:17:21 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:17:23 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:17:24 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:17:24 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:17:24 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:17:24 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:17:24 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:17:24 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:17:25 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:17:25 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 15:17:25 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Rebuilding the list of instances to heal {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 15:17:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:17:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:17:25 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 15:17:25 user nova-compute[72239]: DEBUG nova.objects.instance [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lazy-loading 'info_cache' on Instance uuid f8b7d69e-f23a-4615-9f08-ce5fede9e4eb {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:17:25 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Updating instance_info_cache with network_info: [{"id": "dade5b65-0491-41c1-988b-d18a6613ec6d", "address": "fa:16:3e:cf:e2:1d", "network": {"id": "b9eb37b6-27e4-4d9e-bfb2-7e167766e547", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1162541993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37ae523240a47bb936ef4b54994de61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdade5b65-04", "ovs_interfaceid": "dade5b65-0491-41c1-988b-d18a6613ec6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:17:25 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:17:25 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 15:17:27 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:17:27 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:17:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:17:29 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:17:29 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 15:17:31 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:17:31 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:17:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:17:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:17:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:17:31 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 15:17:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8b7d69e-f23a-4615-9f08-ce5fede9e4eb/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:17:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8b7d69e-f23a-4615-9f08-ce5fede9e4eb/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:17:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8b7d69e-f23a-4615-9f08-ce5fede9e4eb/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:17:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8b7d69e-f23a-4615-9f08-ce5fede9e4eb/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:17:31 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 15:17:31 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 15:17:32 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:17:32 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:17:32 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=8673MB free_disk=25.094379425048828GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 15:17:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:17:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:17:32 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance f8b7d69e-f23a-4615-9f08-ce5fede9e4eb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:17:32 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 97a662be-f1cf-4cd7-a98d-d22996f6282e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:17:32 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 15:17:32 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 15:17:32 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:17:32 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:17:32 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 15:17:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.212s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:17:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:17:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:17:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:17:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:17:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:17:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:17:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:17:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:17:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:17:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:17:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:17:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:17:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:17:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:17:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:17:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:17:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:17:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:17:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:17:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:17:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:18:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:18:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:18:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:18:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:18:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:18:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:18:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:18:06 user nova-compute[72239]: DEBUG nova.compute.manager [req-8395fe87-a603-440b-a962-74dc9dcc7160 req-cdfdfc90-d1b9-4056-ab3f-48392b1b9224 service nova] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Received event network-changed-b70a659a-8d31-407d-b2af-9ae98bd349ea {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:18:06 user nova-compute[72239]: DEBUG nova.compute.manager [req-8395fe87-a603-440b-a962-74dc9dcc7160 req-cdfdfc90-d1b9-4056-ab3f-48392b1b9224 service nova] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Refreshing instance network info cache due to event network-changed-b70a659a-8d31-407d-b2af-9ae98bd349ea. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:18:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-8395fe87-a603-440b-a962-74dc9dcc7160 req-cdfdfc90-d1b9-4056-ab3f-48392b1b9224 service nova] Acquiring lock "refresh_cache-97a662be-f1cf-4cd7-a98d-d22996f6282e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:18:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-8395fe87-a603-440b-a962-74dc9dcc7160 req-cdfdfc90-d1b9-4056-ab3f-48392b1b9224 service nova] Acquired lock "refresh_cache-97a662be-f1cf-4cd7-a98d-d22996f6282e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:18:06 user nova-compute[72239]: DEBUG nova.network.neutron [req-8395fe87-a603-440b-a962-74dc9dcc7160 req-cdfdfc90-d1b9-4056-ab3f-48392b1b9224 service nova] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Refreshing network info cache for port b70a659a-8d31-407d-b2af-9ae98bd349ea {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:18:07 user nova-compute[72239]: DEBUG nova.network.neutron [req-8395fe87-a603-440b-a962-74dc9dcc7160 req-cdfdfc90-d1b9-4056-ab3f-48392b1b9224 service nova] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Updated VIF entry in instance network info cache for port b70a659a-8d31-407d-b2af-9ae98bd349ea. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:18:07 user nova-compute[72239]: DEBUG nova.network.neutron [req-8395fe87-a603-440b-a962-74dc9dcc7160 req-cdfdfc90-d1b9-4056-ab3f-48392b1b9224 service nova] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Updating instance_info_cache with network_info: [{"id": "b70a659a-8d31-407d-b2af-9ae98bd349ea", "address": "fa:16:3e:ac:9d:39", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70a659a-8d", "ovs_interfaceid": "b70a659a-8d31-407d-b2af-9ae98bd349ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:18:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-8395fe87-a603-440b-a962-74dc9dcc7160 req-cdfdfc90-d1b9-4056-ab3f-48392b1b9224 service nova] Releasing lock "refresh_cache-97a662be-f1cf-4cd7-a98d-d22996f6282e" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:18:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "97a662be-f1cf-4cd7-a98d-d22996f6282e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:18:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "97a662be-f1cf-4cd7-a98d-d22996f6282e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:18:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "97a662be-f1cf-4cd7-a98d-d22996f6282e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:18:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "97a662be-f1cf-4cd7-a98d-d22996f6282e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:18:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "97a662be-f1cf-4cd7-a98d-d22996f6282e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:18:08 user nova-compute[72239]: INFO nova.compute.manager [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Terminating instance
Jul 31 15:18:08 user nova-compute[72239]: DEBUG nova.compute.manager [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 15:18:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:18:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:18:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:18:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:18:08 user nova-compute[72239]: DEBUG nova.compute.manager [req-4c90139e-2dbd-45ca-abfc-09e33e521328 req-d2a68e4b-31a6-4ddb-8536-461fa3874003 service nova] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Received event network-vif-unplugged-b70a659a-8d31-407d-b2af-9ae98bd349ea {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:18:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-4c90139e-2dbd-45ca-abfc-09e33e521328 req-d2a68e4b-31a6-4ddb-8536-461fa3874003 service nova] Acquiring lock "97a662be-f1cf-4cd7-a98d-d22996f6282e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:18:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-4c90139e-2dbd-45ca-abfc-09e33e521328 req-d2a68e4b-31a6-4ddb-8536-461fa3874003 service nova] Lock "97a662be-f1cf-4cd7-a98d-d22996f6282e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:18:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-4c90139e-2dbd-45ca-abfc-09e33e521328 req-d2a68e4b-31a6-4ddb-8536-461fa3874003 service nova] Lock "97a662be-f1cf-4cd7-a98d-d22996f6282e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:18:08 user nova-compute[72239]: DEBUG nova.compute.manager [req-4c90139e-2dbd-45ca-abfc-09e33e521328 req-d2a68e4b-31a6-4ddb-8536-461fa3874003 service nova] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] No waiting events found dispatching network-vif-unplugged-b70a659a-8d31-407d-b2af-9ae98bd349ea {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:18:08 user nova-compute[72239]: DEBUG nova.compute.manager [req-4c90139e-2dbd-45ca-abfc-09e33e521328 req-d2a68e4b-31a6-4ddb-8536-461fa3874003 service nova] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Received event network-vif-unplugged-b70a659a-8d31-407d-b2af-9ae98bd349ea for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 15:18:09 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Instance destroyed successfully.
Jul 31 15:18:09 user nova-compute[72239]: DEBUG nova.objects.instance [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lazy-loading 'resources' on Instance uuid 97a662be-f1cf-4cd7-a98d-d22996f6282e {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:16:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1486671920',display_name='tempest-TestVolumeBootPattern-server-1486671920',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1486671920',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCY3vLYjwCj2oqQSBolW7c+OcVO1ul/eTZat0QSfOYuU0YxIpJAnnDmoUxQPBXaqflB5z610Pc9fwuWzrnOXKK97zfH7u+iQLjb5dXhWdA4VmffAJRc95WJmSak/jG2I9g==',key_name='tempest-TestVolumeBootPattern-1846536962',keypairs=<?>,launch_index=0,launched_at=2023-07-31T15:16:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='35aaefdc03aa4e43b4ba435eea373cc4',ramdisk_id='',reservation_id='r-j0xdwzkf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1903261024',owner_user_name='tempest-TestVolumeBootPattern-1903261024-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T15:16:28Z,user_data=None,user_id='a73969a32be54c8caf621290e8823134',uuid=97a662be-f1cf-4cd7-a98d-d22996f6282e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b70a659a-8d31-407d-b2af-9ae98bd349ea", "address": "fa:16:3e:ac:9d:39", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70a659a-8d", "ovs_interfaceid": "b70a659a-8d31-407d-b2af-9ae98bd349ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Converting VIF {"id": "b70a659a-8d31-407d-b2af-9ae98bd349ea", "address": "fa:16:3e:ac:9d:39", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.81", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb70a659a-8d", "ovs_interfaceid": "b70a659a-8d31-407d-b2af-9ae98bd349ea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:9d:39,bridge_name='br-int',has_traffic_filtering=True,id=b70a659a-8d31-407d-b2af-9ae98bd349ea,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb70a659a-8d') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG os_vif [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:9d:39,bridge_name='br-int',has_traffic_filtering=True,id=b70a659a-8d31-407d-b2af-9ae98bd349ea,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb70a659a-8d') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb70a659a-8d, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:18:09 user nova-compute[72239]: INFO os_vif [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:9d:39,bridge_name='br-int',has_traffic_filtering=True,id=b70a659a-8d31-407d-b2af-9ae98bd349ea,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb70a659a-8d')
Jul 31 15:18:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VqRajYtz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:18:09 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:18:09 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[736c9e78-da2c-4557-9061-4de1cb35e1be]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fb1f7f-ae33-4fa2-b07f-8cef53821506]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224 (non-flash)
Jul 31 15:18:09 user nova-compute[72239]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc (non-flash)
Jul 31 15:18:09 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224 (non-flash)
Jul 31 15:18:09 user nova-compute[72239]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc (non-flash)
Jul 31 15:18:09 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41204a53f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc'): ({'sdc'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Removing single pathed devices sdc {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f006d65c-68a1-425f-a8b3-89b96a39d03b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66c97a2-50ec-4546-a794-6cd283cd5cdb]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Flushing IO for device /dev/sdc {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d084e207-5283-4873-b896-27bd05a4744c]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae5510f-46a6-4e1b-8e8e-4b400aa3535b]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] SCSI volumes sdc have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOae7c9d25-548b3196411259bd', '/dev/disk/by-id/scsi-23534386233313936', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ae7c9d25') {{(pid=83493) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7fe1a7-e00b-4a1f-9bbf-d164937a4c5d]: (4, None) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aaf085d-a79a-4b49-9ba5-df0229b2efe3]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[14de4947-0014-4ef6-a89e-aab6ab2c965d]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc, portal: 172.16.0.220,3260]
Jul 31 15:18:09 user nova-compute[72239]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc, portal: 172.16.0.220,3260] successful.
Jul 31 15:18:09 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ad2871-a898-4160-988f-cbf7b07907c9]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] <== disconnect_volume: return (290ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 15:18:09 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Deleting instance files /opt/stack/data/nova/instances/97a662be-f1cf-4cd7-a98d-d22996f6282e_del
Jul 31 15:18:09 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Deletion of /opt/stack/data/nova/instances/97a662be-f1cf-4cd7-a98d-d22996f6282e_del complete
Jul 31 15:18:09 user nova-compute[72239]: INFO nova.compute.manager [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Took 1.15 seconds to destroy the instance on the hypervisor.
Jul 31 15:18:09 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 15:18:09 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 15:18:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:18:10 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:18:10 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Took 0.79 seconds to deallocate network for instance.
Jul 31 15:18:10 user nova-compute[72239]: DEBUG nova.compute.manager [req-cd716f15-4a24-4b65-88c9-238f88e10151 req-959b65f8-0902-473f-a84a-9bb77b5815a6 service nova] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Received event network-vif-deleted-b70a659a-8d31-407d-b2af-9ae98bd349ea {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:18:10 user nova-compute[72239]: INFO nova.compute.manager [req-cd716f15-4a24-4b65-88c9-238f88e10151 req-959b65f8-0902-473f-a84a-9bb77b5815a6 service nova] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Neutron deleted interface b70a659a-8d31-407d-b2af-9ae98bd349ea; detaching it from the instance and deleting it from the info cache
Jul 31 15:18:10 user nova-compute[72239]: DEBUG nova.network.neutron [req-cd716f15-4a24-4b65-88c9-238f88e10151 req-959b65f8-0902-473f-a84a-9bb77b5815a6 service nova] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:18:10 user nova-compute[72239]: DEBUG nova.compute.manager [req-cd716f15-4a24-4b65-88c9-238f88e10151 req-959b65f8-0902-473f-a84a-9bb77b5815a6 service nova] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Detach interface failed, port_id=b70a659a-8d31-407d-b2af-9ae98bd349ea, reason: Instance 97a662be-f1cf-4cd7-a98d-d22996f6282e could not be found. {{(pid=72239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 15:18:10 user nova-compute[72239]: DEBUG nova.compute.manager [req-efe07fbe-6b86-4308-8834-dace692bb2ba req-8bfdc0e7-9d95-4f5a-83f1-6118c5242687 service nova] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Received event network-vif-plugged-b70a659a-8d31-407d-b2af-9ae98bd349ea {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:18:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-efe07fbe-6b86-4308-8834-dace692bb2ba req-8bfdc0e7-9d95-4f5a-83f1-6118c5242687 service nova] Acquiring lock "97a662be-f1cf-4cd7-a98d-d22996f6282e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:18:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-efe07fbe-6b86-4308-8834-dace692bb2ba req-8bfdc0e7-9d95-4f5a-83f1-6118c5242687 service nova] Lock "97a662be-f1cf-4cd7-a98d-d22996f6282e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:18:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-efe07fbe-6b86-4308-8834-dace692bb2ba req-8bfdc0e7-9d95-4f5a-83f1-6118c5242687 service nova] Lock "97a662be-f1cf-4cd7-a98d-d22996f6282e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:18:10 user nova-compute[72239]: DEBUG nova.compute.manager [req-efe07fbe-6b86-4308-8834-dace692bb2ba req-8bfdc0e7-9d95-4f5a-83f1-6118c5242687 service nova] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] No waiting events found dispatching network-vif-plugged-b70a659a-8d31-407d-b2af-9ae98bd349ea {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:18:10 user nova-compute[72239]: WARNING nova.compute.manager [req-efe07fbe-6b86-4308-8834-dace692bb2ba req-8bfdc0e7-9d95-4f5a-83f1-6118c5242687 service nova] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Received unexpected event network-vif-plugged-b70a659a-8d31-407d-b2af-9ae98bd349ea for instance with vm_state active and task_state deleting.
Jul 31 15:18:11 user nova-compute[72239]: INFO nova.compute.manager [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Took 0.74 seconds to detach 1 volumes for instance.
Jul 31 15:18:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:18:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:18:11 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:18:11 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:18:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:18:11 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Deleted allocations for instance 97a662be-f1cf-4cd7-a98d-d22996f6282e
Jul 31 15:18:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7ade61f6-17d5-49e0-b151-47ca41291f36 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "97a662be-f1cf-4cd7-a98d-d22996f6282e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.086s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:18:14 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:18:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:18:16 user nova-compute[72239]: DEBUG nova.compute.manager [req-7ec0acdc-831b-45bf-8d3d-01f156fee554 req-b1e33e77-1773-4b81-92b3-78540fc872d7 service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Received event network-changed-dade5b65-0491-41c1-988b-d18a6613ec6d {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:18:16 user nova-compute[72239]: DEBUG nova.compute.manager [req-7ec0acdc-831b-45bf-8d3d-01f156fee554 req-b1e33e77-1773-4b81-92b3-78540fc872d7 service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Refreshing instance network info cache due to event network-changed-dade5b65-0491-41c1-988b-d18a6613ec6d. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:18:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7ec0acdc-831b-45bf-8d3d-01f156fee554 req-b1e33e77-1773-4b81-92b3-78540fc872d7 service nova] Acquiring lock "refresh_cache-f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:18:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7ec0acdc-831b-45bf-8d3d-01f156fee554 req-b1e33e77-1773-4b81-92b3-78540fc872d7 service nova] Acquired lock "refresh_cache-f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:18:16 user nova-compute[72239]: DEBUG nova.network.neutron [req-7ec0acdc-831b-45bf-8d3d-01f156fee554 req-b1e33e77-1773-4b81-92b3-78540fc872d7 service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Refreshing network info cache for port dade5b65-0491-41c1-988b-d18a6613ec6d {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:18:16 user nova-compute[72239]: DEBUG nova.network.neutron [req-7ec0acdc-831b-45bf-8d3d-01f156fee554 req-b1e33e77-1773-4b81-92b3-78540fc872d7 service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Updated VIF entry in instance network info cache for port dade5b65-0491-41c1-988b-d18a6613ec6d. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:18:16 user nova-compute[72239]: DEBUG nova.network.neutron [req-7ec0acdc-831b-45bf-8d3d-01f156fee554 req-b1e33e77-1773-4b81-92b3-78540fc872d7 service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Updating instance_info_cache with network_info: [{"id": "dade5b65-0491-41c1-988b-d18a6613ec6d", "address": "fa:16:3e:cf:e2:1d", "network": {"id": "b9eb37b6-27e4-4d9e-bfb2-7e167766e547", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1162541993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.94", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37ae523240a47bb936ef4b54994de61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdade5b65-04", "ovs_interfaceid": "dade5b65-0491-41c1-988b-d18a6613ec6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:18:16 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-7ec0acdc-831b-45bf-8d3d-01f156fee554 req-b1e33e77-1773-4b81-92b3-78540fc872d7 service nova] Releasing lock "refresh_cache-f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG nova.compute.manager [req-932f3c76-7c26-41ec-b769-3b5a50b98531 req-1e94e93c-daf9-4181-97c3-16ed61ab9b76 service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Received event network-changed-dade5b65-0491-41c1-988b-d18a6613ec6d {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG nova.compute.manager [req-932f3c76-7c26-41ec-b769-3b5a50b98531 req-1e94e93c-daf9-4181-97c3-16ed61ab9b76 service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Refreshing instance network info cache due to event network-changed-dade5b65-0491-41c1-988b-d18a6613ec6d. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-932f3c76-7c26-41ec-b769-3b5a50b98531 req-1e94e93c-daf9-4181-97c3-16ed61ab9b76 service nova] Acquiring lock "refresh_cache-f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-932f3c76-7c26-41ec-b769-3b5a50b98531 req-1e94e93c-daf9-4181-97c3-16ed61ab9b76 service nova] Acquired lock "refresh_cache-f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG nova.network.neutron [req-932f3c76-7c26-41ec-b769-3b5a50b98531 req-1e94e93c-daf9-4181-97c3-16ed61ab9b76 service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Refreshing network info cache for port dade5b65-0491-41c1-988b-d18a6613ec6d {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7463382c-11a6-48bb-8c4e-e536a316d2ca tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquiring lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7463382c-11a6-48bb-8c4e-e536a316d2ca tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:18:17 user nova-compute[72239]: INFO nova.compute.manager [None req-7463382c-11a6-48bb-8c4e-e536a316d2ca tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Detaching volume 89b87676-c2ea-443a-837d-4e4fb1057224
Jul 31 15:18:17 user nova-compute[72239]: INFO nova.virt.block_device [None req-7463382c-11a6-48bb-8c4e-e536a316d2ca tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Attempting to driver detach volume 89b87676-c2ea-443a-837d-4e4fb1057224 from mountpoint /dev/vdb
Jul 31 15:18:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7463382c-11a6-48bb-8c4e-e536a316d2ca tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Attempting to detach device vdb from instance f8b7d69e-f23a-4615-9f08-ce5fede9e4eb from the persistent domain config. {{(pid=72239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-7463382c-11a6-48bb-8c4e-e536a316d2ca tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 15:18:17 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:18:17 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 15:18:17 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 15:18:17 user nova-compute[72239]:   <serial>89b87676-c2ea-443a-837d-4e4fb1057224</serial>
Jul 31 15:18:17 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 15:18:17 user nova-compute[72239]: </disk>
Jul 31 15:18:17 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 15:18:17 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-7463382c-11a6-48bb-8c4e-e536a316d2ca tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Successfully detached device vdb from instance f8b7d69e-f23a-4615-9f08-ce5fede9e4eb from the persistent domain config.
Jul 31 15:18:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7463382c-11a6-48bb-8c4e-e536a316d2ca tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f8b7d69e-f23a-4615-9f08-ce5fede9e4eb from the live domain config. {{(pid=72239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-7463382c-11a6-48bb-8c4e-e536a316d2ca tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 15:18:17 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:18:17 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 15:18:17 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 15:18:17 user nova-compute[72239]:   <serial>89b87676-c2ea-443a-837d-4e4fb1057224</serial>
Jul 31 15:18:17 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 15:18:17 user nova-compute[72239]: </disk>
Jul 31 15:18:17 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG nova.network.neutron [req-932f3c76-7c26-41ec-b769-3b5a50b98531 req-1e94e93c-daf9-4181-97c3-16ed61ab9b76 service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Updated VIF entry in instance network info cache for port dade5b65-0491-41c1-988b-d18a6613ec6d. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG nova.network.neutron [req-932f3c76-7c26-41ec-b769-3b5a50b98531 req-1e94e93c-daf9-4181-97c3-16ed61ab9b76 service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Updating instance_info_cache with network_info: [{"id": "dade5b65-0491-41c1-988b-d18a6613ec6d", "address": "fa:16:3e:cf:e2:1d", "network": {"id": "b9eb37b6-27e4-4d9e-bfb2-7e167766e547", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1162541993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37ae523240a47bb936ef4b54994de61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdade5b65-04", "ovs_interfaceid": "dade5b65-0491-41c1-988b-d18a6613ec6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-932f3c76-7c26-41ec-b769-3b5a50b98531 req-1e94e93c-daf9-4181-97c3-16ed61ab9b76 service nova] Releasing lock "refresh_cache-f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Received event <DeviceRemovedEvent: 1690816697.762227, f8b7d69e-f23a-4615-9f08-ce5fede9e4eb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72239) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-7463382c-11a6-48bb-8c4e-e536a316d2ca tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f8b7d69e-f23a-4615-9f08-ce5fede9e4eb {{(pid=72239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 15:18:17 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-7463382c-11a6-48bb-8c4e-e536a316d2ca tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Successfully detached device vdb from instance f8b7d69e-f23a-4615-9f08-ce5fede9e4eb from the live domain config.
Jul 31 15:18:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7463382c-11a6-48bb-8c4e-e536a316d2ca tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7463382c-11a6-48bb-8c4e-e536a316d2ca tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WXHIpoNQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:18:17 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-7463382c-11a6-48bb-8c4e-e536a316d2ca tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:18:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-7463382c-11a6-48bb-8c4e-e536a316d2ca tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-7463382c-11a6-48bb-8c4e-e536a316d2ca tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7463382c-11a6-48bb-8c4e-e536a316d2ca tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8d15eb-6944-48b2-871d-9d95121fd8b5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e28a964-271a-448d-9518-73102c816472]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7463382c-11a6-48bb-8c4e-e536a316d2ca tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224 (non-flash)
Jul 31 15:18:17 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7463382c-11a6-48bb-8c4e-e536a316d2ca tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224 (non-flash)
Jul 31 15:18:17 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7463382c-11a6-48bb-8c4e-e536a316d2ca tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41204a68c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224'): ({'sdb'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-7463382c-11a6-48bb-8c4e-e536a316d2ca tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Removing single pathed devices sdb {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfc61917-fc59-48a2-aef3-fd97018ab348]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca9db9a5-9b05-4235-b563-7b0460ab1a6a]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-7463382c-11a6-48bb-8c4e-e536a316d2ca tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Flushing IO for device /dev/sdb {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1418735-9778-4954-9129-888d6b648651]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-7463382c-11a6-48bb-8c4e-e536a316d2ca tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cefd445-104d-4f8a-b9d3-902e7f517866]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-7463382c-11a6-48bb-8c4e-e536a316d2ca tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-7463382c-11a6-48bb-8c4e-e536a316d2ca tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7463382c-11a6-48bb-8c4e-e536a316d2ca tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[986cc0da-ddbc-42af-9d68-29e6d5347a1a]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7463382c-11a6-48bb-8c4e-e536a316d2ca tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:18:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224 -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:18:18 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:18:18 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9955121f-3841-4726-b9af-d290638c2dce]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:18:18 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7463382c-11a6-48bb-8c4e-e536a316d2ca tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224, portal: 172.16.0.220,3260]
Jul 31 15:18:18 user nova-compute[72239]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224, portal: 172.16.0.220,3260] successful.
Jul 31 15:18:18 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:18:18 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224 -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:18:18 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:89b87676-c2ea-443a-837d-4e4fb1057224 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:18:18 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebbbac07-ccdb-4ecf-bb3b-7daeb48f70f2]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:18:18 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7463382c-11a6-48bb-8c4e-e536a316d2ca tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:18:18 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-7463382c-11a6-48bb-8c4e-e536a316d2ca tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.253s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:18:18 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-7463382c-11a6-48bb-8c4e-e536a316d2ca tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] <== disconnect_volume: return (255ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:18:18 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7463382c-11a6-48bb-8c4e-e536a316d2ca tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 15:18:18 user nova-compute[72239]: DEBUG nova.objects.instance [None req-7463382c-11a6-48bb-8c4e-e536a316d2ca tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lazy-loading 'flavor' on Instance uuid f8b7d69e-f23a-4615-9f08-ce5fede9e4eb {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:18:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-7463382c-11a6-48bb-8c4e-e536a316d2ca tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.593s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:18:19 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:18:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:18:21 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:18:22 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:18:24 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690816689.1204517, 97a662be-f1cf-4cd7-a98d-d22996f6282e => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:18:24 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] VM Stopped (Lifecycle Event)
Jul 31 15:18:24 user nova-compute[72239]: DEBUG nova.compute.manager [None req-4cdcb2d4-8889-40f1-af06-7c282f40931f None None] [instance: 97a662be-f1cf-4cd7-a98d-d22996f6282e] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:18:24 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:18:24 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:18:26 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:18:26 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 15:18:26 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Didn't find any instances for network info cache update. {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 15:18:28 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:18:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:18:29 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:18:29 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:18:30 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:18:30 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 15:18:31 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:18:31 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:18:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:18:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:18:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:18:31 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 15:18:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8b7d69e-f23a-4615-9f08-ce5fede9e4eb/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:18:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8b7d69e-f23a-4615-9f08-ce5fede9e4eb/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:18:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8b7d69e-f23a-4615-9f08-ce5fede9e4eb/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:18:31 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8b7d69e-f23a-4615-9f08-ce5fede9e4eb/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:18:32 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:18:32 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:18:32 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=8754MB free_disk=25.085407257080078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 15:18:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:18:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:18:32 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance f8b7d69e-f23a-4615-9f08-ce5fede9e4eb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:18:32 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 15:18:32 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 15:18:32 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:18:32 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:18:32 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 15:18:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.189s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:18:34 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:18:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:18:44 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:18:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:18:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:18:59 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:18:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "1650dae6-9c2e-4316-9655-12cc6f074d63" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:18:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "1650dae6-9c2e-4316-9655-12cc6f074d63" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:18:59 user nova-compute[72239]: DEBUG nova.compute.manager [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 15:19:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:19:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:19:00 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 15:19:00 user nova-compute[72239]: INFO nova.compute.claims [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Claim successful on node user
Jul 31 15:19:00 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:19:00 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:19:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.250s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:19:00 user nova-compute[72239]: DEBUG nova.compute.manager [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 15:19:00 user nova-compute[72239]: DEBUG nova.compute.manager [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 15:19:00 user nova-compute[72239]: DEBUG nova.network.neutron [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 15:19:00 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 15:19:00 user nova-compute[72239]: DEBUG nova.compute.manager [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 15:19:00 user nova-compute[72239]: INFO nova.virt.block_device [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Booting with volume f439f64a-a30f-4ab8-811f-65673bcb1bbc at /dev/vda
Jul 31 15:19:00 user nova-compute[72239]: DEBUG nova.policy [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a73969a32be54c8caf621290e8823134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aaefdc03aa4e43b4ba435eea373cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 15:19:00 user nova-compute[72239]: DEBUG os_brick.utils [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:19:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:19:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:19:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2880074-c113-46cc-ad36-aa5cc9726d22]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:19:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:19:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:19:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e694c4ef-ddd7-4982-8914-ffab67e2b982]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:19:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:19:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:19:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[948f2d43-f3dc-47fc-8a41-ddfd75c26226]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:19:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[218d4b54-9919-479d-ac45-168375b36364]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:19:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:19:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:19:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 15:19:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:19:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:19:00 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 15:19:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9e96b2-98df-4ecd-8fff-70fa9a4d5824]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:19:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 15:19:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 15:19:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 15:19:00 user nova-compute[72239]: DEBUG os_brick.utils [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:19:00 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Updating existing volume attachment record: 43ec31e6-5f8c-40e3-8d08-0c28d95809f0 {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 15:19:01 user nova-compute[72239]: DEBUG nova.network.neutron [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Successfully created port: 31e11082-cc50-4fd2-b847-be246d32fcd8 {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 15:19:02 user nova-compute[72239]: DEBUG nova.network.neutron [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Successfully updated port: 31e11082-cc50-4fd2-b847-be246d32fcd8 {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 15:19:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "refresh_cache-1650dae6-9c2e-4316-9655-12cc6f074d63" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:19:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquired lock "refresh_cache-1650dae6-9c2e-4316-9655-12cc6f074d63" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:19:02 user nova-compute[72239]: DEBUG nova.network.neutron [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 15:19:02 user nova-compute[72239]: DEBUG nova.compute.manager [req-d9d9b1d0-6b2e-42eb-ab20-507d3636b4f3 req-af16282e-05e2-4e31-84d1-bacf14d64153 service nova] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Received event network-changed-31e11082-cc50-4fd2-b847-be246d32fcd8 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:19:02 user nova-compute[72239]: DEBUG nova.compute.manager [req-d9d9b1d0-6b2e-42eb-ab20-507d3636b4f3 req-af16282e-05e2-4e31-84d1-bacf14d64153 service nova] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Refreshing instance network info cache due to event network-changed-31e11082-cc50-4fd2-b847-be246d32fcd8. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:19:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d9d9b1d0-6b2e-42eb-ab20-507d3636b4f3 req-af16282e-05e2-4e31-84d1-bacf14d64153 service nova] Acquiring lock "refresh_cache-1650dae6-9c2e-4316-9655-12cc6f074d63" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:19:02 user nova-compute[72239]: DEBUG nova.network.neutron [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 15:19:02 user nova-compute[72239]: DEBUG nova.network.neutron [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Updating instance_info_cache with network_info: [{"id": "31e11082-cc50-4fd2-b847-be246d32fcd8", "address": "fa:16:3e:3c:c9:46", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e11082-cc", "ovs_interfaceid": "31e11082-cc50-4fd2-b847-be246d32fcd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:19:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Releasing lock "refresh_cache-1650dae6-9c2e-4316-9655-12cc6f074d63" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:19:02 user nova-compute[72239]: DEBUG nova.compute.manager [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Instance network_info: |[{"id": "31e11082-cc50-4fd2-b847-be246d32fcd8", "address": "fa:16:3e:3c:c9:46", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e11082-cc", "ovs_interfaceid": "31e11082-cc50-4fd2-b847-be246d32fcd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 15:19:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d9d9b1d0-6b2e-42eb-ab20-507d3636b4f3 req-af16282e-05e2-4e31-84d1-bacf14d64153 service nova] Acquired lock "refresh_cache-1650dae6-9c2e-4316-9655-12cc6f074d63" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:19:02 user nova-compute[72239]: DEBUG nova.network.neutron [req-d9d9b1d0-6b2e-42eb-ab20-507d3636b4f3 req-af16282e-05e2-4e31-84d1-bacf14d64153 service nova] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Refreshing network info cache for port 31e11082-cc50-4fd2-b847-be246d32fcd8 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:19:02 user nova-compute[72239]: DEBUG nova.network.neutron [req-d9d9b1d0-6b2e-42eb-ab20-507d3636b4f3 req-af16282e-05e2-4e31-84d1-bacf14d64153 service nova] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Updated VIF entry in instance network info cache for port 31e11082-cc50-4fd2-b847-be246d32fcd8. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:19:02 user nova-compute[72239]: DEBUG nova.network.neutron [req-d9d9b1d0-6b2e-42eb-ab20-507d3636b4f3 req-af16282e-05e2-4e31-84d1-bacf14d64153 service nova] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Updating instance_info_cache with network_info: [{"id": "31e11082-cc50-4fd2-b847-be246d32fcd8", "address": "fa:16:3e:3c:c9:46", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e11082-cc", "ovs_interfaceid": "31e11082-cc50-4fd2-b847-be246d32fcd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:19:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-d9d9b1d0-6b2e-42eb-ab20-507d3636b4f3 req-af16282e-05e2-4e31-84d1-bacf14d64153 service nova] Releasing lock "refresh_cache-1650dae6-9c2e-4316-9655-12cc6f074d63" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:19:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG nova.compute.manager [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 15:19:07 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Creating image(s)
Jul 31 15:19:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Did not create local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Ensure instance console log exists: /opt/stack/data/nova/instances/1650dae6-9c2e-4316-9655-12cc6f074d63/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Start _get_guest_xml network_info=[{"id": "31e11082-cc50-4fd2-b847-be246d32fcd8", "address": "fa:16:3e:3c:c9:46", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e11082-cc", "ovs_interfaceid": "31e11082-cc50-4fd2-b847-be246d32fcd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': '43ec31e6-5f8c-40e3-8d08-0c28d95809f0', 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VqRajYtz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1650dae6-9c2e-4316-9655-12cc6f074d63', 'attached_at': '', 'detached_at': '', 'volume_id': 'f439f64a-a30f-4ab8-811f-65673bcb1bbc', 'serial': 'f439f64a-a30f-4ab8-811f-65673bcb1bbc'}, 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 15:19:07 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:19:07 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:19:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VqRajYtz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:19:07 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:19:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:19:07 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:19:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:19:07 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 15:19:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0311986-4a10-4380-b003-e43bb098b760]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 15:19:07 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2066dc5f-4256-4f98-9cb4-f8a8b16a73db]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc] added
Jul 31 15:19:07 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[12308fd2-90f5-4af8-bc07-62563773a553]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[491732c5-1664-47ee-9aa0-05c3d0926c70]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VqRajYtz {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VqRajYtz" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a06595-8c3a-4a3c-96b6-c6fdb0807677]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VqRajYtz'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4cb33f-25f7-4853-877d-7beac9570b99]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af3f99e-7acf-4286-9a09-a3b8eac5c3d8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 15:19:07 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 15:19:07 user nova-compute[72239]:  {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:19:07 user nova-compute[72239]: WARNING os_brick.initiator.connectors.iscsi [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 15:19:07 user nova-compute[72239]: 
Jul 31 15:19:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc7f2ee-301f-4653-ada8-2163095d84cd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc, portal: 172.16.0.220,3260]
Jul 31 15:19:07 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc, portal: 172.16.0.220,3260] successful.
Jul 31 15:19:07 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fb8907-7b72-454e-b57c-2b686064f9df]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[993cf967-033e-486d-a408-998e1a29be27]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc (non-flash)
Jul 31 15:19:07 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc (non-flash)
Jul 31 15:19:07 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5dd05f-804f-4977-8255-5c10898abfe3]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:19:07 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 15:19:08 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 15:19:08 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VqRajYtz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 15:19:08 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.272s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:19:08 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] <== connect_volume: return (1273ms) {'type': 'block', 'scsi_wwn': '23534386233313936', 'path': '/dev/sdb'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:19:08 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534386233313936', 'path': '/dev/sdb'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 15:19:08 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:18:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-497279968',display_name='tempest-TestVolumeBootPattern-server-497279968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-497279968',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCY3vLYjwCj2oqQSBolW7c+OcVO1ul/eTZat0QSfOYuU0YxIpJAnnDmoUxQPBXaqflB5z610Pc9fwuWzrnOXKK97zfH7u+iQLjb5dXhWdA4VmffAJRc95WJmSak/jG2I9g==',key_name='tempest-TestVolumeBootPattern-1846536962',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35aaefdc03aa4e43b4ba435eea373cc4',ramdisk_id='',reservation_id='r-i6i1lvja',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1903261024',owner_user_name='tempest-TestVolumeBootPattern-1903261024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T15:19:00Z,user_data=None,user_id='a73969a32be54c8caf621290e8823134',uuid=1650dae6-9c2e-4316-9655-12cc6f074d63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31e11082-cc50-4fd2-b847-be246d32fcd8", "address": "fa:16:3e:3c:c9:46", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e11082-cc", "ovs_interfaceid": "31e11082-cc50-4fd2-b847-be246d32fcd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 15:19:08 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Converting VIF {"id": "31e11082-cc50-4fd2-b847-be246d32fcd8", "address": "fa:16:3e:3c:c9:46", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e11082-cc", "ovs_interfaceid": "31e11082-cc50-4fd2-b847-be246d32fcd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:19:08 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:c9:46,bridge_name='br-int',has_traffic_filtering=True,id=31e11082-cc50-4fd2-b847-be246d32fcd8,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31e11082-cc') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:19:08 user nova-compute[72239]: DEBUG nova.objects.instance [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lazy-loading 'pci_devices' on Instance uuid 1650dae6-9c2e-4316-9655-12cc6f074d63 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:19:08 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] End _get_guest_xml xml=<domain type="kvm">
Jul 31 15:19:08 user nova-compute[72239]:   <uuid>1650dae6-9c2e-4316-9655-12cc6f074d63</uuid>
Jul 31 15:19:08 user nova-compute[72239]:   <name>instance-00000032</name>
Jul 31 15:19:08 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 15:19:08 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 15:19:08 user nova-compute[72239]:   <metadata>
Jul 31 15:19:08 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 15:19:08 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 15:19:08 user nova-compute[72239]:       <nova:name>tempest-TestVolumeBootPattern-server-497279968</nova:name>
Jul 31 15:19:08 user nova-compute[72239]:       <nova:creationTime>2023-07-31 15:19:07</nova:creationTime>
Jul 31 15:19:08 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 15:19:08 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 15:19:08 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 15:19:08 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 15:19:08 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 15:19:08 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 15:19:08 user nova-compute[72239]:       </nova:flavor>
Jul 31 15:19:08 user nova-compute[72239]:       <nova:owner>
Jul 31 15:19:08 user nova-compute[72239]:         <nova:user uuid="a73969a32be54c8caf621290e8823134">tempest-TestVolumeBootPattern-1903261024-project-member</nova:user>
Jul 31 15:19:08 user nova-compute[72239]:         <nova:project uuid="35aaefdc03aa4e43b4ba435eea373cc4">tempest-TestVolumeBootPattern-1903261024</nova:project>
Jul 31 15:19:08 user nova-compute[72239]:       </nova:owner>
Jul 31 15:19:08 user nova-compute[72239]:       <nova:ports>
Jul 31 15:19:08 user nova-compute[72239]:         <nova:port uuid="31e11082-cc50-4fd2-b847-be246d32fcd8">
Jul 31 15:19:08 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 31 15:19:08 user nova-compute[72239]:         </nova:port>
Jul 31 15:19:08 user nova-compute[72239]:       </nova:ports>
Jul 31 15:19:08 user nova-compute[72239]:     </nova:instance>
Jul 31 15:19:08 user nova-compute[72239]:   </metadata>
Jul 31 15:19:08 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 15:19:08 user nova-compute[72239]:     <system>
Jul 31 15:19:08 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 15:19:08 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 15:19:08 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 15:19:08 user nova-compute[72239]:       <entry name="serial">1650dae6-9c2e-4316-9655-12cc6f074d63</entry>
Jul 31 15:19:08 user nova-compute[72239]:       <entry name="uuid">1650dae6-9c2e-4316-9655-12cc6f074d63</entry>
Jul 31 15:19:08 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 15:19:08 user nova-compute[72239]:     </system>
Jul 31 15:19:08 user nova-compute[72239]:   </sysinfo>
Jul 31 15:19:08 user nova-compute[72239]:   <os>
Jul 31 15:19:08 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 15:19:08 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 15:19:08 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 15:19:08 user nova-compute[72239]:   </os>
Jul 31 15:19:08 user nova-compute[72239]:   <features>
Jul 31 15:19:08 user nova-compute[72239]:     <acpi/>
Jul 31 15:19:08 user nova-compute[72239]:     <apic/>
Jul 31 15:19:08 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 15:19:08 user nova-compute[72239]:   </features>
Jul 31 15:19:08 user nova-compute[72239]:   <clock offset="utc">
Jul 31 15:19:08 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 15:19:08 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 15:19:08 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 15:19:08 user nova-compute[72239]:   </clock>
Jul 31 15:19:08 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 15:19:08 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 15:19:08 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 15:19:08 user nova-compute[72239]:   </cpu>
Jul 31 15:19:08 user nova-compute[72239]:   <devices>
Jul 31 15:19:08 user nova-compute[72239]:     <disk type="block" device="disk">
Jul 31 15:19:08 user nova-compute[72239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:19:08 user nova-compute[72239]:       <source dev="/dev/sdb"/>
Jul 31 15:19:08 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 15:19:08 user nova-compute[72239]:       <serial>f439f64a-a30f-4ab8-811f-65673bcb1bbc</serial>
Jul 31 15:19:08 user nova-compute[72239]:     </disk>
Jul 31 15:19:08 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 15:19:08 user nova-compute[72239]:       <mac address="fa:16:3e:3c:c9:46"/>
Jul 31 15:19:08 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:19:08 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 15:19:08 user nova-compute[72239]:       <target dev="tap31e11082-cc"/>
Jul 31 15:19:08 user nova-compute[72239]:     </interface>
Jul 31 15:19:08 user nova-compute[72239]:     <serial type="pty">
Jul 31 15:19:08 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/1650dae6-9c2e-4316-9655-12cc6f074d63/console.log" append="off"/>
Jul 31 15:19:08 user nova-compute[72239]:     </serial>
Jul 31 15:19:08 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 15:19:08 user nova-compute[72239]:     <video>
Jul 31 15:19:08 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:19:08 user nova-compute[72239]:     </video>
Jul 31 15:19:08 user nova-compute[72239]:     <rng model="virtio">
Jul 31 15:19:08 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 15:19:08 user nova-compute[72239]:     </rng>
Jul 31 15:19:08 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 15:19:08 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 15:19:08 user nova-compute[72239]:       <stats period="10"/>
Jul 31 15:19:08 user nova-compute[72239]:     </memballoon>
Jul 31 15:19:08 user nova-compute[72239]:   </devices>
Jul 31 15:19:08 user nova-compute[72239]: </domain>
Jul 31 15:19:08 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 15:19:08 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:18:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-497279968',display_name='tempest-TestVolumeBootPattern-server-497279968',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-497279968',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCY3vLYjwCj2oqQSBolW7c+OcVO1ul/eTZat0QSfOYuU0YxIpJAnnDmoUxQPBXaqflB5z610Pc9fwuWzrnOXKK97zfH7u+iQLjb5dXhWdA4VmffAJRc95WJmSak/jG2I9g==',key_name='tempest-TestVolumeBootPattern-1846536962',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35aaefdc03aa4e43b4ba435eea373cc4',ramdisk_id='',reservation_id='r-i6i1lvja',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1903261024',owner_user_name='tempest-TestVolumeBootPattern-1903261024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T15:19:00Z,user_data=None,user_id='a73969a32be54c8caf621290e8823134',uuid=1650dae6-9c2e-4316-9655-12cc6f074d63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "31e11082-cc50-4fd2-b847-be246d32fcd8", "address": "fa:16:3e:3c:c9:46", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e11082-cc", "ovs_interfaceid": "31e11082-cc50-4fd2-b847-be246d32fcd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 15:19:08 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Converting VIF {"id": "31e11082-cc50-4fd2-b847-be246d32fcd8", "address": "fa:16:3e:3c:c9:46", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e11082-cc", "ovs_interfaceid": "31e11082-cc50-4fd2-b847-be246d32fcd8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:19:08 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:c9:46,bridge_name='br-int',has_traffic_filtering=True,id=31e11082-cc50-4fd2-b847-be246d32fcd8,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31e11082-cc') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:19:08 user nova-compute[72239]: DEBUG os_vif [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:c9:46,bridge_name='br-int',has_traffic_filtering=True,id=31e11082-cc50-4fd2-b847-be246d32fcd8,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31e11082-cc') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 15:19:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:19:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:19:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 15:19:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:19:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap31e11082-cc, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:19:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap31e11082-cc, col_values=(('external_ids', {'iface-id': '31e11082-cc50-4fd2-b847-be246d32fcd8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:c9:46', 'vm-uuid': '1650dae6-9c2e-4316-9655-12cc6f074d63'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:19:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:19:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:19:08 user nova-compute[72239]: INFO os_vif [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:c9:46,bridge_name='br-int',has_traffic_filtering=True,id=31e11082-cc50-4fd2-b847-be246d32fcd8,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31e11082-cc')
Jul 31 15:19:08 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:19:08 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] No VIF found with MAC fa:16:3e:3c:c9:46, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 15:19:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:19:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:19:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:19:10 user nova-compute[72239]: DEBUG nova.compute.manager [req-ca48704f-2124-4ffb-b6f5-c964b43ab962 req-63f18a99-cd16-4d09-b729-002c39217cf7 service nova] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Received event network-vif-plugged-31e11082-cc50-4fd2-b847-be246d32fcd8 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:19:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ca48704f-2124-4ffb-b6f5-c964b43ab962 req-63f18a99-cd16-4d09-b729-002c39217cf7 service nova] Acquiring lock "1650dae6-9c2e-4316-9655-12cc6f074d63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:19:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ca48704f-2124-4ffb-b6f5-c964b43ab962 req-63f18a99-cd16-4d09-b729-002c39217cf7 service nova] Lock "1650dae6-9c2e-4316-9655-12cc6f074d63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:19:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-ca48704f-2124-4ffb-b6f5-c964b43ab962 req-63f18a99-cd16-4d09-b729-002c39217cf7 service nova] Lock "1650dae6-9c2e-4316-9655-12cc6f074d63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:19:10 user nova-compute[72239]: DEBUG nova.compute.manager [req-ca48704f-2124-4ffb-b6f5-c964b43ab962 req-63f18a99-cd16-4d09-b729-002c39217cf7 service nova] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] No waiting events found dispatching network-vif-plugged-31e11082-cc50-4fd2-b847-be246d32fcd8 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:19:10 user nova-compute[72239]: WARNING nova.compute.manager [req-ca48704f-2124-4ffb-b6f5-c964b43ab962 req-63f18a99-cd16-4d09-b729-002c39217cf7 service nova] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Received unexpected event network-vif-plugged-31e11082-cc50-4fd2-b847-be246d32fcd8 for instance with vm_state building and task_state spawning.
Jul 31 15:19:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:19:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:19:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:19:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:19:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-3c8b7aee-4f2a-441f-be13-92dcf442e003 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquiring lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:19:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-3c8b7aee-4f2a-441f-be13-92dcf442e003 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:19:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-3c8b7aee-4f2a-441f-be13-92dcf442e003 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquiring lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:19:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-3c8b7aee-4f2a-441f-be13-92dcf442e003 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:19:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-3c8b7aee-4f2a-441f-be13-92dcf442e003 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:19:11 user nova-compute[72239]: INFO nova.compute.manager [None req-3c8b7aee-4f2a-441f-be13-92dcf442e003 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Terminating instance
Jul 31 15:19:11 user nova-compute[72239]: DEBUG nova.compute.manager [None req-3c8b7aee-4f2a-441f-be13-92dcf442e003 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 15:19:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:19:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:19:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:19:12 user nova-compute[72239]: DEBUG nova.compute.manager [req-51424342-a5c7-46bd-99f5-60424064183c req-7cecb62e-c0fd-4d8a-bcb5-7d86362c63f6 service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Received event network-vif-unplugged-dade5b65-0491-41c1-988b-d18a6613ec6d {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:19:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-51424342-a5c7-46bd-99f5-60424064183c req-7cecb62e-c0fd-4d8a-bcb5-7d86362c63f6 service nova] Acquiring lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:19:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-51424342-a5c7-46bd-99f5-60424064183c req-7cecb62e-c0fd-4d8a-bcb5-7d86362c63f6 service nova] Lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:19:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-51424342-a5c7-46bd-99f5-60424064183c req-7cecb62e-c0fd-4d8a-bcb5-7d86362c63f6 service nova] Lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:19:12 user nova-compute[72239]: DEBUG nova.compute.manager [req-51424342-a5c7-46bd-99f5-60424064183c req-7cecb62e-c0fd-4d8a-bcb5-7d86362c63f6 service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] No waiting events found dispatching network-vif-unplugged-dade5b65-0491-41c1-988b-d18a6613ec6d {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:19:12 user nova-compute[72239]: DEBUG nova.compute.manager [req-51424342-a5c7-46bd-99f5-60424064183c req-7cecb62e-c0fd-4d8a-bcb5-7d86362c63f6 service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Received event network-vif-unplugged-dade5b65-0491-41c1-988b-d18a6613ec6d for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 15:19:12 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690816752.3785033, 1650dae6-9c2e-4316-9655-12cc6f074d63 => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:19:12 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] VM Resumed (Lifecycle Event)
Jul 31 15:19:12 user nova-compute[72239]: DEBUG nova.compute.manager [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 15:19:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 15:19:12 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Instance spawned successfully.
Jul 31 15:19:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 15:19:12 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:19:12 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:19:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:19:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:19:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:19:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:19:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:19:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:19:12 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 15:19:12 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690816752.3822882, 1650dae6-9c2e-4316-9655-12cc6f074d63 => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:19:12 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] VM Started (Lifecycle Event)
Jul 31 15:19:12 user nova-compute[72239]: DEBUG nova.compute.manager [req-85c997fc-6ab0-434b-aa47-de578ccfd186 req-f454d19e-7b01-440c-8c10-aac7b7efbf3a service nova] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Received event network-vif-plugged-31e11082-cc50-4fd2-b847-be246d32fcd8 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:19:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-85c997fc-6ab0-434b-aa47-de578ccfd186 req-f454d19e-7b01-440c-8c10-aac7b7efbf3a service nova] Acquiring lock "1650dae6-9c2e-4316-9655-12cc6f074d63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:19:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-85c997fc-6ab0-434b-aa47-de578ccfd186 req-f454d19e-7b01-440c-8c10-aac7b7efbf3a service nova] Lock "1650dae6-9c2e-4316-9655-12cc6f074d63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:19:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-85c997fc-6ab0-434b-aa47-de578ccfd186 req-f454d19e-7b01-440c-8c10-aac7b7efbf3a service nova] Lock "1650dae6-9c2e-4316-9655-12cc6f074d63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:19:12 user nova-compute[72239]: DEBUG nova.compute.manager [req-85c997fc-6ab0-434b-aa47-de578ccfd186 req-f454d19e-7b01-440c-8c10-aac7b7efbf3a service nova] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] No waiting events found dispatching network-vif-plugged-31e11082-cc50-4fd2-b847-be246d32fcd8 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:19:12 user nova-compute[72239]: WARNING nova.compute.manager [req-85c997fc-6ab0-434b-aa47-de578ccfd186 req-f454d19e-7b01-440c-8c10-aac7b7efbf3a service nova] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Received unexpected event network-vif-plugged-31e11082-cc50-4fd2-b847-be246d32fcd8 for instance with vm_state building and task_state spawning.
Jul 31 15:19:12 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:19:12 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:19:12 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 15:19:12 user nova-compute[72239]: INFO nova.compute.manager [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Took 4.98 seconds to spawn the instance on the hypervisor.
Jul 31 15:19:12 user nova-compute[72239]: DEBUG nova.compute.manager [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:19:12 user nova-compute[72239]: INFO nova.compute.manager [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Took 12.54 seconds to build instance.
Jul 31 15:19:12 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-a3dd6910-c760-41f0-9513-9b01455cdc80 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "1650dae6-9c2e-4316-9655-12cc6f074d63" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.655s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:19:12 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Instance destroyed successfully.
Jul 31 15:19:12 user nova-compute[72239]: DEBUG nova.objects.instance [None req-3c8b7aee-4f2a-441f-be13-92dcf442e003 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lazy-loading 'resources' on Instance uuid f8b7d69e-f23a-4615-9f08-ce5fede9e4eb {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:19:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-3c8b7aee-4f2a-441f-be13-92dcf442e003 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:14:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1389812758',display_name='tempest-TestMinimumBasicScenario-server-1389812758',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1389812758',id=48,image_ref='01125b01-4b83-422d-b8ab-a9b86821978e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPB4PaX1aLez4CZP4ezZr+kmozP1OQIYFxiMKhZ28BG6oz32xLwAtJg0LaQl8b2kpCmZ7a86lBBv4vfq3UeeWJkLN6sDz7u9+q9DciQuvJHr9YWmCHdHcIznbJgteqOyA==',key_name='tempest-TestMinimumBasicScenario-1453227332',keypairs=<?>,launch_index=0,launched_at=2023-07-31T15:14:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f37ae523240a47bb936ef4b54994de61',ramdisk_id='',reservation_id='r-pd9f956b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='01125b01-4b83-422d-b8ab-a9b86821978e',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-429761002',owner_user_name='tempest-TestMinimumBasicScenario-429761002-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T15:16:33Z,user_data=None,user_id='d0a629efb75a463892b841e95f6d4acf',uuid=f8b7d69e-f23a-4615-9f08-ce5fede9e4eb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dade5b65-0491-41c1-988b-d18a6613ec6d", "address": "fa:16:3e:cf:e2:1d", "network": {"id": "b9eb37b6-27e4-4d9e-bfb2-7e167766e547", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1162541993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37ae523240a47bb936ef4b54994de61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdade5b65-04", "ovs_interfaceid": "dade5b65-0491-41c1-988b-d18a6613ec6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 15:19:12 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-3c8b7aee-4f2a-441f-be13-92dcf442e003 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Converting VIF {"id": "dade5b65-0491-41c1-988b-d18a6613ec6d", "address": "fa:16:3e:cf:e2:1d", "network": {"id": "b9eb37b6-27e4-4d9e-bfb2-7e167766e547", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1162541993-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f37ae523240a47bb936ef4b54994de61", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdade5b65-04", "ovs_interfaceid": "dade5b65-0491-41c1-988b-d18a6613ec6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:19:12 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-3c8b7aee-4f2a-441f-be13-92dcf442e003 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cf:e2:1d,bridge_name='br-int',has_traffic_filtering=True,id=dade5b65-0491-41c1-988b-d18a6613ec6d,network=Network(b9eb37b6-27e4-4d9e-bfb2-7e167766e547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdade5b65-04') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:19:12 user nova-compute[72239]: DEBUG os_vif [None req-3c8b7aee-4f2a-441f-be13-92dcf442e003 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:e2:1d,bridge_name='br-int',has_traffic_filtering=True,id=dade5b65-0491-41c1-988b-d18a6613ec6d,network=Network(b9eb37b6-27e4-4d9e-bfb2-7e167766e547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdade5b65-04') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 15:19:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:19:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdade5b65-04, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:19:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:19:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:19:13 user nova-compute[72239]: INFO os_vif [None req-3c8b7aee-4f2a-441f-be13-92dcf442e003 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:e2:1d,bridge_name='br-int',has_traffic_filtering=True,id=dade5b65-0491-41c1-988b-d18a6613ec6d,network=Network(b9eb37b6-27e4-4d9e-bfb2-7e167766e547),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdade5b65-04')
Jul 31 15:19:13 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-3c8b7aee-4f2a-441f-be13-92dcf442e003 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Deleting instance files /opt/stack/data/nova/instances/f8b7d69e-f23a-4615-9f08-ce5fede9e4eb_del
Jul 31 15:19:13 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-3c8b7aee-4f2a-441f-be13-92dcf442e003 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Deletion of /opt/stack/data/nova/instances/f8b7d69e-f23a-4615-9f08-ce5fede9e4eb_del complete
Jul 31 15:19:13 user nova-compute[72239]: INFO nova.compute.manager [None req-3c8b7aee-4f2a-441f-be13-92dcf442e003 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Took 1.22 seconds to destroy the instance on the hypervisor.
Jul 31 15:19:13 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-3c8b7aee-4f2a-441f-be13-92dcf442e003 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 15:19:13 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 15:19:13 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 15:19:13 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:19:13 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Took 0.70 seconds to deallocate network for instance.
Jul 31 15:19:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-3c8b7aee-4f2a-441f-be13-92dcf442e003 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:19:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-3c8b7aee-4f2a-441f-be13-92dcf442e003 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:19:14 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-3c8b7aee-4f2a-441f-be13-92dcf442e003 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:19:14 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-3c8b7aee-4f2a-441f-be13-92dcf442e003 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:19:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-3c8b7aee-4f2a-441f-be13-92dcf442e003 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.139s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:19:14 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-3c8b7aee-4f2a-441f-be13-92dcf442e003 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Deleted allocations for instance f8b7d69e-f23a-4615-9f08-ce5fede9e4eb
Jul 31 15:19:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-3c8b7aee-4f2a-441f-be13-92dcf442e003 tempest-TestMinimumBasicScenario-429761002 tempest-TestMinimumBasicScenario-429761002-project-member] Lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.266s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:19:14 user nova-compute[72239]: DEBUG nova.compute.manager [req-95d2d591-947a-46a9-aff6-c0bd0e4a5dae req-40d64ef5-6b51-4ece-b82c-e72ca4f906de service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Received event network-vif-plugged-dade5b65-0491-41c1-988b-d18a6613ec6d {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:19:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-95d2d591-947a-46a9-aff6-c0bd0e4a5dae req-40d64ef5-6b51-4ece-b82c-e72ca4f906de service nova] Acquiring lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:19:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-95d2d591-947a-46a9-aff6-c0bd0e4a5dae req-40d64ef5-6b51-4ece-b82c-e72ca4f906de service nova] Lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:19:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-95d2d591-947a-46a9-aff6-c0bd0e4a5dae req-40d64ef5-6b51-4ece-b82c-e72ca4f906de service nova] Lock "f8b7d69e-f23a-4615-9f08-ce5fede9e4eb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:19:14 user nova-compute[72239]: DEBUG nova.compute.manager [req-95d2d591-947a-46a9-aff6-c0bd0e4a5dae req-40d64ef5-6b51-4ece-b82c-e72ca4f906de service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] No waiting events found dispatching network-vif-plugged-dade5b65-0491-41c1-988b-d18a6613ec6d {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:19:14 user nova-compute[72239]: WARNING nova.compute.manager [req-95d2d591-947a-46a9-aff6-c0bd0e4a5dae req-40d64ef5-6b51-4ece-b82c-e72ca4f906de service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Received unexpected event network-vif-plugged-dade5b65-0491-41c1-988b-d18a6613ec6d for instance with vm_state deleted and task_state None.
Jul 31 15:19:14 user nova-compute[72239]: DEBUG nova.compute.manager [req-95d2d591-947a-46a9-aff6-c0bd0e4a5dae req-40d64ef5-6b51-4ece-b82c-e72ca4f906de service nova] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Received event network-vif-deleted-dade5b65-0491-41c1-988b-d18a6613ec6d {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:19:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:19:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:19:23 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:19:23 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:19:23 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:19:23 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:19:23 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:19:23 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:19:23 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:19:23 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:19:26 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:19:27 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690816752.737627, f8b7d69e-f23a-4615-9f08-ce5fede9e4eb => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:19:27 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] VM Stopped (Lifecycle Event)
Jul 31 15:19:27 user nova-compute[72239]: DEBUG nova.compute.manager [None req-ecd12089-00c3-4ad8-b6d5-391c3acb78ba None None] [instance: f8b7d69e-f23a-4615-9f08-ce5fede9e4eb] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:19:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:19:28 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:19:28 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 15:19:28 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Rebuilding the list of instances to heal {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 15:19:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-1650dae6-9c2e-4316-9655-12cc6f074d63" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:19:28 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-1650dae6-9c2e-4316-9655-12cc6f074d63" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:19:28 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 15:19:28 user nova-compute[72239]: DEBUG nova.objects.instance [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lazy-loading 'info_cache' on Instance uuid 1650dae6-9c2e-4316-9655-12cc6f074d63 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:19:29 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Updating instance_info_cache with network_info: [{"id": "31e11082-cc50-4fd2-b847-be246d32fcd8", "address": "fa:16:3e:3c:c9:46", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e11082-cc", "ovs_interfaceid": "31e11082-cc50-4fd2-b847-be246d32fcd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:19:29 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-1650dae6-9c2e-4316-9655-12cc6f074d63" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:19:29 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 15:19:29 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:19:29 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:19:30 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:19:31 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:19:31 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 15:19:31 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:19:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:19:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:19:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:19:31 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 15:19:31 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 15:19:31 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:19:31 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:19:31 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=8700MB free_disk=25.11164093017578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 15:19:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:19:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:19:32 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 1650dae6-9c2e-4316-9655-12cc6f074d63 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:19:32 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 15:19:32 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 15:19:32 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:19:32 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:19:32 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 15:19:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.286s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:19:33 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:19:34 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:19:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:19:38 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:19:40 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:19:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:19:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:19:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:19:49 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:19:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:19:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:19:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:19:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:19:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:19:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:19:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.imagecache [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Verify base images {{(pid=72239) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Jul 31 15:19:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.imagecache [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=72239) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Jul 31 15:19:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.imagecache [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] 1650dae6-9c2e-4316-9655-12cc6f074d63 is a valid instance name {{(pid=72239) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Jul 31 15:19:49 user nova-compute[72239]: WARNING nova.virt.libvirt.imagecache [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Unknown base file: /opt/stack/data/nova/instances/_base/5825a553da02692306cdc0be0b5942c2e71a880a
Jul 31 15:19:49 user nova-compute[72239]: WARNING nova.virt.libvirt.imagecache [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Unknown base file: /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444
Jul 31 15:19:49 user nova-compute[72239]: WARNING nova.virt.libvirt.imagecache [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Unknown base file: /opt/stack/data/nova/instances/_base/201ece8ced2ef3abbd210bc15f164f5740216de2
Jul 31 15:19:49 user nova-compute[72239]: WARNING nova.virt.libvirt.imagecache [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Unknown base file: /opt/stack/data/nova/instances/_base/0eb4f05eba9a32015c8b83592d2056a96eb7efc9
Jul 31 15:19:49 user nova-compute[72239]: WARNING nova.virt.libvirt.imagecache [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Unknown base file: /opt/stack/data/nova/instances/_base/12a7fe223e94ffb9a0fc2001e028ce7fbbedaf17
Jul 31 15:19:49 user nova-compute[72239]: WARNING nova.virt.libvirt.imagecache [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Unknown base file: /opt/stack/data/nova/instances/_base/842371a914522ee9a661144c2954b133f77f0d90
Jul 31 15:19:49 user nova-compute[72239]: WARNING nova.virt.libvirt.imagecache [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Unknown base file: /opt/stack/data/nova/instances/_base/d6df4aa3e5816c8dc08db76d08729105b0faeaeb
Jul 31 15:19:49 user nova-compute[72239]: WARNING nova.virt.libvirt.imagecache [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Unknown base file: /opt/stack/data/nova/instances/_base/9f8219f7ef5421815b464a92913a25001d5aafea
Jul 31 15:19:49 user nova-compute[72239]: WARNING nova.virt.libvirt.imagecache [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Unknown base file: /opt/stack/data/nova/instances/_base/922ad16347e90ac9c087c8b5980cdced0efb6fd0
Jul 31 15:19:49 user nova-compute[72239]: WARNING nova.virt.libvirt.imagecache [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Unknown base file: /opt/stack/data/nova/instances/_base/f26436c38aacbc546fb6769bbd72e00b6b88a499
Jul 31 15:19:49 user nova-compute[72239]: INFO nova.virt.libvirt.imagecache [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Removable base files: /opt/stack/data/nova/instances/_base/5825a553da02692306cdc0be0b5942c2e71a880a /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 /opt/stack/data/nova/instances/_base/201ece8ced2ef3abbd210bc15f164f5740216de2 /opt/stack/data/nova/instances/_base/0eb4f05eba9a32015c8b83592d2056a96eb7efc9 /opt/stack/data/nova/instances/_base/12a7fe223e94ffb9a0fc2001e028ce7fbbedaf17 /opt/stack/data/nova/instances/_base/842371a914522ee9a661144c2954b133f77f0d90 /opt/stack/data/nova/instances/_base/d6df4aa3e5816c8dc08db76d08729105b0faeaeb /opt/stack/data/nova/instances/_base/9f8219f7ef5421815b464a92913a25001d5aafea /opt/stack/data/nova/instances/_base/922ad16347e90ac9c087c8b5980cdced0efb6fd0 /opt/stack/data/nova/instances/_base/f26436c38aacbc546fb6769bbd72e00b6b88a499
Jul 31 15:19:49 user nova-compute[72239]: INFO nova.virt.libvirt.imagecache [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5825a553da02692306cdc0be0b5942c2e71a880a
Jul 31 15:19:49 user nova-compute[72239]: INFO nova.virt.libvirt.imagecache [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444
Jul 31 15:19:49 user nova-compute[72239]: INFO nova.virt.libvirt.imagecache [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/201ece8ced2ef3abbd210bc15f164f5740216de2
Jul 31 15:19:49 user nova-compute[72239]: INFO nova.virt.libvirt.imagecache [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0eb4f05eba9a32015c8b83592d2056a96eb7efc9
Jul 31 15:19:49 user nova-compute[72239]: INFO nova.virt.libvirt.imagecache [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/12a7fe223e94ffb9a0fc2001e028ce7fbbedaf17
Jul 31 15:19:49 user nova-compute[72239]: INFO nova.virt.libvirt.imagecache [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/842371a914522ee9a661144c2954b133f77f0d90
Jul 31 15:19:49 user nova-compute[72239]: INFO nova.virt.libvirt.imagecache [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/d6df4aa3e5816c8dc08db76d08729105b0faeaeb
Jul 31 15:19:49 user nova-compute[72239]: INFO nova.virt.libvirt.imagecache [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9f8219f7ef5421815b464a92913a25001d5aafea
Jul 31 15:19:49 user nova-compute[72239]: INFO nova.virt.libvirt.imagecache [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/922ad16347e90ac9c087c8b5980cdced0efb6fd0
Jul 31 15:19:49 user nova-compute[72239]: INFO nova.virt.libvirt.imagecache [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f26436c38aacbc546fb6769bbd72e00b6b88a499
Jul 31 15:19:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.imagecache [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Verification complete {{(pid=72239) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Jul 31 15:19:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.imagecache [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Verify swap images {{(pid=72239) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Jul 31 15:19:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.imagecache [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Verify ephemeral images {{(pid=72239) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Jul 31 15:19:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:19:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:19:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:19:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:19:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:19:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:19:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:20:03 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:20:04 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:20:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:20:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:20:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:20:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:20:18 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:20:23 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:20:23 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:20:24 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:20:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:20:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:20:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:20:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:20:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:20:28 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:20:28 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:20:28 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:20:29 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:20:29 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 15:20:29 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Rebuilding the list of instances to heal {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 15:20:29 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-1650dae6-9c2e-4316-9655-12cc6f074d63" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:20:29 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-1650dae6-9c2e-4316-9655-12cc6f074d63" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:20:29 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 15:20:29 user nova-compute[72239]: DEBUG nova.objects.instance [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lazy-loading 'info_cache' on Instance uuid 1650dae6-9c2e-4316-9655-12cc6f074d63 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:20:29 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Updating instance_info_cache with network_info: [{"id": "31e11082-cc50-4fd2-b847-be246d32fcd8", "address": "fa:16:3e:3c:c9:46", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e11082-cc", "ovs_interfaceid": "31e11082-cc50-4fd2-b847-be246d32fcd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:20:29 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-1650dae6-9c2e-4316-9655-12cc6f074d63" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:20:29 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 15:20:29 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:20:29 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:20:31 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:20:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:20:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:20:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:20:31 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 15:20:31 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 15:20:31 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:20:31 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:20:31 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=8820MB free_disk=25.150341033935547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 15:20:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:20:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:20:32 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 1650dae6-9c2e-4316-9655-12cc6f074d63 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:20:32 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 15:20:32 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 15:20:32 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Refreshing inventories for resource provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 15:20:32 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Updating ProviderTree inventory for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 15:20:32 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Updating inventory in ProviderTree for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 15:20:32 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Refreshing aggregate associations for resource provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e, aggregates: None {{(pid=72239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 15:20:32 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Refreshing trait associations for resource provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI {{(pid=72239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 15:20:32 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:20:32 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:20:32 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 15:20:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.520s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:20:32 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:20:32 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Cleaning up deleted instances {{(pid=72239) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 15:20:32 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] There are 0 instances to clean {{(pid=72239) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 15:20:33 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:20:33 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:20:33 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:20:33 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 15:20:38 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:20:38 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:20:38 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:20:38 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:20:38 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:20:38 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:20:43 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:20:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:20:52 user nova-compute[72239]: DEBUG nova.compute.manager [req-a77110c8-baf5-4679-80ae-8d64f9aff6b6 req-21440c37-c2c2-4868-a066-6d09b25a0010 service nova] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Received event network-changed-31e11082-cc50-4fd2-b847-be246d32fcd8 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:20:52 user nova-compute[72239]: DEBUG nova.compute.manager [req-a77110c8-baf5-4679-80ae-8d64f9aff6b6 req-21440c37-c2c2-4868-a066-6d09b25a0010 service nova] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Refreshing instance network info cache due to event network-changed-31e11082-cc50-4fd2-b847-be246d32fcd8. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:20:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a77110c8-baf5-4679-80ae-8d64f9aff6b6 req-21440c37-c2c2-4868-a066-6d09b25a0010 service nova] Acquiring lock "refresh_cache-1650dae6-9c2e-4316-9655-12cc6f074d63" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:20:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a77110c8-baf5-4679-80ae-8d64f9aff6b6 req-21440c37-c2c2-4868-a066-6d09b25a0010 service nova] Acquired lock "refresh_cache-1650dae6-9c2e-4316-9655-12cc6f074d63" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:20:52 user nova-compute[72239]: DEBUG nova.network.neutron [req-a77110c8-baf5-4679-80ae-8d64f9aff6b6 req-21440c37-c2c2-4868-a066-6d09b25a0010 service nova] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Refreshing network info cache for port 31e11082-cc50-4fd2-b847-be246d32fcd8 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:20:52 user nova-compute[72239]: DEBUG nova.network.neutron [req-a77110c8-baf5-4679-80ae-8d64f9aff6b6 req-21440c37-c2c2-4868-a066-6d09b25a0010 service nova] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Updated VIF entry in instance network info cache for port 31e11082-cc50-4fd2-b847-be246d32fcd8. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:20:52 user nova-compute[72239]: DEBUG nova.network.neutron [req-a77110c8-baf5-4679-80ae-8d64f9aff6b6 req-21440c37-c2c2-4868-a066-6d09b25a0010 service nova] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Updating instance_info_cache with network_info: [{"id": "31e11082-cc50-4fd2-b847-be246d32fcd8", "address": "fa:16:3e:3c:c9:46", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e11082-cc", "ovs_interfaceid": "31e11082-cc50-4fd2-b847-be246d32fcd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:20:52 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a77110c8-baf5-4679-80ae-8d64f9aff6b6 req-21440c37-c2c2-4868-a066-6d09b25a0010 service nova] Releasing lock "refresh_cache-1650dae6-9c2e-4316-9655-12cc6f074d63" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:20:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:20:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:20:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:20:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:20:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:20:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:20:53 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:20:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:20:55 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:20:55 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Cleaning up deleted instances with incomplete migration  {{(pid=72239) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 15:20:58 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:20:59 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._sync_power_states {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:20:59 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Triggering sync for uuid 1650dae6-9c2e-4316-9655-12cc6f074d63 {{(pid=72239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 15:20:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "1650dae6-9c2e-4316-9655-12cc6f074d63" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:20:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "1650dae6-9c2e-4316-9655-12cc6f074d63" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:20:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "1650dae6-9c2e-4316-9655-12cc6f074d63" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:21:00 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:21:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "7d142ab3-beda-4611-8924-5c2803a7a48b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:21:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "7d142ab3-beda-4611-8924-5c2803a7a48b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:21:02 user nova-compute[72239]: DEBUG nova.compute.manager [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 15:21:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:21:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:21:02 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 15:21:02 user nova-compute[72239]: INFO nova.compute.claims [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Claim successful on node user
Jul 31 15:21:02 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:21:02 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:21:02 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.205s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:21:02 user nova-compute[72239]: DEBUG nova.compute.manager [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 15:21:02 user nova-compute[72239]: DEBUG nova.compute.manager [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 15:21:02 user nova-compute[72239]: DEBUG nova.network.neutron [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 15:21:02 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 15:21:02 user nova-compute[72239]: DEBUG nova.compute.manager [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 15:21:02 user nova-compute[72239]: INFO nova.virt.block_device [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Booting with volume a37a9a27-05c1-4378-81f1-eeac1e32d0c2 at /dev/vda
Jul 31 15:21:02 user nova-compute[72239]: DEBUG nova.policy [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a73969a32be54c8caf621290e8823134', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35aaefdc03aa4e43b4ba435eea373cc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 15:21:02 user nova-compute[72239]: DEBUG os_brick.utils [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:21:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:21:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:21:02 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[337ac3bb-b310-47d9-b427-d643a300281c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:21:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:21:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:21:02 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0635c14-b455-4811-9954-2bd46ceafd73]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:21:02 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:21:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:21:03 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b06641-0023-4c4e-b6e2-ba37bb8d84e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:21:03 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9829b7ca-97aa-4f63-9993-72aa518223bc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:21:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:21:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:21:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 15:21:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:21:03 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:21:03 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 15:21:03 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5ab1d3-14a6-4567-bc0e-9ef771f8c2df]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:21:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 15:21:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 15:21:03 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 15:21:03 user nova-compute[72239]: DEBUG os_brick.utils [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:21:03 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Updating existing volume attachment record: ff1b9afc-b8de-4507-8ec9-1870472d55cb {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 15:21:03 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:21:03 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:21:03 user nova-compute[72239]: DEBUG nova.network.neutron [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Successfully created port: ebd3a6dd-7565-4c09-b693-68d8d95343de {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 15:21:04 user nova-compute[72239]: DEBUG nova.network.neutron [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Successfully updated port: ebd3a6dd-7565-4c09-b693-68d8d95343de {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 15:21:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "refresh_cache-7d142ab3-beda-4611-8924-5c2803a7a48b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:21:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquired lock "refresh_cache-7d142ab3-beda-4611-8924-5c2803a7a48b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:21:04 user nova-compute[72239]: DEBUG nova.network.neutron [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 15:21:04 user nova-compute[72239]: DEBUG nova.network.neutron [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 15:21:04 user nova-compute[72239]: DEBUG nova.compute.manager [req-e23b6606-07c0-45ec-816a-c8b4f0add2ba req-c5a87ddd-3698-4342-baf2-841b9783f66f service nova] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Received event network-changed-ebd3a6dd-7565-4c09-b693-68d8d95343de {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:21:04 user nova-compute[72239]: DEBUG nova.compute.manager [req-e23b6606-07c0-45ec-816a-c8b4f0add2ba req-c5a87ddd-3698-4342-baf2-841b9783f66f service nova] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Refreshing instance network info cache due to event network-changed-ebd3a6dd-7565-4c09-b693-68d8d95343de. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:21:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e23b6606-07c0-45ec-816a-c8b4f0add2ba req-c5a87ddd-3698-4342-baf2-841b9783f66f service nova] Acquiring lock "refresh_cache-7d142ab3-beda-4611-8924-5c2803a7a48b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:21:04 user nova-compute[72239]: DEBUG nova.network.neutron [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Updating instance_info_cache with network_info: [{"id": "ebd3a6dd-7565-4c09-b693-68d8d95343de", "address": "fa:16:3e:5b:bc:5f", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd3a6dd-75", "ovs_interfaceid": "ebd3a6dd-7565-4c09-b693-68d8d95343de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:21:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Releasing lock "refresh_cache-7d142ab3-beda-4611-8924-5c2803a7a48b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:21:04 user nova-compute[72239]: DEBUG nova.compute.manager [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Instance network_info: |[{"id": "ebd3a6dd-7565-4c09-b693-68d8d95343de", "address": "fa:16:3e:5b:bc:5f", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd3a6dd-75", "ovs_interfaceid": "ebd3a6dd-7565-4c09-b693-68d8d95343de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 15:21:04 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e23b6606-07c0-45ec-816a-c8b4f0add2ba req-c5a87ddd-3698-4342-baf2-841b9783f66f service nova] Acquired lock "refresh_cache-7d142ab3-beda-4611-8924-5c2803a7a48b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:21:04 user nova-compute[72239]: DEBUG nova.network.neutron [req-e23b6606-07c0-45ec-816a-c8b4f0add2ba req-c5a87ddd-3698-4342-baf2-841b9783f66f service nova] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Refreshing network info cache for port ebd3a6dd-7565-4c09-b693-68d8d95343de {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:21:05 user nova-compute[72239]: DEBUG nova.network.neutron [req-e23b6606-07c0-45ec-816a-c8b4f0add2ba req-c5a87ddd-3698-4342-baf2-841b9783f66f service nova] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Updated VIF entry in instance network info cache for port ebd3a6dd-7565-4c09-b693-68d8d95343de. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:21:05 user nova-compute[72239]: DEBUG nova.network.neutron [req-e23b6606-07c0-45ec-816a-c8b4f0add2ba req-c5a87ddd-3698-4342-baf2-841b9783f66f service nova] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Updating instance_info_cache with network_info: [{"id": "ebd3a6dd-7565-4c09-b693-68d8d95343de", "address": "fa:16:3e:5b:bc:5f", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd3a6dd-75", "ovs_interfaceid": "ebd3a6dd-7565-4c09-b693-68d8d95343de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:21:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e23b6606-07c0-45ec-816a-c8b4f0add2ba req-c5a87ddd-3698-4342-baf2-841b9783f66f service nova] Releasing lock "refresh_cache-7d142ab3-beda-4611-8924-5c2803a7a48b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:21:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG nova.compute.manager [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 15:21:10 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Creating image(s)
Jul 31 15:21:10 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Did not create local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Ensure instance console log exists: /opt/stack/data/nova/instances/7d142ab3-beda-4611-8924-5c2803a7a48b/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Start _get_guest_xml network_info=[{"id": "ebd3a6dd-7565-4c09-b693-68d8d95343de", "address": "fa:16:3e:5b:bc:5f", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd3a6dd-75", "ovs_interfaceid": "ebd3a6dd-7565-4c09-b693-68d8d95343de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'attachment_id': 'ff1b9afc-b8de-4507-8ec9-1870472d55cb', 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yVcHMoCv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7d142ab3-beda-4611-8924-5c2803a7a48b', 'attached_at': '', 'detached_at': '', 'volume_id': 'a37a9a27-05c1-4378-81f1-eeac1e32d0c2', 'serial': 'a37a9a27-05c1-4378-81f1-eeac1e32d0c2'}, 'delete_on_termination': False, 'guest_format': None, 'volume_type': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 15:21:10 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:21:10 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:21:10 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yVcHMoCv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:21:10 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:21:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:21:10 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:21:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:21:10 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 15:21:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2 -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2898ab4a-3f0c-41d9-8089-49f8088cbffd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 15:21:10 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2 -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[99879f29-0ae5-447c-a2de-469bc0f8f168]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2] added
Jul 31 15:21:10 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[be52400e-904b-4e7b-a7a4-10e33535e3d2]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08cff0f-ebd3-408e-8609-2ee8b07f27d7]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yVcHMoCv {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yVcHMoCv" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c22382-0279-4ea6-9134-29e1dc6aae41]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yVcHMoCv'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea745f36-9830-4709-a5f0-a53998eae8a9]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8b9123-b10d-4a14-8d56-ea907f3708f2]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc (non-flash)
Jul 31 15:21:10 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc (non-flash)
Jul 31 15:21:10 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2 -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdbabf7-3ac3-4014-880d-8cd2ebc16f13]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2, portal: 172.16.0.220,3260]
Jul 31 15:21:10 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2, portal: 172.16.0.220,3260] successful.
Jul 31 15:21:10 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[129ff5f5-5566-4c77-af4b-5c788d0d1d1a]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9e9ac6-d5ac-44af-a0a4-bf54ecacffb9]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc (non-flash)
Jul 31 15:21:10 user nova-compute[72239]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2 (non-flash)
Jul 31 15:21:10 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc (non-flash)
Jul 31 15:21:10 user nova-compute[72239]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2 (non-flash)
Jul 31 15:21:10 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] HCTL ('34', '-', '-', 0) found on session 62 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a5409a-8fd7-4387-92b8-68efb4f9dc91]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Searching for a device in session 62 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 15:21:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yVcHMoCv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 15:21:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:21:11 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23032623264623065', 'path': '/dev/sdc'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:21:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032623264623065', 'path': '/dev/sdc'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 15:21:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:21:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1322576040',display_name='tempest-TestVolumeBootPattern-server-1322576040',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1322576040',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCY3vLYjwCj2oqQSBolW7c+OcVO1ul/eTZat0QSfOYuU0YxIpJAnnDmoUxQPBXaqflB5z610Pc9fwuWzrnOXKK97zfH7u+iQLjb5dXhWdA4VmffAJRc95WJmSak/jG2I9g==',key_name='tempest-TestVolumeBootPattern-1846536962',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35aaefdc03aa4e43b4ba435eea373cc4',ramdisk_id='',reservation_id='r-xifpb5eg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1903261024',owner_user_name='tempest-TestVolumeBootPattern-1903261024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T15:21:03Z,user_data=None,user_id='a73969a32be54c8caf621290e8823134',uuid=7d142ab3-beda-4611-8924-5c2803a7a48b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebd3a6dd-7565-4c09-b693-68d8d95343de", "address": "fa:16:3e:5b:bc:5f", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd3a6dd-75", "ovs_interfaceid": "ebd3a6dd-7565-4c09-b693-68d8d95343de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 15:21:11 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Converting VIF {"id": "ebd3a6dd-7565-4c09-b693-68d8d95343de", "address": "fa:16:3e:5b:bc:5f", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd3a6dd-75", "ovs_interfaceid": "ebd3a6dd-7565-4c09-b693-68d8d95343de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:21:11 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:bc:5f,bridge_name='br-int',has_traffic_filtering=True,id=ebd3a6dd-7565-4c09-b693-68d8d95343de,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd3a6dd-75') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:21:11 user nova-compute[72239]: DEBUG nova.objects.instance [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d142ab3-beda-4611-8924-5c2803a7a48b {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:21:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] End _get_guest_xml xml=<domain type="kvm">
Jul 31 15:21:11 user nova-compute[72239]:   <uuid>7d142ab3-beda-4611-8924-5c2803a7a48b</uuid>
Jul 31 15:21:11 user nova-compute[72239]:   <name>instance-00000033</name>
Jul 31 15:21:11 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 15:21:11 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 15:21:11 user nova-compute[72239]:   <metadata>
Jul 31 15:21:11 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 15:21:11 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 15:21:11 user nova-compute[72239]:       <nova:name>tempest-TestVolumeBootPattern-server-1322576040</nova:name>
Jul 31 15:21:11 user nova-compute[72239]:       <nova:creationTime>2023-07-31 15:21:10</nova:creationTime>
Jul 31 15:21:11 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 15:21:11 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 15:21:11 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 15:21:11 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 15:21:11 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 15:21:11 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 15:21:11 user nova-compute[72239]:       </nova:flavor>
Jul 31 15:21:11 user nova-compute[72239]:       <nova:owner>
Jul 31 15:21:11 user nova-compute[72239]:         <nova:user uuid="a73969a32be54c8caf621290e8823134">tempest-TestVolumeBootPattern-1903261024-project-member</nova:user>
Jul 31 15:21:11 user nova-compute[72239]:         <nova:project uuid="35aaefdc03aa4e43b4ba435eea373cc4">tempest-TestVolumeBootPattern-1903261024</nova:project>
Jul 31 15:21:11 user nova-compute[72239]:       </nova:owner>
Jul 31 15:21:11 user nova-compute[72239]:       <nova:ports>
Jul 31 15:21:11 user nova-compute[72239]:         <nova:port uuid="ebd3a6dd-7565-4c09-b693-68d8d95343de">
Jul 31 15:21:11 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 31 15:21:11 user nova-compute[72239]:         </nova:port>
Jul 31 15:21:11 user nova-compute[72239]:       </nova:ports>
Jul 31 15:21:11 user nova-compute[72239]:     </nova:instance>
Jul 31 15:21:11 user nova-compute[72239]:   </metadata>
Jul 31 15:21:11 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 15:21:11 user nova-compute[72239]:     <system>
Jul 31 15:21:11 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 15:21:11 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 15:21:11 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 15:21:11 user nova-compute[72239]:       <entry name="serial">7d142ab3-beda-4611-8924-5c2803a7a48b</entry>
Jul 31 15:21:11 user nova-compute[72239]:       <entry name="uuid">7d142ab3-beda-4611-8924-5c2803a7a48b</entry>
Jul 31 15:21:11 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 15:21:11 user nova-compute[72239]:     </system>
Jul 31 15:21:11 user nova-compute[72239]:   </sysinfo>
Jul 31 15:21:11 user nova-compute[72239]:   <os>
Jul 31 15:21:11 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 15:21:11 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 15:21:11 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 15:21:11 user nova-compute[72239]:   </os>
Jul 31 15:21:11 user nova-compute[72239]:   <features>
Jul 31 15:21:11 user nova-compute[72239]:     <acpi/>
Jul 31 15:21:11 user nova-compute[72239]:     <apic/>
Jul 31 15:21:11 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 15:21:11 user nova-compute[72239]:   </features>
Jul 31 15:21:11 user nova-compute[72239]:   <clock offset="utc">
Jul 31 15:21:11 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 15:21:11 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 15:21:11 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 15:21:11 user nova-compute[72239]:   </clock>
Jul 31 15:21:11 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 15:21:11 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 15:21:11 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 15:21:11 user nova-compute[72239]:   </cpu>
Jul 31 15:21:11 user nova-compute[72239]:   <devices>
Jul 31 15:21:11 user nova-compute[72239]:     <disk type="block" device="disk">
Jul 31 15:21:11 user nova-compute[72239]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:21:11 user nova-compute[72239]:       <source dev="/dev/sdc"/>
Jul 31 15:21:11 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 15:21:11 user nova-compute[72239]:       <serial>a37a9a27-05c1-4378-81f1-eeac1e32d0c2</serial>
Jul 31 15:21:11 user nova-compute[72239]:     </disk>
Jul 31 15:21:11 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 15:21:11 user nova-compute[72239]:       <mac address="fa:16:3e:5b:bc:5f"/>
Jul 31 15:21:11 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:21:11 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 15:21:11 user nova-compute[72239]:       <target dev="tapebd3a6dd-75"/>
Jul 31 15:21:11 user nova-compute[72239]:     </interface>
Jul 31 15:21:11 user nova-compute[72239]:     <serial type="pty">
Jul 31 15:21:11 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/7d142ab3-beda-4611-8924-5c2803a7a48b/console.log" append="off"/>
Jul 31 15:21:11 user nova-compute[72239]:     </serial>
Jul 31 15:21:11 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 15:21:11 user nova-compute[72239]:     <video>
Jul 31 15:21:11 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:21:11 user nova-compute[72239]:     </video>
Jul 31 15:21:11 user nova-compute[72239]:     <rng model="virtio">
Jul 31 15:21:11 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 15:21:11 user nova-compute[72239]:     </rng>
Jul 31 15:21:11 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 15:21:11 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 15:21:11 user nova-compute[72239]:       <stats period="10"/>
Jul 31 15:21:11 user nova-compute[72239]:     </memballoon>
Jul 31 15:21:11 user nova-compute[72239]:   </devices>
Jul 31 15:21:11 user nova-compute[72239]: </domain>
Jul 31 15:21:11 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 15:21:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:21:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1322576040',display_name='tempest-TestVolumeBootPattern-server-1322576040',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1322576040',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCY3vLYjwCj2oqQSBolW7c+OcVO1ul/eTZat0QSfOYuU0YxIpJAnnDmoUxQPBXaqflB5z610Pc9fwuWzrnOXKK97zfH7u+iQLjb5dXhWdA4VmffAJRc95WJmSak/jG2I9g==',key_name='tempest-TestVolumeBootPattern-1846536962',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35aaefdc03aa4e43b4ba435eea373cc4',ramdisk_id='',reservation_id='r-xifpb5eg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1903261024',owner_user_name='tempest-TestVolumeBootPattern-1903261024-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T15:21:03Z,user_data=None,user_id='a73969a32be54c8caf621290e8823134',uuid=7d142ab3-beda-4611-8924-5c2803a7a48b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebd3a6dd-7565-4c09-b693-68d8d95343de", "address": "fa:16:3e:5b:bc:5f", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd3a6dd-75", "ovs_interfaceid": "ebd3a6dd-7565-4c09-b693-68d8d95343de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 15:21:11 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Converting VIF {"id": "ebd3a6dd-7565-4c09-b693-68d8d95343de", "address": "fa:16:3e:5b:bc:5f", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd3a6dd-75", "ovs_interfaceid": "ebd3a6dd-7565-4c09-b693-68d8d95343de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:21:11 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:bc:5f,bridge_name='br-int',has_traffic_filtering=True,id=ebd3a6dd-7565-4c09-b693-68d8d95343de,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd3a6dd-75') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:21:11 user nova-compute[72239]: DEBUG os_vif [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:bc:5f,bridge_name='br-int',has_traffic_filtering=True,id=ebd3a6dd-7565-4c09-b693-68d8d95343de,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd3a6dd-75') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 15:21:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:21:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:21:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 15:21:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:21:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebd3a6dd-75, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:21:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapebd3a6dd-75, col_values=(('external_ids', {'iface-id': 'ebd3a6dd-7565-4c09-b693-68d8d95343de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:bc:5f', 'vm-uuid': '7d142ab3-beda-4611-8924-5c2803a7a48b'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:21:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:21:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:21:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:21:11 user nova-compute[72239]: INFO os_vif [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:bc:5f,bridge_name='br-int',has_traffic_filtering=True,id=ebd3a6dd-7565-4c09-b693-68d8d95343de,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd3a6dd-75')
Jul 31 15:21:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:21:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] No VIF found with MAC fa:16:3e:5b:bc:5f, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 15:21:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:21:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:21:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:21:13 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:21:13 user nova-compute[72239]: DEBUG nova.compute.manager [req-a479778f-4ffa-47ac-9196-78c239ac8db8 req-5272e454-93e5-42dd-b84a-dc97e199967e service nova] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Received event network-vif-plugged-ebd3a6dd-7565-4c09-b693-68d8d95343de {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:21:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a479778f-4ffa-47ac-9196-78c239ac8db8 req-5272e454-93e5-42dd-b84a-dc97e199967e service nova] Acquiring lock "7d142ab3-beda-4611-8924-5c2803a7a48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:21:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a479778f-4ffa-47ac-9196-78c239ac8db8 req-5272e454-93e5-42dd-b84a-dc97e199967e service nova] Lock "7d142ab3-beda-4611-8924-5c2803a7a48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:21:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-a479778f-4ffa-47ac-9196-78c239ac8db8 req-5272e454-93e5-42dd-b84a-dc97e199967e service nova] Lock "7d142ab3-beda-4611-8924-5c2803a7a48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:21:13 user nova-compute[72239]: DEBUG nova.compute.manager [req-a479778f-4ffa-47ac-9196-78c239ac8db8 req-5272e454-93e5-42dd-b84a-dc97e199967e service nova] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] No waiting events found dispatching network-vif-plugged-ebd3a6dd-7565-4c09-b693-68d8d95343de {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:21:13 user nova-compute[72239]: WARNING nova.compute.manager [req-a479778f-4ffa-47ac-9196-78c239ac8db8 req-5272e454-93e5-42dd-b84a-dc97e199967e service nova] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Received unexpected event network-vif-plugged-ebd3a6dd-7565-4c09-b693-68d8d95343de for instance with vm_state building and task_state spawning.
Jul 31 15:21:14 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690816874.9241593, 7d142ab3-beda-4611-8924-5c2803a7a48b => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:21:14 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] VM Resumed (Lifecycle Event)
Jul 31 15:21:14 user nova-compute[72239]: DEBUG nova.compute.manager [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 15:21:14 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 15:21:14 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Instance spawned successfully.
Jul 31 15:21:14 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 15:21:14 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:21:14 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:21:14 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:21:14 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:21:14 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:21:14 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:21:14 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:21:14 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:21:14 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 15:21:14 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690816874.9258683, 7d142ab3-beda-4611-8924-5c2803a7a48b => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:21:14 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] VM Started (Lifecycle Event)
Jul 31 15:21:14 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:21:15 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:21:15 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 15:21:15 user nova-compute[72239]: INFO nova.compute.manager [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Took 4.96 seconds to spawn the instance on the hypervisor.
Jul 31 15:21:15 user nova-compute[72239]: DEBUG nova.compute.manager [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:21:15 user nova-compute[72239]: INFO nova.compute.manager [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Took 12.62 seconds to build instance.
Jul 31 15:21:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9248a935-67f6-4b7c-86da-bb5c303eeeb8 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "7d142ab3-beda-4611-8924-5c2803a7a48b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.743s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:21:15 user nova-compute[72239]: DEBUG nova.compute.manager [req-476bd07d-b64f-4e7d-97ec-227a100e09f8 req-6c73f1ab-6951-4efa-b220-3ade4febbf13 service nova] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Received event network-vif-plugged-ebd3a6dd-7565-4c09-b693-68d8d95343de {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:21:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-476bd07d-b64f-4e7d-97ec-227a100e09f8 req-6c73f1ab-6951-4efa-b220-3ade4febbf13 service nova] Acquiring lock "7d142ab3-beda-4611-8924-5c2803a7a48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:21:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-476bd07d-b64f-4e7d-97ec-227a100e09f8 req-6c73f1ab-6951-4efa-b220-3ade4febbf13 service nova] Lock "7d142ab3-beda-4611-8924-5c2803a7a48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:21:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-476bd07d-b64f-4e7d-97ec-227a100e09f8 req-6c73f1ab-6951-4efa-b220-3ade4febbf13 service nova] Lock "7d142ab3-beda-4611-8924-5c2803a7a48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:21:15 user nova-compute[72239]: DEBUG nova.compute.manager [req-476bd07d-b64f-4e7d-97ec-227a100e09f8 req-6c73f1ab-6951-4efa-b220-3ade4febbf13 service nova] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] No waiting events found dispatching network-vif-plugged-ebd3a6dd-7565-4c09-b693-68d8d95343de {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:21:15 user nova-compute[72239]: WARNING nova.compute.manager [req-476bd07d-b64f-4e7d-97ec-227a100e09f8 req-6c73f1ab-6951-4efa-b220-3ade4febbf13 service nova] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Received unexpected event network-vif-plugged-ebd3a6dd-7565-4c09-b693-68d8d95343de for instance with vm_state active and task_state None.
Jul 31 15:21:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:21:16 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:21:21 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:21:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:21:25 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:21:26 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:21:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:21:29 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:21:29 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:21:29 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 15:21:29 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Rebuilding the list of instances to heal {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 15:21:29 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-1650dae6-9c2e-4316-9655-12cc6f074d63" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:21:29 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-1650dae6-9c2e-4316-9655-12cc6f074d63" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:21:29 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 15:21:29 user nova-compute[72239]: DEBUG nova.objects.instance [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lazy-loading 'info_cache' on Instance uuid 1650dae6-9c2e-4316-9655-12cc6f074d63 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:21:29 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Updating instance_info_cache with network_info: [{"id": "31e11082-cc50-4fd2-b847-be246d32fcd8", "address": "fa:16:3e:3c:c9:46", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e11082-cc", "ovs_interfaceid": "31e11082-cc50-4fd2-b847-be246d32fcd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:21:29 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-1650dae6-9c2e-4316-9655-12cc6f074d63" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:21:29 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 15:21:29 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:21:30 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:21:30 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:21:31 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:21:32 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:21:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:21:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:21:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:21:32 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 15:21:32 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 15:21:32 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 15:21:32 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:21:32 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:21:32 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=8632MB free_disk=25.148448944091797GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 15:21:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:21:32 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:21:32 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 1650dae6-9c2e-4316-9655-12cc6f074d63 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:21:32 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 7d142ab3-beda-4611-8924-5c2803a7a48b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:21:32 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 15:21:32 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 15:21:33 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:21:33 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:21:33 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 15:21:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.200s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:21:34 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:21:34 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 15:21:34 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:21:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:21:36 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:21:40 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:21:41 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:21:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:21:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:21:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:21:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:22:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:22:06 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:22:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:22:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:22:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:22:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:22:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:22:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:22:16 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:22:21 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:22:25 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:22:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:22:28 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:22:29 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:22:29 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:22:30 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:22:30 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:22:30 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 15:22:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-7d142ab3-beda-4611-8924-5c2803a7a48b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:22:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-7d142ab3-beda-4611-8924-5c2803a7a48b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:22:30 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 15:22:31 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Updating instance_info_cache with network_info: [{"id": "ebd3a6dd-7565-4c09-b693-68d8d95343de", "address": "fa:16:3e:5b:bc:5f", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd3a6dd-75", "ovs_interfaceid": "ebd3a6dd-7565-4c09-b693-68d8d95343de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:22:31 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-7d142ab3-beda-4611-8924-5c2803a7a48b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:22:31 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 15:22:31 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:22:31 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:22:31 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:22:31 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:22:31 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:22:31 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:22:31 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:22:34 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:22:34 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:22:34 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:22:34 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:22:34 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:22:34 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 15:22:34 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 15:22:34 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 15:22:34 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:22:34 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:22:34 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=8725MB free_disk=25.147823333740234GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 15:22:34 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:22:34 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:22:34 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 1650dae6-9c2e-4316-9655-12cc6f074d63 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:22:34 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 7d142ab3-beda-4611-8924-5c2803a7a48b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:22:34 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 15:22:34 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 15:22:35 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:22:35 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:22:35 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 15:22:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:22:36 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:22:36 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 15:22:36 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:22:41 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:22:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:22:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:22:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:22:54 user nova-compute[72239]: DEBUG nova.compute.manager [req-28a995ea-0e4a-4a68-b66b-62578111f40d req-12b0c110-54a1-4aeb-b294-6be8f04112d0 service nova] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Received event network-changed-ebd3a6dd-7565-4c09-b693-68d8d95343de {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:22:54 user nova-compute[72239]: DEBUG nova.compute.manager [req-28a995ea-0e4a-4a68-b66b-62578111f40d req-12b0c110-54a1-4aeb-b294-6be8f04112d0 service nova] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Refreshing instance network info cache due to event network-changed-ebd3a6dd-7565-4c09-b693-68d8d95343de. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:22:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-28a995ea-0e4a-4a68-b66b-62578111f40d req-12b0c110-54a1-4aeb-b294-6be8f04112d0 service nova] Acquiring lock "refresh_cache-7d142ab3-beda-4611-8924-5c2803a7a48b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:22:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-28a995ea-0e4a-4a68-b66b-62578111f40d req-12b0c110-54a1-4aeb-b294-6be8f04112d0 service nova] Acquired lock "refresh_cache-7d142ab3-beda-4611-8924-5c2803a7a48b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:22:54 user nova-compute[72239]: DEBUG nova.network.neutron [req-28a995ea-0e4a-4a68-b66b-62578111f40d req-12b0c110-54a1-4aeb-b294-6be8f04112d0 service nova] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Refreshing network info cache for port ebd3a6dd-7565-4c09-b693-68d8d95343de {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:22:55 user nova-compute[72239]: DEBUG nova.network.neutron [req-28a995ea-0e4a-4a68-b66b-62578111f40d req-12b0c110-54a1-4aeb-b294-6be8f04112d0 service nova] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Updated VIF entry in instance network info cache for port ebd3a6dd-7565-4c09-b693-68d8d95343de. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:22:55 user nova-compute[72239]: DEBUG nova.network.neutron [req-28a995ea-0e4a-4a68-b66b-62578111f40d req-12b0c110-54a1-4aeb-b294-6be8f04112d0 service nova] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Updating instance_info_cache with network_info: [{"id": "ebd3a6dd-7565-4c09-b693-68d8d95343de", "address": "fa:16:3e:5b:bc:5f", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd3a6dd-75", "ovs_interfaceid": "ebd3a6dd-7565-4c09-b693-68d8d95343de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:22:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-28a995ea-0e4a-4a68-b66b-62578111f40d req-12b0c110-54a1-4aeb-b294-6be8f04112d0 service nova] Releasing lock "refresh_cache-7d142ab3-beda-4611-8924-5c2803a7a48b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:22:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:22:55 user nova-compute[72239]: DEBUG nova.compute.manager [req-be86374d-a1b6-4d6d-b056-d7f336ef67d7 req-c7db602d-e827-442f-bd04-38a12c294b63 service nova] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Received event network-changed-ebd3a6dd-7565-4c09-b693-68d8d95343de {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:22:55 user nova-compute[72239]: DEBUG nova.compute.manager [req-be86374d-a1b6-4d6d-b056-d7f336ef67d7 req-c7db602d-e827-442f-bd04-38a12c294b63 service nova] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Refreshing instance network info cache due to event network-changed-ebd3a6dd-7565-4c09-b693-68d8d95343de. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:22:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-be86374d-a1b6-4d6d-b056-d7f336ef67d7 req-c7db602d-e827-442f-bd04-38a12c294b63 service nova] Acquiring lock "refresh_cache-7d142ab3-beda-4611-8924-5c2803a7a48b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:22:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-be86374d-a1b6-4d6d-b056-d7f336ef67d7 req-c7db602d-e827-442f-bd04-38a12c294b63 service nova] Acquired lock "refresh_cache-7d142ab3-beda-4611-8924-5c2803a7a48b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:22:55 user nova-compute[72239]: DEBUG nova.network.neutron [req-be86374d-a1b6-4d6d-b056-d7f336ef67d7 req-c7db602d-e827-442f-bd04-38a12c294b63 service nova] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Refreshing network info cache for port ebd3a6dd-7565-4c09-b693-68d8d95343de {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:22:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "7d142ab3-beda-4611-8924-5c2803a7a48b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:22:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "7d142ab3-beda-4611-8924-5c2803a7a48b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:22:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "7d142ab3-beda-4611-8924-5c2803a7a48b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:22:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "7d142ab3-beda-4611-8924-5c2803a7a48b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:22:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "7d142ab3-beda-4611-8924-5c2803a7a48b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:22:55 user nova-compute[72239]: INFO nova.compute.manager [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Terminating instance
Jul 31 15:22:55 user nova-compute[72239]: DEBUG nova.compute.manager [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 15:22:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:22:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG nova.network.neutron [req-be86374d-a1b6-4d6d-b056-d7f336ef67d7 req-c7db602d-e827-442f-bd04-38a12c294b63 service nova] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Updated VIF entry in instance network info cache for port ebd3a6dd-7565-4c09-b693-68d8d95343de. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG nova.network.neutron [req-be86374d-a1b6-4d6d-b056-d7f336ef67d7 req-c7db602d-e827-442f-bd04-38a12c294b63 service nova] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Updating instance_info_cache with network_info: [{"id": "ebd3a6dd-7565-4c09-b693-68d8d95343de", "address": "fa:16:3e:5b:bc:5f", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd3a6dd-75", "ovs_interfaceid": "ebd3a6dd-7565-4c09-b693-68d8d95343de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-be86374d-a1b6-4d6d-b056-d7f336ef67d7 req-c7db602d-e827-442f-bd04-38a12c294b63 service nova] Releasing lock "refresh_cache-7d142ab3-beda-4611-8924-5c2803a7a48b" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:22:56 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Instance destroyed successfully.
Jul 31 15:22:56 user nova-compute[72239]: DEBUG nova.objects.instance [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lazy-loading 'resources' on Instance uuid 7d142ab3-beda-4611-8924-5c2803a7a48b {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:21:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1322576040',display_name='tempest-TestVolumeBootPattern-server-1322576040',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1322576040',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCY3vLYjwCj2oqQSBolW7c+OcVO1ul/eTZat0QSfOYuU0YxIpJAnnDmoUxQPBXaqflB5z610Pc9fwuWzrnOXKK97zfH7u+iQLjb5dXhWdA4VmffAJRc95WJmSak/jG2I9g==',key_name='tempest-TestVolumeBootPattern-1846536962',keypairs=<?>,launch_index=0,launched_at=2023-07-31T15:21:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='35aaefdc03aa4e43b4ba435eea373cc4',ramdisk_id='',reservation_id='r-xifpb5eg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1903261024',owner_user_name='tempest-TestVolumeBootPattern-1903261024-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T15:21:15Z,user_data=None,user_id='a73969a32be54c8caf621290e8823134',uuid=7d142ab3-beda-4611-8924-5c2803a7a48b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebd3a6dd-7565-4c09-b693-68d8d95343de", "address": "fa:16:3e:5b:bc:5f", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd3a6dd-75", "ovs_interfaceid": "ebd3a6dd-7565-4c09-b693-68d8d95343de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Converting VIF {"id": "ebd3a6dd-7565-4c09-b693-68d8d95343de", "address": "fa:16:3e:5b:bc:5f", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebd3a6dd-75", "ovs_interfaceid": "ebd3a6dd-7565-4c09-b693-68d8d95343de", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:bc:5f,bridge_name='br-int',has_traffic_filtering=True,id=ebd3a6dd-7565-4c09-b693-68d8d95343de,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd3a6dd-75') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG os_vif [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:bc:5f,bridge_name='br-int',has_traffic_filtering=True,id=ebd3a6dd-7565-4c09-b693-68d8d95343de,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd3a6dd-75') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebd3a6dd-75, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:22:56 user nova-compute[72239]: INFO os_vif [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:bc:5f,bridge_name='br-int',has_traffic_filtering=True,id=ebd3a6dd-7565-4c09-b693-68d8d95343de,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebd3a6dd-75')
Jul 31 15:22:56 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yVcHMoCv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:22:56 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:22:56 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4bd50d-5868-43b0-abb1-3c2cd074a960]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f9be36-4960-4234-b4a0-fedfc3c57eb2]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc (non-flash)\ntcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc (non-flash)
Jul 31 15:22:56 user nova-compute[72239]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2 (non-flash)
Jul 31 15:22:56 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc (non-flash)
Jul 31 15:22:56 user nova-compute[72239]: tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2 (non-flash)
Jul 31 15:22:56 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41214b1fc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2'): ({'sdc'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Removing single pathed devices sdc {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0abba7f-4b40-48af-a9c9-3f8d7f2d97c2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7b0d0d-7406-4d64-a8e0-59af3145bd20]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Flushing IO for device /dev/sdc {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead4b1cd-13be-4f47-8e20-53972a7f6644]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.079s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[86514fcc-bb89-463b-bee8-8f4432e0abc6]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] SCSI volumes sdc have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3bfe968-3662-4964-a67e-9a7067ff5a17]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2 -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4eb591-31ce-434d-b79d-27c04efa96e8]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2, portal: 172.16.0.220,3260]
Jul 31 15:22:56 user nova-compute[72239]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2, portal: 172.16.0.220,3260] successful.
Jul 31 15:22:56 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2 -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a37a9a27-05c1-4378-81f1-eeac1e32d0c2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e1fb4e-f62f-4295-8fdd-2d7046648d7a]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] <== disconnect_volume: return (325ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:22:56 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 15:22:56 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Deleting instance files /opt/stack/data/nova/instances/7d142ab3-beda-4611-8924-5c2803a7a48b_del
Jul 31 15:22:56 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Deletion of /opt/stack/data/nova/instances/7d142ab3-beda-4611-8924-5c2803a7a48b_del complete
Jul 31 15:22:57 user nova-compute[72239]: INFO nova.compute.manager [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Took 1.25 seconds to destroy the instance on the hypervisor.
Jul 31 15:22:57 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 15:22:57 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 15:22:57 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 15:22:57 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:22:57 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Took 0.58 seconds to deallocate network for instance.
Jul 31 15:22:57 user nova-compute[72239]: DEBUG nova.compute.manager [req-f36d3c5d-429e-4347-888d-97eebea0d71f req-763e794c-bd24-474f-8926-358a7eca9baf service nova] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Received event network-vif-deleted-ebd3a6dd-7565-4c09-b693-68d8d95343de {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:22:57 user nova-compute[72239]: DEBUG nova.compute.manager [req-acd31f9c-9d81-4553-93a1-e25889f751ce req-08f826b0-c474-4fba-9fdd-798e22669b6a service nova] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Received event network-vif-unplugged-ebd3a6dd-7565-4c09-b693-68d8d95343de {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:22:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-acd31f9c-9d81-4553-93a1-e25889f751ce req-08f826b0-c474-4fba-9fdd-798e22669b6a service nova] Acquiring lock "7d142ab3-beda-4611-8924-5c2803a7a48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:22:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-acd31f9c-9d81-4553-93a1-e25889f751ce req-08f826b0-c474-4fba-9fdd-798e22669b6a service nova] Lock "7d142ab3-beda-4611-8924-5c2803a7a48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:22:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-acd31f9c-9d81-4553-93a1-e25889f751ce req-08f826b0-c474-4fba-9fdd-798e22669b6a service nova] Lock "7d142ab3-beda-4611-8924-5c2803a7a48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:22:57 user nova-compute[72239]: DEBUG nova.compute.manager [req-acd31f9c-9d81-4553-93a1-e25889f751ce req-08f826b0-c474-4fba-9fdd-798e22669b6a service nova] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] No waiting events found dispatching network-vif-unplugged-ebd3a6dd-7565-4c09-b693-68d8d95343de {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:22:57 user nova-compute[72239]: DEBUG nova.compute.manager [req-acd31f9c-9d81-4553-93a1-e25889f751ce req-08f826b0-c474-4fba-9fdd-798e22669b6a service nova] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Received event network-vif-unplugged-ebd3a6dd-7565-4c09-b693-68d8d95343de for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 15:22:57 user nova-compute[72239]: DEBUG nova.compute.manager [req-acd31f9c-9d81-4553-93a1-e25889f751ce req-08f826b0-c474-4fba-9fdd-798e22669b6a service nova] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Received event network-vif-plugged-ebd3a6dd-7565-4c09-b693-68d8d95343de {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:22:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-acd31f9c-9d81-4553-93a1-e25889f751ce req-08f826b0-c474-4fba-9fdd-798e22669b6a service nova] Acquiring lock "7d142ab3-beda-4611-8924-5c2803a7a48b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:22:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-acd31f9c-9d81-4553-93a1-e25889f751ce req-08f826b0-c474-4fba-9fdd-798e22669b6a service nova] Lock "7d142ab3-beda-4611-8924-5c2803a7a48b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:22:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-acd31f9c-9d81-4553-93a1-e25889f751ce req-08f826b0-c474-4fba-9fdd-798e22669b6a service nova] Lock "7d142ab3-beda-4611-8924-5c2803a7a48b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:22:57 user nova-compute[72239]: DEBUG nova.compute.manager [req-acd31f9c-9d81-4553-93a1-e25889f751ce req-08f826b0-c474-4fba-9fdd-798e22669b6a service nova] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] No waiting events found dispatching network-vif-plugged-ebd3a6dd-7565-4c09-b693-68d8d95343de {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:22:57 user nova-compute[72239]: WARNING nova.compute.manager [req-acd31f9c-9d81-4553-93a1-e25889f751ce req-08f826b0-c474-4fba-9fdd-798e22669b6a service nova] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Received unexpected event network-vif-plugged-ebd3a6dd-7565-4c09-b693-68d8d95343de for instance with vm_state active and task_state deleting.
Jul 31 15:22:58 user nova-compute[72239]: INFO nova.compute.manager [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Took 0.83 seconds to detach 1 volumes for instance.
Jul 31 15:22:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:22:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:22:58 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:22:58 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:22:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.126s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:22:58 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Deleted allocations for instance 7d142ab3-beda-4611-8924-5c2803a7a48b
Jul 31 15:22:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ed0761a4-8ebd-4f1c-847e-5522cfa9ad50 tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "7d142ab3-beda-4611-8924-5c2803a7a48b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.095s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:23:00 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:23:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:23:06 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:23:11 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690816976.5592363, 7d142ab3-beda-4611-8924-5c2803a7a48b => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:23:11 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] VM Stopped (Lifecycle Event)
Jul 31 15:23:11 user nova-compute[72239]: DEBUG nova.compute.manager [None req-52245d39-3180-4bd5-8950-011ac1cda31e None None] [instance: 7d142ab3-beda-4611-8924-5c2803a7a48b] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:23:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:23:16 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:23:21 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:23:25 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:23:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:23:28 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:23:30 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:23:30 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 15:23:30 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Rebuilding the list of instances to heal {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 15:23:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-1650dae6-9c2e-4316-9655-12cc6f074d63" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:23:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-1650dae6-9c2e-4316-9655-12cc6f074d63" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:23:30 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 15:23:30 user nova-compute[72239]: DEBUG nova.objects.instance [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lazy-loading 'info_cache' on Instance uuid 1650dae6-9c2e-4316-9655-12cc6f074d63 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:23:30 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Updating instance_info_cache with network_info: [{"id": "31e11082-cc50-4fd2-b847-be246d32fcd8", "address": "fa:16:3e:3c:c9:46", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e11082-cc", "ovs_interfaceid": "31e11082-cc50-4fd2-b847-be246d32fcd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:23:30 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-1650dae6-9c2e-4316-9655-12cc6f074d63" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:23:30 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 15:23:30 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:23:31 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:23:31 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:23:31 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:23:34 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:23:36 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:23:36 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 15:23:36 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:23:36 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:23:36 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:23:36 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:23:36 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 15:23:36 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=72239) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 31 15:23:36 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:23:36 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:23:36 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:23:36 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=8809MB free_disk=25.146896362304688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 15:23:36 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:23:36 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:23:36 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 1650dae6-9c2e-4316-9655-12cc6f074d63 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:23:36 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 15:23:36 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 15:23:37 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:23:37 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:23:37 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 15:23:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.158s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:23:41 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:23:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:23:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:23:54 user nova-compute[72239]: DEBUG nova.compute.manager [req-3d801c2f-2982-47f8-a630-5689b3982e5f req-805eec6f-4461-4adf-96c8-9e050e0379eb service nova] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Received event network-changed-31e11082-cc50-4fd2-b847-be246d32fcd8 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:23:54 user nova-compute[72239]: DEBUG nova.compute.manager [req-3d801c2f-2982-47f8-a630-5689b3982e5f req-805eec6f-4461-4adf-96c8-9e050e0379eb service nova] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Refreshing instance network info cache due to event network-changed-31e11082-cc50-4fd2-b847-be246d32fcd8. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:23:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-3d801c2f-2982-47f8-a630-5689b3982e5f req-805eec6f-4461-4adf-96c8-9e050e0379eb service nova] Acquiring lock "refresh_cache-1650dae6-9c2e-4316-9655-12cc6f074d63" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:23:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-3d801c2f-2982-47f8-a630-5689b3982e5f req-805eec6f-4461-4adf-96c8-9e050e0379eb service nova] Acquired lock "refresh_cache-1650dae6-9c2e-4316-9655-12cc6f074d63" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:23:54 user nova-compute[72239]: DEBUG nova.network.neutron [req-3d801c2f-2982-47f8-a630-5689b3982e5f req-805eec6f-4461-4adf-96c8-9e050e0379eb service nova] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Refreshing network info cache for port 31e11082-cc50-4fd2-b847-be246d32fcd8 {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:23:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "1650dae6-9c2e-4316-9655-12cc6f074d63" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:23:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "1650dae6-9c2e-4316-9655-12cc6f074d63" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:23:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "1650dae6-9c2e-4316-9655-12cc6f074d63-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:23:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "1650dae6-9c2e-4316-9655-12cc6f074d63-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:23:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "1650dae6-9c2e-4316-9655-12cc6f074d63-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:23:54 user nova-compute[72239]: INFO nova.compute.manager [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Terminating instance
Jul 31 15:23:54 user nova-compute[72239]: DEBUG nova.compute.manager [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 15:23:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:23:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:23:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:23:54 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:23:54 user nova-compute[72239]: DEBUG nova.compute.manager [req-3b6f020e-f151-4adc-9991-3e5d56575379 req-73de14fc-1992-4d00-9a0d-c95a2b37c18c service nova] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Received event network-vif-unplugged-31e11082-cc50-4fd2-b847-be246d32fcd8 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:23:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-3b6f020e-f151-4adc-9991-3e5d56575379 req-73de14fc-1992-4d00-9a0d-c95a2b37c18c service nova] Acquiring lock "1650dae6-9c2e-4316-9655-12cc6f074d63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:23:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-3b6f020e-f151-4adc-9991-3e5d56575379 req-73de14fc-1992-4d00-9a0d-c95a2b37c18c service nova] Lock "1650dae6-9c2e-4316-9655-12cc6f074d63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:23:54 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-3b6f020e-f151-4adc-9991-3e5d56575379 req-73de14fc-1992-4d00-9a0d-c95a2b37c18c service nova] Lock "1650dae6-9c2e-4316-9655-12cc6f074d63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:23:54 user nova-compute[72239]: DEBUG nova.compute.manager [req-3b6f020e-f151-4adc-9991-3e5d56575379 req-73de14fc-1992-4d00-9a0d-c95a2b37c18c service nova] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] No waiting events found dispatching network-vif-unplugged-31e11082-cc50-4fd2-b847-be246d32fcd8 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:23:54 user nova-compute[72239]: DEBUG nova.compute.manager [req-3b6f020e-f151-4adc-9991-3e5d56575379 req-73de14fc-1992-4d00-9a0d-c95a2b37c18c service nova] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Received event network-vif-unplugged-31e11082-cc50-4fd2-b847-be246d32fcd8 for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG nova.network.neutron [req-3d801c2f-2982-47f8-a630-5689b3982e5f req-805eec6f-4461-4adf-96c8-9e050e0379eb service nova] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Updated VIF entry in instance network info cache for port 31e11082-cc50-4fd2-b847-be246d32fcd8. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG nova.network.neutron [req-3d801c2f-2982-47f8-a630-5689b3982e5f req-805eec6f-4461-4adf-96c8-9e050e0379eb service nova] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Updating instance_info_cache with network_info: [{"id": "31e11082-cc50-4fd2-b847-be246d32fcd8", "address": "fa:16:3e:3c:c9:46", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e11082-cc", "ovs_interfaceid": "31e11082-cc50-4fd2-b847-be246d32fcd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-3d801c2f-2982-47f8-a630-5689b3982e5f req-805eec6f-4461-4adf-96c8-9e050e0379eb service nova] Releasing lock "refresh_cache-1650dae6-9c2e-4316-9655-12cc6f074d63" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:23:55 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Instance destroyed successfully.
Jul 31 15:23:55 user nova-compute[72239]: DEBUG nova.objects.instance [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lazy-loading 'resources' on Instance uuid 1650dae6-9c2e-4316-9655-12cc6f074d63 {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:18:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-497279968',display_name='tempest-TestVolumeBootPattern-server-497279968',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-497279968',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCY3vLYjwCj2oqQSBolW7c+OcVO1ul/eTZat0QSfOYuU0YxIpJAnnDmoUxQPBXaqflB5z610Pc9fwuWzrnOXKK97zfH7u+iQLjb5dXhWdA4VmffAJRc95WJmSak/jG2I9g==',key_name='tempest-TestVolumeBootPattern-1846536962',keypairs=<?>,launch_index=0,launched_at=2023-07-31T15:19:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='35aaefdc03aa4e43b4ba435eea373cc4',ramdisk_id='',reservation_id='r-i6i1lvja',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1903261024',owner_user_name='tempest-TestVolumeBootPattern-1903261024-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T15:19:13Z,user_data=None,user_id='a73969a32be54c8caf621290e8823134',uuid=1650dae6-9c2e-4316-9655-12cc6f074d63,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "31e11082-cc50-4fd2-b847-be246d32fcd8", "address": "fa:16:3e:3c:c9:46", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e11082-cc", "ovs_interfaceid": "31e11082-cc50-4fd2-b847-be246d32fcd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Converting VIF {"id": "31e11082-cc50-4fd2-b847-be246d32fcd8", "address": "fa:16:3e:3c:c9:46", "network": {"id": "78172260-35c7-4653-8ec5-652398310475", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1105052655-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35aaefdc03aa4e43b4ba435eea373cc4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap31e11082-cc", "ovs_interfaceid": "31e11082-cc50-4fd2-b847-be246d32fcd8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:c9:46,bridge_name='br-int',has_traffic_filtering=True,id=31e11082-cc50-4fd2-b847-be246d32fcd8,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31e11082-cc') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG os_vif [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:c9:46,bridge_name='br-int',has_traffic_filtering=True,id=31e11082-cc50-4fd2-b847-be246d32fcd8,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31e11082-cc') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap31e11082-cc, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:23:55 user nova-compute[72239]: INFO os_vif [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:c9:46,bridge_name='br-int',has_traffic_filtering=True,id=31e11082-cc50-4fd2-b847-be246d32fcd8,network=Network(78172260-35c7-4653-8ec5-652398310475),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap31e11082-cc')
Jul 31 15:23:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VqRajYtz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:23:55 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:23:55 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a1c61d-c637-4c24-bb07-1e6b368730cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1260266e-fb5f-47b1-bad5-e5c56f6033d1]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc (non-flash)
Jul 31 15:23:55 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc (non-flash)
Jul 31 15:23:55 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41214b3760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc'): ({'sdb'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Removing single pathed devices sdb {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8302268a-67c9-44f3-8d18-b071bdcd4fe3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[04dce69a-e6b7-4231-9527-e91f6087f744]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Flushing IO for device /dev/sdb {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d94500b7-5c90-43e0-a80b-7f342f563f01]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fec8002-29eb-4d09-8c59-7bac7a7efc46]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOae7c9d25-548b3196411259bd', '/dev/disk/by-id/scsi-23534386233313936', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ae7c9d25') {{(pid=83493) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f622534b-adfc-4c1e-9c04-1249bdee0383]: (4, None) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49fec0a-9c7d-441e-9c41-0093b5012bd1]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[df736ed7-d644-4d7d-bfd9-59e9ee174f2d]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc, portal: 172.16.0.220,3260]
Jul 31 15:23:55 user nova-compute[72239]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc, portal: 172.16.0.220,3260] successful.
Jul 31 15:23:55 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f439f64a-a30f-4ab8-811f-65673bcb1bbc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ea66090-a478-4521-a13f-65332213f10d]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] <== disconnect_volume: return (292ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 15:23:55 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Deleting instance files /opt/stack/data/nova/instances/1650dae6-9c2e-4316-9655-12cc6f074d63_del
Jul 31 15:23:55 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Deletion of /opt/stack/data/nova/instances/1650dae6-9c2e-4316-9655-12cc6f074d63_del complete
Jul 31 15:23:55 user nova-compute[72239]: INFO nova.compute.manager [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Took 1.14 seconds to destroy the instance on the hypervisor.
Jul 31 15:23:55 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 15:23:55 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 15:23:56 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:23:57 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Took 1.22 seconds to deallocate network for instance.
Jul 31 15:23:57 user nova-compute[72239]: DEBUG nova.compute.manager [req-3c2c98bd-0fb6-4b2e-b485-bfdea58fa24c req-ef798766-4ba3-463f-86e3-eb85424c0a2b service nova] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Received event network-vif-deleted-31e11082-cc50-4fd2-b847-be246d32fcd8 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:23:57 user nova-compute[72239]: INFO nova.compute.manager [req-3c2c98bd-0fb6-4b2e-b485-bfdea58fa24c req-ef798766-4ba3-463f-86e3-eb85424c0a2b service nova] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Neutron deleted interface 31e11082-cc50-4fd2-b847-be246d32fcd8; detaching it from the instance and deleting it from the info cache
Jul 31 15:23:57 user nova-compute[72239]: DEBUG nova.network.neutron [req-3c2c98bd-0fb6-4b2e-b485-bfdea58fa24c req-ef798766-4ba3-463f-86e3-eb85424c0a2b service nova] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:23:57 user nova-compute[72239]: DEBUG nova.compute.manager [req-f4de40fb-edea-460c-a7a2-04d89b2ddd5f req-95a7de45-d56f-47a3-9a49-87172c039aaa service nova] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Received event network-vif-plugged-31e11082-cc50-4fd2-b847-be246d32fcd8 {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:23:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-f4de40fb-edea-460c-a7a2-04d89b2ddd5f req-95a7de45-d56f-47a3-9a49-87172c039aaa service nova] Acquiring lock "1650dae6-9c2e-4316-9655-12cc6f074d63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:23:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-f4de40fb-edea-460c-a7a2-04d89b2ddd5f req-95a7de45-d56f-47a3-9a49-87172c039aaa service nova] Lock "1650dae6-9c2e-4316-9655-12cc6f074d63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:23:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-f4de40fb-edea-460c-a7a2-04d89b2ddd5f req-95a7de45-d56f-47a3-9a49-87172c039aaa service nova] Lock "1650dae6-9c2e-4316-9655-12cc6f074d63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:23:57 user nova-compute[72239]: DEBUG nova.compute.manager [req-f4de40fb-edea-460c-a7a2-04d89b2ddd5f req-95a7de45-d56f-47a3-9a49-87172c039aaa service nova] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] No waiting events found dispatching network-vif-plugged-31e11082-cc50-4fd2-b847-be246d32fcd8 {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:23:57 user nova-compute[72239]: WARNING nova.compute.manager [req-f4de40fb-edea-460c-a7a2-04d89b2ddd5f req-95a7de45-d56f-47a3-9a49-87172c039aaa service nova] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Received unexpected event network-vif-plugged-31e11082-cc50-4fd2-b847-be246d32fcd8 for instance with vm_state active and task_state deleting.
Jul 31 15:23:57 user nova-compute[72239]: DEBUG nova.compute.manager [req-3c2c98bd-0fb6-4b2e-b485-bfdea58fa24c req-ef798766-4ba3-463f-86e3-eb85424c0a2b service nova] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Detach interface failed, port_id=31e11082-cc50-4fd2-b847-be246d32fcd8, reason: Instance 1650dae6-9c2e-4316-9655-12cc6f074d63 could not be found. {{(pid=72239) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 31 15:23:57 user nova-compute[72239]: INFO nova.compute.manager [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Took 0.79 seconds to detach 1 volumes for instance.
Jul 31 15:23:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:23:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:23:57 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:23:57 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:23:57 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.132s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:23:58 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Deleted allocations for instance 1650dae6-9c2e-4316-9655-12cc6f074d63
Jul 31 15:23:58 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-d8f920a4-a07a-47de-bbfc-5b5f083d9fed tempest-TestVolumeBootPattern-1903261024 tempest-TestVolumeBootPattern-1903261024-project-member] Lock "1650dae6-9c2e-4316-9655-12cc6f074d63" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.478s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:24:00 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:24:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:24:10 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690817035.3755927, 1650dae6-9c2e-4316-9655-12cc6f074d63 => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:24:10 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] VM Stopped (Lifecycle Event)
Jul 31 15:24:10 user nova-compute[72239]: DEBUG nova.compute.manager [None req-1fbda676-5d34-483d-b1f9-0cb78766d59a None None] [instance: 1650dae6-9c2e-4316-9655-12cc6f074d63] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:24:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:24:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:24:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:24:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:24:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:24:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:24:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:24:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:24:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:24:27 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:24:30 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:24:30 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 15:24:30 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Rebuilding the list of instances to heal {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 15:24:30 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Didn't find any instances for network info cache update. {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 15:24:30 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:24:30 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:24:31 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:24:33 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:24:33 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:24:34 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:24:35 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:24:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:24:36 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:24:36 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:24:36 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:24:36 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:24:36 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 15:24:36 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:24:36 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:24:36 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=8956MB free_disk=25.146018981933594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 15:24:36 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:24:36 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:24:36 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 15:24:36 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 15:24:36 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:24:37 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:24:37 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 15:24:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.244s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:24:38 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:24:38 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 15:24:40 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:24:40 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:24:40 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:24:40 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:24:40 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:24:40 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:24:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:24:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:24:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:24:53 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:24:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:24:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:25:00 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:25:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:25:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:25:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:25:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:25:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:25:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:25:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:25:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:25:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:25:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:25:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:25:27 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:25:29 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:25:30 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:25:30 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:25:31 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:25:31 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 15:25:31 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Rebuilding the list of instances to heal {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 15:25:31 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Didn't find any instances for network info cache update. {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 15:25:31 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:25:32 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:25:33 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:25:33 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:25:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:25:35 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:25:35 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Cleaning up deleted instances {{(pid=72239) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 15:25:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:25:35 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] There are 0 instances to clean {{(pid=72239) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 15:25:35 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:25:36 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:25:37 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:25:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:25:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:25:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:25:37 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 15:25:38 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:25:38 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:25:38 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=8644MB free_disk=25.132709503173828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 15:25:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:25:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:25:38 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 15:25:38 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 15:25:38 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Refreshing inventories for resource provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 15:25:38 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Updating ProviderTree inventory for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 15:25:38 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Updating inventory in ProviderTree for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 15:25:38 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Refreshing aggregate associations for resource provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e, aggregates: None {{(pid=72239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 15:25:38 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Refreshing trait associations for resource provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI {{(pid=72239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 15:25:38 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:25:38 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:25:38 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 15:25:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.504s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:25:38 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:25:39 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:25:39 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 15:25:40 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:25:40 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:25:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Acquiring lock "09177e97-5848-4d1d-a998-438bfaddb73c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:25:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "09177e97-5848-4d1d-a998-438bfaddb73c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:25:44 user nova-compute[72239]: DEBUG nova.compute.manager [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Starting instance... {{(pid=72239) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 31 15:25:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:25:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:25:44 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=72239) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 31 15:25:44 user nova-compute[72239]: INFO nova.compute.claims [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Claim successful on node user
Jul 31 15:25:44 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:25:44 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:25:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:25:44 user nova-compute[72239]: DEBUG nova.compute.manager [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Start building networks asynchronously for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 31 15:25:44 user nova-compute[72239]: DEBUG nova.compute.manager [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Allocating IP information in the background. {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 31 15:25:44 user nova-compute[72239]: DEBUG nova.network.neutron [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] allocate_for_instance() {{(pid=72239) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 31 15:25:44 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 31 15:25:44 user nova-compute[72239]: DEBUG nova.compute.manager [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Start building block device mappings for instance. {{(pid=72239) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 31 15:25:44 user nova-compute[72239]: DEBUG nova.policy [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72fca748cce041cf81dd0d876b05d0d1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b66f633b14b48ada4e1d8b20da967df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=72239) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 31 15:25:45 user nova-compute[72239]: DEBUG nova.compute.manager [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Start spawning the instance on the hypervisor. {{(pid=72239) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 31 15:25:45 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Creating instance directory {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 31 15:25:45 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Creating image(s)
Jul 31 15:25:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Acquiring lock "/opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:25:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "/opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:25:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "/opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:25:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:25:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.132s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:25:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Acquiring lock "ca449065000c92aac3b7b9fa685f9a7710929444" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:25:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:25:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:25:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.145s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:25:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c/disk 1073741824 {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:25:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444,backing_fmt=raw /opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c/disk 1073741824" returned: 0 in 0.058s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:25:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "ca449065000c92aac3b7b9fa685f9a7710929444" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:25:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:25:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:25:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:25:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/ca449065000c92aac3b7b9fa685f9a7710929444 --force-share --output=json" returned: 0 in 0.165s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:25:45 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Checking if we can resize image /opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c/disk. size=1073741824 {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 31 15:25:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:25:45 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:25:45 user nova-compute[72239]: DEBUG nova.virt.disk.api [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Cannot resize image /opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c/disk to a smaller size. {{(pid=72239) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 31 15:25:45 user nova-compute[72239]: DEBUG nova.objects.instance [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lazy-loading 'migration_context' on Instance uuid 09177e97-5848-4d1d-a998-438bfaddb73c {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:25:45 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Created local disks {{(pid=72239) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 31 15:25:45 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Ensure instance console log exists: /opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c/console.log {{(pid=72239) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 31 15:25:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:25:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:25:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:25:45 user nova-compute[72239]: DEBUG nova.network.neutron [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Successfully created port: bd765857-52dd-419a-84e4-611a7bdbb0db {{(pid=72239) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 31 15:25:46 user nova-compute[72239]: DEBUG nova.network.neutron [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Successfully updated port: bd765857-52dd-419a-84e4-611a7bdbb0db {{(pid=72239) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 31 15:25:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Acquiring lock "refresh_cache-09177e97-5848-4d1d-a998-438bfaddb73c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:25:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Acquired lock "refresh_cache-09177e97-5848-4d1d-a998-438bfaddb73c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:25:46 user nova-compute[72239]: DEBUG nova.network.neutron [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Building network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 31 15:25:46 user nova-compute[72239]: DEBUG nova.compute.manager [req-4e07ff43-4300-4323-b8c6-c2ac3f998868 req-caf3a28b-65ba-49c6-964b-f5613565c019 service nova] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Received event network-changed-bd765857-52dd-419a-84e4-611a7bdbb0db {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:25:46 user nova-compute[72239]: DEBUG nova.compute.manager [req-4e07ff43-4300-4323-b8c6-c2ac3f998868 req-caf3a28b-65ba-49c6-964b-f5613565c019 service nova] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Refreshing instance network info cache due to event network-changed-bd765857-52dd-419a-84e4-611a7bdbb0db. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:25:46 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-4e07ff43-4300-4323-b8c6-c2ac3f998868 req-caf3a28b-65ba-49c6-964b-f5613565c019 service nova] Acquiring lock "refresh_cache-09177e97-5848-4d1d-a998-438bfaddb73c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:25:46 user nova-compute[72239]: DEBUG nova.network.neutron [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Instance cache missing network info. {{(pid=72239) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 31 15:25:46 user nova-compute[72239]: DEBUG nova.network.neutron [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Updating instance_info_cache with network_info: [{"id": "bd765857-52dd-419a-84e4-611a7bdbb0db", "address": "fa:16:3e:28:7e:24", "network": {"id": "83f220fa-06f9-40dd-8cc8-329ec73063ec", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1755302406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b66f633b14b48ada4e1d8b20da967df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd765857-52", "ovs_interfaceid": "bd765857-52dd-419a-84e4-611a7bdbb0db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Releasing lock "refresh_cache-09177e97-5848-4d1d-a998-438bfaddb73c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG nova.compute.manager [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Instance network_info: |[{"id": "bd765857-52dd-419a-84e4-611a7bdbb0db", "address": "fa:16:3e:28:7e:24", "network": {"id": "83f220fa-06f9-40dd-8cc8-329ec73063ec", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1755302406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b66f633b14b48ada4e1d8b20da967df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd765857-52", "ovs_interfaceid": "bd765857-52dd-419a-84e4-611a7bdbb0db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=72239) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-4e07ff43-4300-4323-b8c6-c2ac3f998868 req-caf3a28b-65ba-49c6-964b-f5613565c019 service nova] Acquired lock "refresh_cache-09177e97-5848-4d1d-a998-438bfaddb73c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG nova.network.neutron [req-4e07ff43-4300-4323-b8c6-c2ac3f998868 req-caf3a28b-65ba-49c6-964b-f5613565c019 service nova] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Refreshing network info cache for port bd765857-52dd-419a-84e4-611a7bdbb0db {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Start _get_guest_xml network_info=[{"id": "bd765857-52dd-419a-84e4-611a7bdbb0db", "address": "fa:16:3e:28:7e:24", "network": {"id": "83f220fa-06f9-40dd-8cc8-329ec73063ec", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1755302406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b66f633b14b48ada4e1d8b20da967df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd765857-52", "ovs_interfaceid": "bd765857-52dd-419a-84e4-611a7bdbb0db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'encrypted': False, 'device_type': 'disk', 'size': 0, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_format': None, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'c6afbfe5-0fbc-464d-978f-d1243b0a6ba8'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 31 15:25:47 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:25:47 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:25:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] CPU controller missing on host. {{(pid=72239) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.host [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] CPU controller found on host. {{(pid=72239) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=72239) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-31T14:40:07Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-31T14:40:18Z,direct_url=<?>,disk_format='qcow2',id=c6afbfe5-0fbc-464d-978f-d1243b0a6ba8,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='be985e778f1041c8a2378f305504c462',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-31T14:40:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Flavor limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Image limits 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Flavor pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Image pref 0:0:0 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=72239) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Got 1 possible topologies {{(pid=72239) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG nova.virt.hardware [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=72239) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:25:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1393909406',display_name='tempest-SnapshotDataIntegrityTests-server-1393909406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1393909406',id=52,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMddw161/Fe9E1fIvi2fKuwWlaAvMZfGBzbPaMGMnSJJaQ9yq4fnMmto5BJYS+ODbdqEXqqkY/9IeG0y4HyXAhuScdzvnfpwZVOH+6DV1XFlLTXfErBFM7iXlVKfDpE8fQ==',key_name='tempest-keypair-1472732451',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b66f633b14b48ada4e1d8b20da967df',ramdisk_id='',reservation_id='r-gwfgvm2w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1913476977',owner_user_name='tempest-SnapshotDataIntegrityTests-1913476977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T15:25:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72fca748cce041cf81dd0d876b05d0d1',uuid=09177e97-5848-4d1d-a998-438bfaddb73c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd765857-52dd-419a-84e4-611a7bdbb0db", "address": "fa:16:3e:28:7e:24", "network": {"id": "83f220fa-06f9-40dd-8cc8-329ec73063ec", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1755302406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b66f633b14b48ada4e1d8b20da967df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd765857-52", "ovs_interfaceid": "bd765857-52dd-419a-84e4-611a7bdbb0db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=72239) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Converting VIF {"id": "bd765857-52dd-419a-84e4-611a7bdbb0db", "address": "fa:16:3e:28:7e:24", "network": {"id": "83f220fa-06f9-40dd-8cc8-329ec73063ec", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1755302406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b66f633b14b48ada4e1d8b20da967df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd765857-52", "ovs_interfaceid": "bd765857-52dd-419a-84e4-611a7bdbb0db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:7e:24,bridge_name='br-int',has_traffic_filtering=True,id=bd765857-52dd-419a-84e4-611a7bdbb0db,network=Network(83f220fa-06f9-40dd-8cc8-329ec73063ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd765857-52') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG nova.objects.instance [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lazy-loading 'pci_devices' on Instance uuid 09177e97-5848-4d1d-a998-438bfaddb73c {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] End _get_guest_xml xml=<domain type="kvm">
Jul 31 15:25:47 user nova-compute[72239]:   <uuid>09177e97-5848-4d1d-a998-438bfaddb73c</uuid>
Jul 31 15:25:47 user nova-compute[72239]:   <name>instance-00000034</name>
Jul 31 15:25:47 user nova-compute[72239]:   <memory>524288</memory>
Jul 31 15:25:47 user nova-compute[72239]:   <vcpu>1</vcpu>
Jul 31 15:25:47 user nova-compute[72239]:   <metadata>
Jul 31 15:25:47 user nova-compute[72239]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 31 15:25:47 user nova-compute[72239]:       <nova:package version="0.0.0"/>
Jul 31 15:25:47 user nova-compute[72239]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1393909406</nova:name>
Jul 31 15:25:47 user nova-compute[72239]:       <nova:creationTime>2023-07-31 15:25:47</nova:creationTime>
Jul 31 15:25:47 user nova-compute[72239]:       <nova:flavor name="m1.tiny">
Jul 31 15:25:47 user nova-compute[72239]:         <nova:memory>512</nova:memory>
Jul 31 15:25:47 user nova-compute[72239]:         <nova:disk>1</nova:disk>
Jul 31 15:25:47 user nova-compute[72239]:         <nova:swap>0</nova:swap>
Jul 31 15:25:47 user nova-compute[72239]:         <nova:ephemeral>0</nova:ephemeral>
Jul 31 15:25:47 user nova-compute[72239]:         <nova:vcpus>1</nova:vcpus>
Jul 31 15:25:47 user nova-compute[72239]:       </nova:flavor>
Jul 31 15:25:47 user nova-compute[72239]:       <nova:owner>
Jul 31 15:25:47 user nova-compute[72239]:         <nova:user uuid="72fca748cce041cf81dd0d876b05d0d1">tempest-SnapshotDataIntegrityTests-1913476977-project-member</nova:user>
Jul 31 15:25:47 user nova-compute[72239]:         <nova:project uuid="8b66f633b14b48ada4e1d8b20da967df">tempest-SnapshotDataIntegrityTests-1913476977</nova:project>
Jul 31 15:25:47 user nova-compute[72239]:       </nova:owner>
Jul 31 15:25:47 user nova-compute[72239]:       <nova:root type="image" uuid="c6afbfe5-0fbc-464d-978f-d1243b0a6ba8"/>
Jul 31 15:25:47 user nova-compute[72239]:       <nova:ports>
Jul 31 15:25:47 user nova-compute[72239]:         <nova:port uuid="bd765857-52dd-419a-84e4-611a7bdbb0db">
Jul 31 15:25:47 user nova-compute[72239]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 31 15:25:47 user nova-compute[72239]:         </nova:port>
Jul 31 15:25:47 user nova-compute[72239]:       </nova:ports>
Jul 31 15:25:47 user nova-compute[72239]:     </nova:instance>
Jul 31 15:25:47 user nova-compute[72239]:   </metadata>
Jul 31 15:25:47 user nova-compute[72239]:   <sysinfo type="smbios">
Jul 31 15:25:47 user nova-compute[72239]:     <system>
Jul 31 15:25:47 user nova-compute[72239]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 31 15:25:47 user nova-compute[72239]:       <entry name="product">OpenStack Nova</entry>
Jul 31 15:25:47 user nova-compute[72239]:       <entry name="version">0.0.0</entry>
Jul 31 15:25:47 user nova-compute[72239]:       <entry name="serial">09177e97-5848-4d1d-a998-438bfaddb73c</entry>
Jul 31 15:25:47 user nova-compute[72239]:       <entry name="uuid">09177e97-5848-4d1d-a998-438bfaddb73c</entry>
Jul 31 15:25:47 user nova-compute[72239]:       <entry name="family">Virtual Machine</entry>
Jul 31 15:25:47 user nova-compute[72239]:     </system>
Jul 31 15:25:47 user nova-compute[72239]:   </sysinfo>
Jul 31 15:25:47 user nova-compute[72239]:   <os>
Jul 31 15:25:47 user nova-compute[72239]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 31 15:25:47 user nova-compute[72239]:     <boot dev="hd"/>
Jul 31 15:25:47 user nova-compute[72239]:     <smbios mode="sysinfo"/>
Jul 31 15:25:47 user nova-compute[72239]:   </os>
Jul 31 15:25:47 user nova-compute[72239]:   <features>
Jul 31 15:25:47 user nova-compute[72239]:     <acpi/>
Jul 31 15:25:47 user nova-compute[72239]:     <apic/>
Jul 31 15:25:47 user nova-compute[72239]:     <vmcoreinfo/>
Jul 31 15:25:47 user nova-compute[72239]:   </features>
Jul 31 15:25:47 user nova-compute[72239]:   <clock offset="utc">
Jul 31 15:25:47 user nova-compute[72239]:     <timer name="pit" tickpolicy="delay"/>
Jul 31 15:25:47 user nova-compute[72239]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 31 15:25:47 user nova-compute[72239]:     <timer name="hpet" present="no"/>
Jul 31 15:25:47 user nova-compute[72239]:   </clock>
Jul 31 15:25:47 user nova-compute[72239]:   <cpu mode="custom" match="exact">
Jul 31 15:25:47 user nova-compute[72239]:     <model>Nehalem</model>
Jul 31 15:25:47 user nova-compute[72239]:     <topology sockets="1" cores="1" threads="1"/>
Jul 31 15:25:47 user nova-compute[72239]:   </cpu>
Jul 31 15:25:47 user nova-compute[72239]:   <devices>
Jul 31 15:25:47 user nova-compute[72239]:     <disk type="file" device="disk">
Jul 31 15:25:47 user nova-compute[72239]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 31 15:25:47 user nova-compute[72239]:       <source file="/opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c/disk"/>
Jul 31 15:25:47 user nova-compute[72239]:       <target dev="vda" bus="virtio"/>
Jul 31 15:25:47 user nova-compute[72239]:     </disk>
Jul 31 15:25:47 user nova-compute[72239]:     <interface type="ethernet">
Jul 31 15:25:47 user nova-compute[72239]:       <mac address="fa:16:3e:28:7e:24"/>
Jul 31 15:25:47 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:25:47 user nova-compute[72239]:       <mtu size="1442"/>
Jul 31 15:25:47 user nova-compute[72239]:       <target dev="tapbd765857-52"/>
Jul 31 15:25:47 user nova-compute[72239]:     </interface>
Jul 31 15:25:47 user nova-compute[72239]:     <serial type="pty">
Jul 31 15:25:47 user nova-compute[72239]:       <log file="/opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c/console.log" append="off"/>
Jul 31 15:25:47 user nova-compute[72239]:     </serial>
Jul 31 15:25:47 user nova-compute[72239]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 31 15:25:47 user nova-compute[72239]:     <video>
Jul 31 15:25:47 user nova-compute[72239]:       <model type="virtio"/>
Jul 31 15:25:47 user nova-compute[72239]:     </video>
Jul 31 15:25:47 user nova-compute[72239]:     <rng model="virtio">
Jul 31 15:25:47 user nova-compute[72239]:       <backend model="random">/dev/urandom</backend>
Jul 31 15:25:47 user nova-compute[72239]:     </rng>
Jul 31 15:25:47 user nova-compute[72239]:     <controller type="usb" index="0" model="none"/>
Jul 31 15:25:47 user nova-compute[72239]:     <memballoon model="virtio">
Jul 31 15:25:47 user nova-compute[72239]:       <stats period="10"/>
Jul 31 15:25:47 user nova-compute[72239]:     </memballoon>
Jul 31 15:25:47 user nova-compute[72239]:   </devices>
Jul 31 15:25:47 user nova-compute[72239]: </domain>
Jul 31 15:25:47 user nova-compute[72239]:  {{(pid=72239) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:25:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1393909406',display_name='tempest-SnapshotDataIntegrityTests-server-1393909406',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1393909406',id=52,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMddw161/Fe9E1fIvi2fKuwWlaAvMZfGBzbPaMGMnSJJaQ9yq4fnMmto5BJYS+ODbdqEXqqkY/9IeG0y4HyXAhuScdzvnfpwZVOH+6DV1XFlLTXfErBFM7iXlVKfDpE8fQ==',key_name='tempest-keypair-1472732451',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b66f633b14b48ada4e1d8b20da967df',ramdisk_id='',reservation_id='r-gwfgvm2w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1913476977',owner_user_name='tempest-SnapshotDataIntegrityTests-1913476977-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-31T15:25:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72fca748cce041cf81dd0d876b05d0d1',uuid=09177e97-5848-4d1d-a998-438bfaddb73c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd765857-52dd-419a-84e4-611a7bdbb0db", "address": "fa:16:3e:28:7e:24", "network": {"id": "83f220fa-06f9-40dd-8cc8-329ec73063ec", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1755302406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b66f633b14b48ada4e1d8b20da967df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd765857-52", "ovs_interfaceid": "bd765857-52dd-419a-84e4-611a7bdbb0db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Converting VIF {"id": "bd765857-52dd-419a-84e4-611a7bdbb0db", "address": "fa:16:3e:28:7e:24", "network": {"id": "83f220fa-06f9-40dd-8cc8-329ec73063ec", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1755302406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b66f633b14b48ada4e1d8b20da967df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd765857-52", "ovs_interfaceid": "bd765857-52dd-419a-84e4-611a7bdbb0db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:7e:24,bridge_name='br-int',has_traffic_filtering=True,id=bd765857-52dd-419a-84e4-611a7bdbb0db,network=Network(83f220fa-06f9-40dd-8cc8-329ec73063ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd765857-52') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG os_vif [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:7e:24,bridge_name='br-int',has_traffic_filtering=True,id=bd765857-52dd-419a-84e4-611a7bdbb0db,network=Network(83f220fa-06f9-40dd-8cc8-329ec73063ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd765857-52') {{(pid=72239) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd765857-52, may_exist=True, interface_attrs={}) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbd765857-52, col_values=(('external_ids', {'iface-id': 'bd765857-52dd-419a-84e4-611a7bdbb0db', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:7e:24', 'vm-uuid': '09177e97-5848-4d1d-a998-438bfaddb73c'}),), if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:25:47 user nova-compute[72239]: INFO os_vif [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:7e:24,bridge_name='br-int',has_traffic_filtering=True,id=bd765857-52dd-419a-84e4-611a7bdbb0db,network=Network(83f220fa-06f9-40dd-8cc8-329ec73063ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd765857-52')
Jul 31 15:25:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] No VIF found with MAC fa:16:3e:28:7e:24, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG nova.network.neutron [req-4e07ff43-4300-4323-b8c6-c2ac3f998868 req-caf3a28b-65ba-49c6-964b-f5613565c019 service nova] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Updated VIF entry in instance network info cache for port bd765857-52dd-419a-84e4-611a7bdbb0db. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG nova.network.neutron [req-4e07ff43-4300-4323-b8c6-c2ac3f998868 req-caf3a28b-65ba-49c6-964b-f5613565c019 service nova] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Updating instance_info_cache with network_info: [{"id": "bd765857-52dd-419a-84e4-611a7bdbb0db", "address": "fa:16:3e:28:7e:24", "network": {"id": "83f220fa-06f9-40dd-8cc8-329ec73063ec", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1755302406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b66f633b14b48ada4e1d8b20da967df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd765857-52", "ovs_interfaceid": "bd765857-52dd-419a-84e4-611a7bdbb0db", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:25:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-4e07ff43-4300-4323-b8c6-c2ac3f998868 req-caf3a28b-65ba-49c6-964b-f5613565c019 service nova] Releasing lock "refresh_cache-09177e97-5848-4d1d-a998-438bfaddb73c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:25:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:25:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:25:48 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:25:48 user nova-compute[72239]: DEBUG nova.compute.manager [req-e7e3f451-66d0-4a50-b796-6e061787e4df req-734d02cc-3951-4b51-a0d9-361b7ca876ce service nova] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Received event network-vif-plugged-bd765857-52dd-419a-84e4-611a7bdbb0db {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:25:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e7e3f451-66d0-4a50-b796-6e061787e4df req-734d02cc-3951-4b51-a0d9-361b7ca876ce service nova] Acquiring lock "09177e97-5848-4d1d-a998-438bfaddb73c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:25:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e7e3f451-66d0-4a50-b796-6e061787e4df req-734d02cc-3951-4b51-a0d9-361b7ca876ce service nova] Lock "09177e97-5848-4d1d-a998-438bfaddb73c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:25:48 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-e7e3f451-66d0-4a50-b796-6e061787e4df req-734d02cc-3951-4b51-a0d9-361b7ca876ce service nova] Lock "09177e97-5848-4d1d-a998-438bfaddb73c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:25:48 user nova-compute[72239]: DEBUG nova.compute.manager [req-e7e3f451-66d0-4a50-b796-6e061787e4df req-734d02cc-3951-4b51-a0d9-361b7ca876ce service nova] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] No waiting events found dispatching network-vif-plugged-bd765857-52dd-419a-84e4-611a7bdbb0db {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:25:48 user nova-compute[72239]: WARNING nova.compute.manager [req-e7e3f451-66d0-4a50-b796-6e061787e4df req-734d02cc-3951-4b51-a0d9-361b7ca876ce service nova] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Received unexpected event network-vif-plugged-bd765857-52dd-419a-84e4-611a7bdbb0db for instance with vm_state building and task_state spawning.
Jul 31 15:25:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:25:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:25:49 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:25:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:25:50 user nova-compute[72239]: DEBUG nova.compute.manager [req-9f33b0ca-dbce-4ae2-b83a-c762e09bc991 req-30bb048d-1c52-4d2f-9afd-a00c9743fbcf service nova] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Received event network-vif-plugged-bd765857-52dd-419a-84e4-611a7bdbb0db {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:25:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-9f33b0ca-dbce-4ae2-b83a-c762e09bc991 req-30bb048d-1c52-4d2f-9afd-a00c9743fbcf service nova] Acquiring lock "09177e97-5848-4d1d-a998-438bfaddb73c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:25:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-9f33b0ca-dbce-4ae2-b83a-c762e09bc991 req-30bb048d-1c52-4d2f-9afd-a00c9743fbcf service nova] Lock "09177e97-5848-4d1d-a998-438bfaddb73c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:25:50 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-9f33b0ca-dbce-4ae2-b83a-c762e09bc991 req-30bb048d-1c52-4d2f-9afd-a00c9743fbcf service nova] Lock "09177e97-5848-4d1d-a998-438bfaddb73c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:25:50 user nova-compute[72239]: DEBUG nova.compute.manager [req-9f33b0ca-dbce-4ae2-b83a-c762e09bc991 req-30bb048d-1c52-4d2f-9afd-a00c9743fbcf service nova] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] No waiting events found dispatching network-vif-plugged-bd765857-52dd-419a-84e4-611a7bdbb0db {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:25:50 user nova-compute[72239]: WARNING nova.compute.manager [req-9f33b0ca-dbce-4ae2-b83a-c762e09bc991 req-30bb048d-1c52-4d2f-9afd-a00c9743fbcf service nova] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Received unexpected event network-vif-plugged-bd765857-52dd-419a-84e4-611a7bdbb0db for instance with vm_state building and task_state spawning.
Jul 31 15:25:51 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690817151.0920293, 09177e97-5848-4d1d-a998-438bfaddb73c => Resumed> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:25:51 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] VM Resumed (Lifecycle Event)
Jul 31 15:25:51 user nova-compute[72239]: DEBUG nova.compute.manager [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Instance event wait completed in 0 seconds for  {{(pid=72239) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 31 15:25:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Guest created on hypervisor {{(pid=72239) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 31 15:25:51 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Instance spawned successfully.
Jul 31 15:25:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 31 15:25:51 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:25:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Found default for hw_cdrom_bus of ide {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:25:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Found default for hw_disk_bus of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:25:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Found default for hw_input_bus of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:25:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Found default for hw_pointer_model of None {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:25:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Found default for hw_video_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:25:51 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Found default for hw_vif_model of virtio {{(pid=72239) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 31 15:25:51 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:25:51 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 15:25:51 user nova-compute[72239]: DEBUG nova.virt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Emitting event <LifecycleEvent: 1690817151.0937371, 09177e97-5848-4d1d-a998-438bfaddb73c => Started> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:25:51 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] VM Started (Lifecycle Event)
Jul 31 15:25:51 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:25:51 user nova-compute[72239]: DEBUG nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=72239) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 31 15:25:51 user nova-compute[72239]: INFO nova.compute.manager [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Took 6.25 seconds to spawn the instance on the hypervisor.
Jul 31 15:25:51 user nova-compute[72239]: DEBUG nova.compute.manager [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:25:51 user nova-compute[72239]: INFO nova.compute.manager [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 31 15:25:51 user nova-compute[72239]: INFO nova.compute.manager [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Took 7.16 seconds to build instance.
Jul 31 15:25:51 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-9c1c7d23-9b09-49e5-8c3f-ea9ed5d0ba8c tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "09177e97-5848-4d1d-a998-438bfaddb73c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.284s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:25:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:25:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:25:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:26:00 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:26:01 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:26:01 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Cleaning up deleted instances with incomplete migration  {{(pid=72239) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 15:26:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:26:05 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:26:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:26:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:26:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:26:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:26:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:26:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:26:08 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:26:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:26:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:26:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:26:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:26:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:26:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:26:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:26:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:26:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:26:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:26:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:26:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:26:29 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:26:31 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:26:32 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:26:33 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:26:33 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:26:33 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 15:26:33 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Rebuilding the list of instances to heal {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 15:26:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-09177e97-5848-4d1d-a998-438bfaddb73c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:26:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-09177e97-5848-4d1d-a998-438bfaddb73c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:26:33 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 15:26:33 user nova-compute[72239]: DEBUG nova.objects.instance [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lazy-loading 'info_cache' on Instance uuid 09177e97-5848-4d1d-a998-438bfaddb73c {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:26:33 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Updating instance_info_cache with network_info: [{"id": "bd765857-52dd-419a-84e4-611a7bdbb0db", "address": "fa:16:3e:28:7e:24", "network": {"id": "83f220fa-06f9-40dd-8cc8-329ec73063ec", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1755302406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b66f633b14b48ada4e1d8b20da967df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd765857-52", "ovs_interfaceid": "bd765857-52dd-419a-84e4-611a7bdbb0db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:26:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-09177e97-5848-4d1d-a998-438bfaddb73c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:26:33 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 15:26:33 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:26:33 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:26:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:26:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:26:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:26:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:26:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:26:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:26:37 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:26:37 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:26:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:26:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:26:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:26:37 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 15:26:37 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:26:37 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:26:37 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:26:37 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:26:38 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:26:38 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:26:38 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=8587MB free_disk=25.099506378173828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 15:26:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:26:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:26:38 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 09177e97-5848-4d1d-a998-438bfaddb73c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:26:38 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 15:26:38 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 15:26:38 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:26:38 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:26:38 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 15:26:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.271s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:26:39 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:26:39 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:26:39 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 15:26:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:26:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:26:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:26:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:26:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:26:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:26:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:26:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:26:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:26:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:26:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:26:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:26:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:26:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:27:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:27:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:27:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:27:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:27:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:27:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:27:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:27:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:27:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:27:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:27:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:27:31 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:27:31 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:27:32 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:27:33 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:27:33 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:27:33 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 15:27:33 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Rebuilding the list of instances to heal {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 15:27:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-09177e97-5848-4d1d-a998-438bfaddb73c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:27:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-09177e97-5848-4d1d-a998-438bfaddb73c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:27:33 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 15:27:33 user nova-compute[72239]: DEBUG nova.objects.instance [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lazy-loading 'info_cache' on Instance uuid 09177e97-5848-4d1d-a998-438bfaddb73c {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:27:34 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Updating instance_info_cache with network_info: [{"id": "bd765857-52dd-419a-84e4-611a7bdbb0db", "address": "fa:16:3e:28:7e:24", "network": {"id": "83f220fa-06f9-40dd-8cc8-329ec73063ec", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1755302406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b66f633b14b48ada4e1d8b20da967df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd765857-52", "ovs_interfaceid": "bd765857-52dd-419a-84e4-611a7bdbb0db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:27:34 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-09177e97-5848-4d1d-a998-438bfaddb73c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:27:34 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 15:27:34 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:27:34 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:27:35 user nova-compute[72239]: DEBUG nova.compute.manager [req-b14001e4-edec-4f88-bd0d-a1331396f760 req-b48b6d44-b304-4bfd-9f2d-6bf64164c33e service nova] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Received event network-changed-bd765857-52dd-419a-84e4-611a7bdbb0db {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:27:35 user nova-compute[72239]: DEBUG nova.compute.manager [req-b14001e4-edec-4f88-bd0d-a1331396f760 req-b48b6d44-b304-4bfd-9f2d-6bf64164c33e service nova] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Refreshing instance network info cache due to event network-changed-bd765857-52dd-419a-84e4-611a7bdbb0db. {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 31 15:27:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b14001e4-edec-4f88-bd0d-a1331396f760 req-b48b6d44-b304-4bfd-9f2d-6bf64164c33e service nova] Acquiring lock "refresh_cache-09177e97-5848-4d1d-a998-438bfaddb73c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:27:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b14001e4-edec-4f88-bd0d-a1331396f760 req-b48b6d44-b304-4bfd-9f2d-6bf64164c33e service nova] Acquired lock "refresh_cache-09177e97-5848-4d1d-a998-438bfaddb73c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:27:35 user nova-compute[72239]: DEBUG nova.network.neutron [req-b14001e4-edec-4f88-bd0d-a1331396f760 req-b48b6d44-b304-4bfd-9f2d-6bf64164c33e service nova] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Refreshing network info cache for port bd765857-52dd-419a-84e4-611a7bdbb0db {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 31 15:27:36 user nova-compute[72239]: DEBUG nova.network.neutron [req-b14001e4-edec-4f88-bd0d-a1331396f760 req-b48b6d44-b304-4bfd-9f2d-6bf64164c33e service nova] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Updated VIF entry in instance network info cache for port bd765857-52dd-419a-84e4-611a7bdbb0db. {{(pid=72239) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 31 15:27:36 user nova-compute[72239]: DEBUG nova.network.neutron [req-b14001e4-edec-4f88-bd0d-a1331396f760 req-b48b6d44-b304-4bfd-9f2d-6bf64164c33e service nova] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Updating instance_info_cache with network_info: [{"id": "bd765857-52dd-419a-84e4-611a7bdbb0db", "address": "fa:16:3e:28:7e:24", "network": {"id": "83f220fa-06f9-40dd-8cc8-329ec73063ec", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1755302406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b66f633b14b48ada4e1d8b20da967df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd765857-52", "ovs_interfaceid": "bd765857-52dd-419a-84e4-611a7bdbb0db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:27:36 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-b14001e4-edec-4f88-bd0d-a1331396f760 req-b48b6d44-b304-4bfd-9f2d-6bf64164c33e service nova] Releasing lock "refresh_cache-09177e97-5848-4d1d-a998-438bfaddb73c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:27:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:27:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:27:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:27:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:27:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:27:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:27:37 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:27:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:27:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:27:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:27:37 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 15:27:37 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:27:37 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:27:37 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:27:37 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:27:38 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:27:38 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:27:38 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=8809MB free_disk=25.097938537597656GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 15:27:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:27:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:27:38 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 09177e97-5848-4d1d-a998-438bfaddb73c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:27:38 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 15:27:38 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 15:27:38 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:27:38 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:27:38 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 15:27:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.166s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:27:40 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Acquiring lock "09177e97-5848-4d1d-a998-438bfaddb73c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:27:40 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "09177e97-5848-4d1d-a998-438bfaddb73c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:27:40 user nova-compute[72239]: DEBUG nova.objects.instance [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lazy-loading 'flavor' on Instance uuid 09177e97-5848-4d1d-a998-438bfaddb73c {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:27:40 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "09177e97-5848-4d1d-a998-438bfaddb73c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:27:40 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:27:40 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:27:40 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Acquiring lock "09177e97-5848-4d1d-a998-438bfaddb73c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:27:40 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "09177e97-5848-4d1d-a998-438bfaddb73c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:27:40 user nova-compute[72239]: INFO nova.compute.manager [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Attaching volume df687d14-4957-4c38-9b27-4e846a06dcd7 to /dev/vdb
Jul 31 15:27:40 user nova-compute[72239]: DEBUG os_brick.utils [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:27:40 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:27:40 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:27:40 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[189b98bd-4b55-4cfc-bb6b-8a5fccbdeba0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:27:40 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:27:40 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:27:40 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b790bce-dcc1-484d-8927-3357a5536754]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:27:40 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:27:40 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:27:40 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[17506059-a92a-4b10-81ff-5ab9f93c08d8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:27:40 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c3f9a9-7f70-48f3-afe6-b5c13a16757d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:27:40 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:27:40 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:27:40 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 15:27:40 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:27:40 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:27:40 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 15:27:40 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[115011d9-1a2d-461c-8968-623231c9f18a]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:27:40 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 15:27:40 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 15:27:40 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 15:27:40 user nova-compute[72239]: DEBUG os_brick.utils [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:27:40 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Updating existing volume attachment record: f64d9281-3383-4f4a-b631-a5ecaf381751 {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 15:27:41 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:27:41 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 15:27:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:27:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJTaWBlo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:27:47 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:27:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:27:47 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:27:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:27:47 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 15:27:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7 -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f88c83-6746-489f-b8ea-804d18411e52]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 15:27:47 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[50357f4c-38bd-4c31-b5c7-164d8cbff2c3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7] added
Jul 31 15:27:47 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec1e463-250c-4ba6-bd3d-8670f9f6050b]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08ea96c-3d7f-478e-80a1-e6134ba24a43]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KJTaWBlo {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KJTaWBlo" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b1311d-82b3-446e-aede-eb1eb2acb800]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KJTaWBlo'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[131ca455-aa4b-470b-9998-37c20d8ffc62]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b32a47-e3d2-4a28-b238-12e2860c2ba9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 15:27:47 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 15:27:47 user nova-compute[72239]:  {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:27:47 user nova-compute[72239]: WARNING os_brick.initiator.connectors.iscsi [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 15:27:47 user nova-compute[72239]: 
Jul 31 15:27:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7 -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d600915d-a8b1-4d99-a5e3-f7ceab96b365]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7, portal: 172.16.0.220,3260]
Jul 31 15:27:47 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7, portal: 172.16.0.220,3260] successful.
Jul 31 15:27:47 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb38dca3-f7ed-4ae0-b345-bd14afc755fd]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3693d43e-5764-4458-b7de-c8c8293c3671]: (4, ('tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7 (non-flash)
Jul 31 15:27:47 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsi session list stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7 (non-flash)
Jul 31 15:27:47 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] HCTL ('33', '-', '-', 0) found on session 66 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e6d20c-2e83-42c4-85ed-31525feb3636]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:27:47 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Searching for a device in session 66 and hctl ['33', '*', '*', 0] yield: None {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 15:27:48 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Searching for a device in session 66 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 15:27:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJTaWBlo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 15:27:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.277s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:27:48 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] <== connect_volume: return (1278ms) {'type': 'block', 'scsi_wwn': '26562393035333464', 'path': '/dev/sdb'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:27:48 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26562393035333464', 'path': '/dev/sdb'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 15:27:48 user nova-compute[72239]: DEBUG nova.objects.instance [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lazy-loading 'flavor' on Instance uuid 09177e97-5848-4d1d-a998-438bfaddb73c {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:27:48 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 15:27:48 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:27:48 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 15:27:48 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 15:27:48 user nova-compute[72239]:   <serial>df687d14-4957-4c38-9b27-4e846a06dcd7</serial>
Jul 31 15:27:48 user nova-compute[72239]: </disk>
Jul 31 15:27:48 user nova-compute[72239]:  {{(pid=72239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 15:27:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:27:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:27:49 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] No VIF found with MAC fa:16:3e:28:7e:24, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 15:27:49 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-3684ca67-0bfd-4faa-8af3-f69105041083 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "09177e97-5848-4d1d-a998-438bfaddb73c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.973s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:27:50 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:27:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:27:55 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:27:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:28:00 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:28:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:28:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:28:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-3968e475-963c-486b-836c-8b125757b49e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Acquiring lock "09177e97-5848-4d1d-a998-438bfaddb73c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:28:06 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-3968e475-963c-486b-836c-8b125757b49e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "09177e97-5848-4d1d-a998-438bfaddb73c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:28:06 user nova-compute[72239]: INFO nova.compute.manager [None req-3968e475-963c-486b-836c-8b125757b49e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Detaching volume df687d14-4957-4c38-9b27-4e846a06dcd7
Jul 31 15:28:06 user nova-compute[72239]: INFO nova.virt.block_device [None req-3968e475-963c-486b-836c-8b125757b49e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Attempting to driver detach volume df687d14-4957-4c38-9b27-4e846a06dcd7 from mountpoint /dev/vdb
Jul 31 15:28:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-3968e475-963c-486b-836c-8b125757b49e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Attempting to detach device vdb from instance 09177e97-5848-4d1d-a998-438bfaddb73c from the persistent domain config. {{(pid=72239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 15:28:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-3968e475-963c-486b-836c-8b125757b49e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 15:28:06 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:28:06 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 15:28:06 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 15:28:06 user nova-compute[72239]:   <serial>df687d14-4957-4c38-9b27-4e846a06dcd7</serial>
Jul 31 15:28:06 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 15:28:06 user nova-compute[72239]: </disk>
Jul 31 15:28:06 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 15:28:06 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-3968e475-963c-486b-836c-8b125757b49e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Successfully detached device vdb from instance 09177e97-5848-4d1d-a998-438bfaddb73c from the persistent domain config.
Jul 31 15:28:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-3968e475-963c-486b-836c-8b125757b49e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 09177e97-5848-4d1d-a998-438bfaddb73c from the live domain config. {{(pid=72239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 15:28:06 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-3968e475-963c-486b-836c-8b125757b49e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 15:28:06 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:28:06 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 15:28:06 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 15:28:06 user nova-compute[72239]:   <serial>df687d14-4957-4c38-9b27-4e846a06dcd7</serial>
Jul 31 15:28:06 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 15:28:06 user nova-compute[72239]: </disk>
Jul 31 15:28:06 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Received event <DeviceRemovedEvent: 1690817287.4160984, 09177e97-5848-4d1d-a998-438bfaddb73c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72239) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-3968e475-963c-486b-836c-8b125757b49e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 09177e97-5848-4d1d-a998-438bfaddb73c {{(pid=72239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 15:28:07 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-3968e475-963c-486b-836c-8b125757b49e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Successfully detached device vdb from instance 09177e97-5848-4d1d-a998-438bfaddb73c from the live domain config.
Jul 31 15:28:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3968e475-963c-486b-836c-8b125757b49e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3968e475-963c-486b-836c-8b125757b49e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KJTaWBlo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:28:07 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-3968e475-963c-486b-836c-8b125757b49e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:28:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-3968e475-963c-486b-836c-8b125757b49e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-3968e475-963c-486b-836c-8b125757b49e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3968e475-963c-486b-836c-8b125757b49e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b43b276-6f2e-45ba-8201-b2c5b1e885a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1796413-921a-483b-a48d-ac9fb90c830c]: (4, ('tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3968e475-963c-486b-836c-8b125757b49e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7 (non-flash)
Jul 31 15:28:07 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3968e475-963c-486b-836c-8b125757b49e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsi session list stdout=tcp: [66] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7 (non-flash)
Jul 31 15:28:07 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3968e475-963c-486b-836c-8b125757b49e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f410058d090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7'): ({'sdb'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-3968e475-963c-486b-836c-8b125757b49e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Removing single pathed devices sdb {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b9f276-cb05-4b78-9d97-1f16708e00a2]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d12108-823b-414a-ab8c-cbd2bc5ebf8d]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-3968e475-963c-486b-836c-8b125757b49e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Flushing IO for device /dev/sdb {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9d41ae6-77ae-4cd2-b1d1-d28ab4a1bcf7]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-3968e475-963c-486b-836c-8b125757b49e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b290d5-bb04-457a-829b-30ac8b225ed8]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-3968e475-963c-486b-836c-8b125757b49e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-3968e475-963c-486b-836c-8b125757b49e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3968e475-963c-486b-836c-8b125757b49e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99b827d-4c75-4914-8441-1cc90e9220d6]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3968e475-963c-486b-836c-8b125757b49e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7 -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[774f5422-1452-46e1-ae4d-d8e61cfe9150]: (4, ('Logging out of session [sid: 66, target: iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7, portal: 172.16.0.220,3260]\nLogout of [sid: 66, target: iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3968e475-963c-486b-836c-8b125757b49e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 66, target: iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7, portal: 172.16.0.220,3260]
Jul 31 15:28:07 user nova-compute[72239]: Logout of [sid: 66, target: iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7, portal: 172.16.0.220,3260] successful.
Jul 31 15:28:07 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7 -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df687d14-4957-4c38-9b27-4e846a06dcd7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e4bafd-bf86-4549-8f3d-8fc50b8defcb]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3968e475-963c-486b-836c-8b125757b49e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-3968e475-963c-486b-836c-8b125757b49e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.253s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-3968e475-963c-486b-836c-8b125757b49e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] <== disconnect_volume: return (253ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:28:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3968e475-963c-486b-836c-8b125757b49e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 15:28:08 user nova-compute[72239]: DEBUG nova.objects.instance [None req-3968e475-963c-486b-836c-8b125757b49e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lazy-loading 'flavor' on Instance uuid 09177e97-5848-4d1d-a998-438bfaddb73c {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:28:08 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-3968e475-963c-486b-836c-8b125757b49e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "09177e97-5848-4d1d-a998-438bfaddb73c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.548s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:28:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:28:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:28:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:28:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:28:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:28:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:28:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:28:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:28:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:28:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:28:31 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:28:32 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:28:33 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:28:33 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 15:28:33 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Rebuilding the list of instances to heal {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 15:28:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-09177e97-5848-4d1d-a998-438bfaddb73c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:28:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-09177e97-5848-4d1d-a998-438bfaddb73c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:28:33 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 15:28:33 user nova-compute[72239]: DEBUG nova.objects.instance [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lazy-loading 'info_cache' on Instance uuid 09177e97-5848-4d1d-a998-438bfaddb73c {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:28:33 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Updating instance_info_cache with network_info: [{"id": "bd765857-52dd-419a-84e4-611a7bdbb0db", "address": "fa:16:3e:28:7e:24", "network": {"id": "83f220fa-06f9-40dd-8cc8-329ec73063ec", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1755302406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b66f633b14b48ada4e1d8b20da967df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd765857-52", "ovs_interfaceid": "bd765857-52dd-419a-84e4-611a7bdbb0db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:28:33 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-09177e97-5848-4d1d-a998-438bfaddb73c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:28:33 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 15:28:33 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:28:34 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:28:34 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:28:35 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:28:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:28:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:28:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:28:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:28:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:28:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:28:39 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:28:39 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:28:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:28:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:28:39 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:28:39 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 15:28:39 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:28:39 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:28:39 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:28:39 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:28:40 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:28:40 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:28:40 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=8805MB free_disk=25.088829040527344GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 15:28:40 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:28:40 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:28:40 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 09177e97-5848-4d1d-a998-438bfaddb73c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:28:40 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 15:28:40 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 15:28:40 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:28:40 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:28:40 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 15:28:40 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:28:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:28:42 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:28:42 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:28:42 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 15:28:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:28:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:28:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:28:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:28:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:28:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:28:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:28:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:28:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Acquiring lock "09177e97-5848-4d1d-a998-438bfaddb73c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:28:59 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "09177e97-5848-4d1d-a998-438bfaddb73c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:28:59 user nova-compute[72239]: DEBUG nova.objects.instance [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lazy-loading 'flavor' on Instance uuid 09177e97-5848-4d1d-a998-438bfaddb73c {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:29:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "09177e97-5848-4d1d-a998-438bfaddb73c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:29:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Acquiring lock "09177e97-5848-4d1d-a998-438bfaddb73c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:29:00 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "09177e97-5848-4d1d-a998-438bfaddb73c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:29:00 user nova-compute[72239]: INFO nova.compute.manager [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Attaching volume 18cd2920-c4a3-47c3-a13d-98e799d7b5f7 to /dev/vdb
Jul 31 15:29:00 user nova-compute[72239]: DEBUG os_brick.utils [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:29:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:29:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:29:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee1d9970-f032-4246-a731-6e8007a6dce5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:29:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:29:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:29:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[def263a5-ed06-4916-906b-b24b1385af77]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:29:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:29:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:29:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5bd6c6f-d4b6-43c6-8a25-26606ff9425b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:29:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[98c597e4-1e24-44b6-947d-88a264a80c1b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:29:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:29:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:29:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 15:29:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:29:00 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:29:00 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 15:29:00 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dac14e0-302c-4ed9-adc2-9e5223405aeb]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:29:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 15:29:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 15:29:00 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 15:29:00 user nova-compute[72239]: DEBUG os_brick.utils [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:29:00 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Updating existing volume attachment record: 6e33e2c9-5e52-4c10-94b5-bd7531296188 {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 15:29:00 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:29:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rKkSwqlQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:29:07 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:29:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:29:07 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:29:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:29:07 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 15:29:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7 -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[335557eb-07e0-43a7-93e5-b2fde3bb6fad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 15:29:07 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf122a2-f60f-4162-81d2-63872f973223]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7] added
Jul 31 15:29:07 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ddfcb7-f87c-4856-b1c0-fde8e51bd8f0]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0242507-50a6-41db-ab0c-7732fbddebe0]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rKkSwqlQ {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rKkSwqlQ" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7066eb01-13ca-492d-92c0-15f5dde1d276]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rKkSwqlQ'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a9db70-9ef0-434c-8515-578e43da11df]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[51eb0342-66f2-4565-970d-5c6b3c5a9e58]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 15:29:07 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 15:29:07 user nova-compute[72239]:  {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:29:07 user nova-compute[72239]: WARNING os_brick.initiator.connectors.iscsi [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 15:29:07 user nova-compute[72239]: 
Jul 31 15:29:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7 -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b7b24a-f46a-4e7e-b394-5411807fcffa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7, portal: 172.16.0.220,3260]
Jul 31 15:29:07 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7, portal: 172.16.0.220,3260] successful.
Jul 31 15:29:07 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb35dc91-08d0-4674-a165-cacbc46d207d]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3134ae-2176-4508-8379-cac89fd63fcf]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7 (non-flash)
Jul 31 15:29:07 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7 (non-flash)
Jul 31 15:29:07 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7eb36f-75cf-46f4-aaba-63c183a08e83]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 15:29:07 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rKkSwqlQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 15:29:08 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.278s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:29:08 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] <== connect_volume: return (1280ms) {'type': 'block', 'scsi_wwn': '23539386430383633', 'path': '/dev/sdb'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:29:08 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23539386430383633', 'path': '/dev/sdb'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 15:29:08 user nova-compute[72239]: DEBUG nova.objects.instance [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lazy-loading 'flavor' on Instance uuid 09177e97-5848-4d1d-a998-438bfaddb73c {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:29:08 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 15:29:08 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:29:08 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 15:29:08 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 15:29:08 user nova-compute[72239]:   <serial>18cd2920-c4a3-47c3-a13d-98e799d7b5f7</serial>
Jul 31 15:29:08 user nova-compute[72239]: </disk>
Jul 31 15:29:08 user nova-compute[72239]:  {{(pid=72239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 15:29:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:29:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:29:09 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] No VIF found with MAC fa:16:3e:28:7e:24, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 15:29:09 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-ef220676-340b-404d-82db-441649bf3607 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "09177e97-5848-4d1d-a998-438bfaddb73c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.942s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:29:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:29:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b3d67567-e414-44f2-a53d-afb2aa3e650d tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Acquiring lock "09177e97-5848-4d1d-a998-438bfaddb73c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:29:11 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b3d67567-e414-44f2-a53d-afb2aa3e650d tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "09177e97-5848-4d1d-a998-438bfaddb73c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:29:11 user nova-compute[72239]: INFO nova.compute.manager [None req-b3d67567-e414-44f2-a53d-afb2aa3e650d tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Detaching volume 18cd2920-c4a3-47c3-a13d-98e799d7b5f7
Jul 31 15:29:11 user nova-compute[72239]: INFO nova.virt.block_device [None req-b3d67567-e414-44f2-a53d-afb2aa3e650d tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Attempting to driver detach volume 18cd2920-c4a3-47c3-a13d-98e799d7b5f7 from mountpoint /dev/vdb
Jul 31 15:29:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b3d67567-e414-44f2-a53d-afb2aa3e650d tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Attempting to detach device vdb from instance 09177e97-5848-4d1d-a998-438bfaddb73c from the persistent domain config. {{(pid=72239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 15:29:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-b3d67567-e414-44f2-a53d-afb2aa3e650d tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 15:29:11 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:29:11 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 15:29:11 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 15:29:11 user nova-compute[72239]:   <serial>18cd2920-c4a3-47c3-a13d-98e799d7b5f7</serial>
Jul 31 15:29:11 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 15:29:11 user nova-compute[72239]: </disk>
Jul 31 15:29:11 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 15:29:11 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-b3d67567-e414-44f2-a53d-afb2aa3e650d tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Successfully detached device vdb from instance 09177e97-5848-4d1d-a998-438bfaddb73c from the persistent domain config.
Jul 31 15:29:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b3d67567-e414-44f2-a53d-afb2aa3e650d tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 09177e97-5848-4d1d-a998-438bfaddb73c from the live domain config. {{(pid=72239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 15:29:11 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-b3d67567-e414-44f2-a53d-afb2aa3e650d tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 15:29:11 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:29:11 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 15:29:11 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 15:29:11 user nova-compute[72239]:   <serial>18cd2920-c4a3-47c3-a13d-98e799d7b5f7</serial>
Jul 31 15:29:11 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 15:29:11 user nova-compute[72239]: </disk>
Jul 31 15:29:11 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Received event <DeviceRemovedEvent: 1690817352.0946972, 09177e97-5848-4d1d-a998-438bfaddb73c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72239) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-b3d67567-e414-44f2-a53d-afb2aa3e650d tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 09177e97-5848-4d1d-a998-438bfaddb73c {{(pid=72239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 15:29:12 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-b3d67567-e414-44f2-a53d-afb2aa3e650d tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Successfully detached device vdb from instance 09177e97-5848-4d1d-a998-438bfaddb73c from the live domain config.
Jul 31 15:29:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3d67567-e414-44f2-a53d-afb2aa3e650d tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d67567-e414-44f2-a53d-afb2aa3e650d tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rKkSwqlQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:29:12 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-b3d67567-e414-44f2-a53d-afb2aa3e650d tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:29:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-b3d67567-e414-44f2-a53d-afb2aa3e650d tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-b3d67567-e414-44f2-a53d-afb2aa3e650d tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d67567-e414-44f2-a53d-afb2aa3e650d tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb33dd7-519d-42b4-b1df-b9b4d30b513f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fbf96c-9958-427c-9801-4adcb9bcf173]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d67567-e414-44f2-a53d-afb2aa3e650d tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7 (non-flash)
Jul 31 15:29:12 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d67567-e414-44f2-a53d-afb2aa3e650d tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7 (non-flash)
Jul 31 15:29:12 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d67567-e414-44f2-a53d-afb2aa3e650d tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f41007f2e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7'): ({'sdb'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-b3d67567-e414-44f2-a53d-afb2aa3e650d tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Removing single pathed devices sdb {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[db22bbb9-8ac5-4359-9f11-de6a93066b1a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c70e7b1-2225-4684-9ed4-198dc2f9b84c]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-b3d67567-e414-44f2-a53d-afb2aa3e650d tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Flushing IO for device /dev/sdb {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4883f6b-e6d0-4547-aa76-ea6b19c8bc57]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-b3d67567-e414-44f2-a53d-afb2aa3e650d tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[26086a4b-5e8d-4451-8f4e-9fefbf8b3cc0]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-b3d67567-e414-44f2-a53d-afb2aa3e650d tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-b3d67567-e414-44f2-a53d-afb2aa3e650d tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d67567-e414-44f2-a53d-afb2aa3e650d tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[296f59f7-b4ed-4452-8306-54ce3ad5fae4]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d67567-e414-44f2-a53d-afb2aa3e650d tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7 -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdafdcc0-319c-4e90-89cc-014413e34816]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d67567-e414-44f2-a53d-afb2aa3e650d tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7, portal: 172.16.0.220,3260]
Jul 31 15:29:12 user nova-compute[72239]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7, portal: 172.16.0.220,3260] successful.
Jul 31 15:29:12 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7 -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:18cd2920-c4a3-47c3-a13d-98e799d7b5f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac63d69-0477-47e7-82ae-2fa1ef60bf0f]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d67567-e414-44f2-a53d-afb2aa3e650d tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-b3d67567-e414-44f2-a53d-afb2aa3e650d tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.254s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-b3d67567-e414-44f2-a53d-afb2aa3e650d tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] <== disconnect_volume: return (255ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:29:12 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b3d67567-e414-44f2-a53d-afb2aa3e650d tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 15:29:13 user nova-compute[72239]: DEBUG nova.objects.instance [None req-b3d67567-e414-44f2-a53d-afb2aa3e650d tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lazy-loading 'flavor' on Instance uuid 09177e97-5848-4d1d-a998-438bfaddb73c {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:29:13 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-b3d67567-e414-44f2-a53d-afb2aa3e650d tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "09177e97-5848-4d1d-a998-438bfaddb73c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.665s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:29:15 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:29:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:29:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:29:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:29:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:29:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:29:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:29:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:29:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:29:32 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:29:32 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:29:34 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:29:34 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:29:35 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:29:35 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 15:29:35 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Rebuilding the list of instances to heal {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 15:29:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-09177e97-5848-4d1d-a998-438bfaddb73c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:29:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-09177e97-5848-4d1d-a998-438bfaddb73c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:29:35 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 15:29:35 user nova-compute[72239]: DEBUG nova.objects.instance [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lazy-loading 'info_cache' on Instance uuid 09177e97-5848-4d1d-a998-438bfaddb73c {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:29:35 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Updating instance_info_cache with network_info: [{"id": "bd765857-52dd-419a-84e4-611a7bdbb0db", "address": "fa:16:3e:28:7e:24", "network": {"id": "83f220fa-06f9-40dd-8cc8-329ec73063ec", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1755302406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b66f633b14b48ada4e1d8b20da967df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd765857-52", "ovs_interfaceid": "bd765857-52dd-419a-84e4-611a7bdbb0db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:29:35 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-09177e97-5848-4d1d-a998-438bfaddb73c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:29:35 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 15:29:36 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:29:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:29:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:29:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:29:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:29:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:29:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:29:37 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:29:40 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:29:40 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:29:40 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:29:40 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:29:40 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 15:29:40 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:29:40 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:29:40 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:29:40 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:29:41 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:29:41 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:29:41 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=8814MB free_disk=25.087871551513672GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 15:29:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:29:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:29:41 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 09177e97-5848-4d1d-a998-438bfaddb73c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:29:41 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 15:29:41 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 15:29:41 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:29:41 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:29:41 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 15:29:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.182s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:29:42 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:29:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:29:42 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:29:42 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 15:29:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:29:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:29:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:29:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:29:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:29:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:29:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:29:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:29:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:29:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:29:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:29:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:29:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:30:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:30:05 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:30:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Acquiring lock "09177e97-5848-4d1d-a998-438bfaddb73c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:30:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "09177e97-5848-4d1d-a998-438bfaddb73c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:30:05 user nova-compute[72239]: DEBUG nova.objects.instance [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lazy-loading 'flavor' on Instance uuid 09177e97-5848-4d1d-a998-438bfaddb73c {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:30:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "09177e97-5848-4d1d-a998-438bfaddb73c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:30:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Acquiring lock "09177e97-5848-4d1d-a998-438bfaddb73c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:30:05 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "09177e97-5848-4d1d-a998-438bfaddb73c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:30:05 user nova-compute[72239]: INFO nova.compute.manager [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Attaching volume d0e47a04-443c-48de-81c1-15102702aceb to /dev/vdb
Jul 31 15:30:05 user nova-compute[72239]: DEBUG os_brick.utils [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:30:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:30:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:30:05 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadf5d60-6935-4d63-b869-83ea1807b8c2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:30:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:30:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:30:05 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db67f19-a702-4024-ad34-f82e06c3c496]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:30:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:30:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:30:05 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c85eeb-1d32-4600-a54f-66fb7fba6410]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:30:05 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcd3ab4-159b-453f-b56e-ad64ef1df5e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:30:05 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:30:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:30:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 15:30:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:30:06 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:30:06 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 15:30:06 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c856c03-08a7-45f6-886a-89206f1ba4c7]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:30:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 15:30:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 15:30:06 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 15:30:06 user nova-compute[72239]: DEBUG os_brick.utils [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:30:06 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Updating existing volume attachment record: 991676bf-509e-4a7b-80cc-6ec766908c9f {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 15:30:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:30:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:30:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uVMbYxKS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:30:13 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:30:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:30:13 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:30:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:30:13 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 15:30:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64a43c6-d80e-4884-99b8-555b9379ba31]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 15:30:13 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7aa723-b995-4bee-8073-04d01940b850]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb] added
Jul 31 15:30:13 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed944dc9-b27b-4fcc-9546-a1944aa063f9]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[938a1f89-4fcf-4ea4-9ccb-0a5fd9a762dc]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uVMbYxKS {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uVMbYxKS" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[afae3ae4-6046-4bcc-bb3d-f8f90a7e10d4]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uVMbYxKS'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d4a9df-4370-4c92-8a52-5cb7909a8a6f]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[848e120f-b149-4b25-a4bc-e09aa7e982f5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 15:30:13 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 15:30:13 user nova-compute[72239]:  {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:30:13 user nova-compute[72239]: WARNING os_brick.initiator.connectors.iscsi [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 15:30:13 user nova-compute[72239]: 
Jul 31 15:30:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4d5462-773c-4692-85f1-9e19a0b3e6db]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb, portal: 172.16.0.220,3260]
Jul 31 15:30:13 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb, portal: 172.16.0.220,3260] successful.
Jul 31 15:30:13 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46e563e-1655-469b-84d4-7e2214fb2c41]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a51262-2f9a-4101-b9e6-4e2b49b8eeca]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb (non-flash)
Jul 31 15:30:13 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb (non-flash)
Jul 31 15:30:13 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.238s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[342468c0-5211-4c8f-896a-70ebc64d354a]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 15:30:13 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uVMbYxKS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 15:30:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.271s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:30:14 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] <== connect_volume: return (1273ms) {'type': 'block', 'scsi_wwn': '26437323539333636', 'path': '/dev/sdb'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:30:14 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26437323539333636', 'path': '/dev/sdb'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 15:30:14 user nova-compute[72239]: DEBUG nova.objects.instance [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lazy-loading 'flavor' on Instance uuid 09177e97-5848-4d1d-a998-438bfaddb73c {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:30:14 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 15:30:14 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:30:14 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 15:30:14 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 15:30:14 user nova-compute[72239]:   <serial>d0e47a04-443c-48de-81c1-15102702aceb</serial>
Jul 31 15:30:14 user nova-compute[72239]: </disk>
Jul 31 15:30:14 user nova-compute[72239]:  {{(pid=72239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 15:30:14 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:30:14 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:30:14 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] No VIF found with MAC fa:16:3e:28:7e:24, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 15:30:14 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-621badf1-a022-47af-9bc2-1a270145b60e tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "09177e97-5848-4d1d-a998-438bfaddb73c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.127s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-59e0d49c-4f96-4bf8-8153-a423ca7786f0 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Acquiring lock "09177e97-5848-4d1d-a998-438bfaddb73c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-59e0d49c-4f96-4bf8-8153-a423ca7786f0 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "09177e97-5848-4d1d-a998-438bfaddb73c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:30:17 user nova-compute[72239]: INFO nova.compute.manager [None req-59e0d49c-4f96-4bf8-8153-a423ca7786f0 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Detaching volume d0e47a04-443c-48de-81c1-15102702aceb
Jul 31 15:30:17 user nova-compute[72239]: INFO nova.virt.block_device [None req-59e0d49c-4f96-4bf8-8153-a423ca7786f0 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Attempting to driver detach volume d0e47a04-443c-48de-81c1-15102702aceb from mountpoint /dev/vdb
Jul 31 15:30:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-59e0d49c-4f96-4bf8-8153-a423ca7786f0 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Attempting to detach device vdb from instance 09177e97-5848-4d1d-a998-438bfaddb73c from the persistent domain config. {{(pid=72239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-59e0d49c-4f96-4bf8-8153-a423ca7786f0 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 15:30:17 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:30:17 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 15:30:17 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 15:30:17 user nova-compute[72239]:   <serial>d0e47a04-443c-48de-81c1-15102702aceb</serial>
Jul 31 15:30:17 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 15:30:17 user nova-compute[72239]: </disk>
Jul 31 15:30:17 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 15:30:17 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-59e0d49c-4f96-4bf8-8153-a423ca7786f0 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Successfully detached device vdb from instance 09177e97-5848-4d1d-a998-438bfaddb73c from the persistent domain config.
Jul 31 15:30:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-59e0d49c-4f96-4bf8-8153-a423ca7786f0 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 09177e97-5848-4d1d-a998-438bfaddb73c from the live domain config. {{(pid=72239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-59e0d49c-4f96-4bf8-8153-a423ca7786f0 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 15:30:17 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:30:17 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 15:30:17 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 15:30:17 user nova-compute[72239]:   <serial>d0e47a04-443c-48de-81c1-15102702aceb</serial>
Jul 31 15:30:17 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 15:30:17 user nova-compute[72239]: </disk>
Jul 31 15:30:17 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Received event <DeviceRemovedEvent: 1690817417.7022386, 09177e97-5848-4d1d-a998-438bfaddb73c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72239) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-59e0d49c-4f96-4bf8-8153-a423ca7786f0 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 09177e97-5848-4d1d-a998-438bfaddb73c {{(pid=72239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 15:30:17 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-59e0d49c-4f96-4bf8-8153-a423ca7786f0 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Successfully detached device vdb from instance 09177e97-5848-4d1d-a998-438bfaddb73c from the live domain config.
Jul 31 15:30:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59e0d49c-4f96-4bf8-8153-a423ca7786f0 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e0d49c-4f96-4bf8-8153-a423ca7786f0 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uVMbYxKS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:30:17 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-59e0d49c-4f96-4bf8-8153-a423ca7786f0 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:30:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-59e0d49c-4f96-4bf8-8153-a423ca7786f0 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-59e0d49c-4f96-4bf8-8153-a423ca7786f0 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e0d49c-4f96-4bf8-8153-a423ca7786f0 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ce93c7-d75c-4292-b84f-3e33ba44e0f2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e263e48-6afc-4770-9d67-84e64f3502e8]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e0d49c-4f96-4bf8-8153-a423ca7786f0 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb (non-flash)
Jul 31 15:30:17 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e0d49c-4f96-4bf8-8153-a423ca7786f0 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb (non-flash)
Jul 31 15:30:17 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e0d49c-4f96-4bf8-8153-a423ca7786f0 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4120154160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb'): ({'sdb'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-59e0d49c-4f96-4bf8-8153-a423ca7786f0 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Removing single pathed devices sdb {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[102c64eb-fd2d-4e2c-ac00-59070ea81bdb]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d85a835-3b97-413f-9823-502e397e389c]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-59e0d49c-4f96-4bf8-8153-a423ca7786f0 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Flushing IO for device /dev/sdb {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19010c0-1185-487e-9637-c46303f6f0a2]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-59e0d49c-4f96-4bf8-8153-a423ca7786f0 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa46e89-3c24-4c65-9b13-f4825d58f3e1]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-59e0d49c-4f96-4bf8-8153-a423ca7786f0 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-59e0d49c-4f96-4bf8-8153-a423ca7786f0 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e0d49c-4f96-4bf8-8153-a423ca7786f0 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50c1694-7823-4bf7-b9c5-57c7b0c674f1]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e0d49c-4f96-4bf8-8153-a423ca7786f0 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[360432a6-cd89-4e1f-9df1-d2a3cc9d3dfa]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e0d49c-4f96-4bf8-8153-a423ca7786f0 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb, portal: 172.16.0.220,3260]
Jul 31 15:30:17 user nova-compute[72239]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb, portal: 172.16.0.220,3260] successful.
Jul 31 15:30:17 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0e47a04-443c-48de-81c1-15102702aceb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5351252f-7ed7-469e-a153-703d13818708]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e0d49c-4f96-4bf8-8153-a423ca7786f0 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-59e0d49c-4f96-4bf8-8153-a423ca7786f0 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.245s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-59e0d49c-4f96-4bf8-8153-a423ca7786f0 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] <== disconnect_volume: return (246ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:30:17 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-59e0d49c-4f96-4bf8-8153-a423ca7786f0 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 15:30:18 user nova-compute[72239]: DEBUG nova.objects.instance [None req-59e0d49c-4f96-4bf8-8153-a423ca7786f0 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lazy-loading 'flavor' on Instance uuid 09177e97-5848-4d1d-a998-438bfaddb73c {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:30:18 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-59e0d49c-4f96-4bf8-8153-a423ca7786f0 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "09177e97-5848-4d1d-a998-438bfaddb73c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.616s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:30:20 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:30:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:30:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:30:32 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:30:32 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:30:35 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:30:36 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:30:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:30:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:30:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:30:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:30:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:30:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:30:37 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:30:37 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:30:37 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 15:30:37 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Rebuilding the list of instances to heal {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 15:30:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-09177e97-5848-4d1d-a998-438bfaddb73c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:30:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-09177e97-5848-4d1d-a998-438bfaddb73c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:30:37 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 15:30:37 user nova-compute[72239]: DEBUG nova.objects.instance [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lazy-loading 'info_cache' on Instance uuid 09177e97-5848-4d1d-a998-438bfaddb73c {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:30:38 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Updating instance_info_cache with network_info: [{"id": "bd765857-52dd-419a-84e4-611a7bdbb0db", "address": "fa:16:3e:28:7e:24", "network": {"id": "83f220fa-06f9-40dd-8cc8-329ec73063ec", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1755302406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b66f633b14b48ada4e1d8b20da967df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd765857-52", "ovs_interfaceid": "bd765857-52dd-419a-84e4-611a7bdbb0db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:30:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-09177e97-5848-4d1d-a998-438bfaddb73c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:30:38 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 15:30:38 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:30:41 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:30:41 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:30:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:30:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:30:41 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:30:41 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 15:30:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:30:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:30:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:30:41 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:30:42 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:30:42 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:30:42 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=8811MB free_disk=25.086814880371094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 15:30:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:30:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:30:42 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 09177e97-5848-4d1d-a998-438bfaddb73c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:30:42 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 15:30:42 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 15:30:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:30:42 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Refreshing inventories for resource provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 31 15:30:42 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Updating ProviderTree inventory for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 31 15:30:42 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Updating inventory in ProviderTree for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 31 15:30:42 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Refreshing aggregate associations for resource provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e, aggregates: None {{(pid=72239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 31 15:30:42 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Refreshing trait associations for resource provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e, traits: COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_TRUSTED_CERTS,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSE42,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NODE,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_GRAPHICS_MODEL_VGA,HW_CPU_X86_SSE41,COMPUTE_STORAGE_BUS_FDC,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_IMAGE_TYPE_ARI {{(pid=72239) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 31 15:30:42 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:30:42 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:30:42 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 15:30:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.406s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:30:43 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:30:43 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 15:30:44 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:30:44 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Cleaning up deleted instances {{(pid=72239) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 31 15:30:44 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] There are 0 instances to clean {{(pid=72239) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 31 15:30:45 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:30:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:30:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:30:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:31:01 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:31:01 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Cleaning up deleted instances with incomplete migration  {{(pid=72239) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 31 15:31:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:31:05 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:31:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:31:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:31:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:31:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:31:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:31:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:31:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Acquiring lock "09177e97-5848-4d1d-a998-438bfaddb73c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:31:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "09177e97-5848-4d1d-a998-438bfaddb73c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:31:10 user nova-compute[72239]: DEBUG nova.objects.instance [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lazy-loading 'flavor' on Instance uuid 09177e97-5848-4d1d-a998-438bfaddb73c {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:31:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "09177e97-5848-4d1d-a998-438bfaddb73c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:31:10 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:31:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Acquiring lock "09177e97-5848-4d1d-a998-438bfaddb73c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:31:10 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "09177e97-5848-4d1d-a998-438bfaddb73c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:31:10 user nova-compute[72239]: INFO nova.compute.manager [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Attaching volume 9e02ab81-1efb-47cd-9be6-6e71b5759c39 to /dev/vdb
Jul 31 15:31:10 user nova-compute[72239]: DEBUG os_brick.utils [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:31:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:31:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:31:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fe6c910-7eba-4adf-984f-aeaf0b181d83]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:46e426a7cd\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:31:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:31:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:31:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec565b95-17f4-4ed2-95f3-1fab8ebad971]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:31:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:31:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:31:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[964684ac-30ca-4d32-9422-7be9bc1ec23a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:31:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a26a89-4102-4fff-9a05-9593f00d8b61]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:31:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Running cmd (subprocess): nvme version {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:31:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] 'nvme version' failed. Not Retrying. {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:31:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.nvmeof [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] nvme not present on system {{(pid=72239) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 31 15:31:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:31:10 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 31 15:31:10 user nova-compute[72239]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 31 15:31:10 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[92418c4e-8b0e-46fd-a30f-02f9fd29dc28]: (4, '') {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:31:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=72239) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 31 15:31:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 31 15:31:10 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.lightos [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] LIGHTOS: no hostnqn found. {{(pid=72239) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 31 15:31:10 user nova-compute[72239]: DEBUG os_brick.utils [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:46e426a7cd', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:31:10 user nova-compute[72239]: DEBUG nova.virt.block_device [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Updating existing volume attachment record: da2ddf17-590b-4b6d-922c-06723dfd908a {{(pid=72239) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 31 15:31:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:31:15 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._sync_power_states {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:31:15 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Triggering sync for uuid 09177e97-5848-4d1d-a998-438bfaddb73c {{(pid=72239) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 31 15:31:15 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "09177e97-5848-4d1d-a998-438bfaddb73c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:31:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Calling os-brick to attach iSCSI Volume {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mwKodaQh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:31:22 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:31:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:31:22 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:31:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:31:22 user nova-compute[72239]: INFO os_brick.initiator.connectors.iscsi [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 31 15:31:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39 -p 172.16.0.220:3260 {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c590b80a-f049-4fcb-bcd2-ff3af3f9044d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 31 15:31:22 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39 -p 172.16.0.220:3260 --interface default --op new {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91606bc-11fe-4483-aa32-a29e0f5c1eb4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39] added\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39] added
Jul 31 15:31:22 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[1135d305-1740-41dc-b827-dc59ba52babe]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2128a6d9-bde7-47a4-a7a4-9d54af19f2a5]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mwKodaQh {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mwKodaQh" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[2817293e-6f4a-4ced-96a0-abc6d449aa7f]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mwKodaQh'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f0edf0-b7ed-4e6f-bb05-4d6f77b46de5]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd1205e2-d259-4b2f-8af7-7e671fb243a9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 31 15:31:22 user nova-compute[72239]:  {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 31 15:31:22 user nova-compute[72239]:  {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:31:22 user nova-compute[72239]: WARNING os_brick.initiator.connectors.iscsi [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 31 15:31:22 user nova-compute[72239]: 
Jul 31 15:31:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39 -p 172.16.0.220:3260 --login {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c9df8a-0915-469a-a015-ce4f86dcfaee]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39, portal: 172.16.0.220,3260]
Jul 31 15:31:22 user nova-compute[72239]: Login to [iface: default, target: iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39, portal: 172.16.0.220,3260] successful.
Jul 31 15:31:22 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[6145a136-cde8-4b09-aba9-1ac8f1197a63]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7651c13-a7f0-403a-9750-2940704e03bd]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39 (non-flash)
Jul 31 15:31:22 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39 (non-flash)
Jul 31 15:31:22 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.235s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Connected to 172.16.0.220:3260 {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=72239) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=72239) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[da06f7d5-004d-4319-8ece-2f4c38f5efbe]: (4, ('- - 0', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:31:22 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 15:31:23 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=72239) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 31 15:31:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mwKodaQh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=72239) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 31 15:31:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.265s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:31:23 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] <== connect_volume: return (1266ms) {'type': 'block', 'scsi_wwn': '26630343866653831', 'path': '/dev/sdb'} {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:31:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630343866653831', 'path': '/dev/sdb'} {{(pid=72239) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 31 15:31:23 user nova-compute[72239]: DEBUG nova.objects.instance [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lazy-loading 'flavor' on Instance uuid 09177e97-5848-4d1d-a998-438bfaddb73c {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:31:23 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] attach device xml: <disk type="block" device="disk">
Jul 31 15:31:23 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:31:23 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 15:31:23 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 15:31:23 user nova-compute[72239]:   <serial>9e02ab81-1efb-47cd-9be6-6e71b5759c39</serial>
Jul 31 15:31:23 user nova-compute[72239]: </disk>
Jul 31 15:31:23 user nova-compute[72239]:  {{(pid=72239) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 31 15:31:24 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] No BDM found with device name vda, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:31:24 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] No BDM found with device name vdb, not building metadata. {{(pid=72239) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 31 15:31:24 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] No VIF found with MAC fa:16:3e:28:7e:24, not building metadata {{(pid=72239) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 31 15:31:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-03dbc44b-0324-40a8-b874-05f689794fd9 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "09177e97-5848-4d1d-a998-438bfaddb73c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.677s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:31:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "09177e97-5848-4d1d-a998-438bfaddb73c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 9.016s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:31:24 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "09177e97-5848-4d1d-a998-438bfaddb73c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:31:25 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c7acdaad-a46d-4e0b-9d98-2a7a8aea81d6 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Acquiring lock "09177e97-5848-4d1d-a998-438bfaddb73c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c7acdaad-a46d-4e0b-9d98-2a7a8aea81d6 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "09177e97-5848-4d1d-a998-438bfaddb73c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:31:26 user nova-compute[72239]: INFO nova.compute.manager [None req-c7acdaad-a46d-4e0b-9d98-2a7a8aea81d6 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Detaching volume 9e02ab81-1efb-47cd-9be6-6e71b5759c39
Jul 31 15:31:26 user nova-compute[72239]: INFO nova.virt.block_device [None req-c7acdaad-a46d-4e0b-9d98-2a7a8aea81d6 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Attempting to driver detach volume 9e02ab81-1efb-47cd-9be6-6e71b5759c39 from mountpoint /dev/vdb
Jul 31 15:31:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-c7acdaad-a46d-4e0b-9d98-2a7a8aea81d6 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Attempting to detach device vdb from instance 09177e97-5848-4d1d-a998-438bfaddb73c from the persistent domain config. {{(pid=72239) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-c7acdaad-a46d-4e0b-9d98-2a7a8aea81d6 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 15:31:26 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:31:26 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 15:31:26 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 15:31:26 user nova-compute[72239]:   <serial>9e02ab81-1efb-47cd-9be6-6e71b5759c39</serial>
Jul 31 15:31:26 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 15:31:26 user nova-compute[72239]: </disk>
Jul 31 15:31:26 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 15:31:26 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-c7acdaad-a46d-4e0b-9d98-2a7a8aea81d6 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Successfully detached device vdb from instance 09177e97-5848-4d1d-a998-438bfaddb73c from the persistent domain config.
Jul 31 15:31:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-c7acdaad-a46d-4e0b-9d98-2a7a8aea81d6 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 09177e97-5848-4d1d-a998-438bfaddb73c from the live domain config. {{(pid=72239) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.guest [None req-c7acdaad-a46d-4e0b-9d98-2a7a8aea81d6 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] detach device xml: <disk type="block" device="disk">
Jul 31 15:31:26 user nova-compute[72239]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 31 15:31:26 user nova-compute[72239]:   <source dev="/dev/sdb"/>
Jul 31 15:31:26 user nova-compute[72239]:   <target dev="vdb" bus="virtio"/>
Jul 31 15:31:26 user nova-compute[72239]:   <serial>9e02ab81-1efb-47cd-9be6-6e71b5759c39</serial>
Jul 31 15:31:26 user nova-compute[72239]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 31 15:31:26 user nova-compute[72239]: </disk>
Jul 31 15:31:26 user nova-compute[72239]:  {{(pid=72239) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-30fe382c-d17e-4cfa-8606-29587aee98b6 None None] Received event <DeviceRemovedEvent: 1690817486.7354057, 09177e97-5848-4d1d-a998-438bfaddb73c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=72239) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.driver [None req-c7acdaad-a46d-4e0b-9d98-2a7a8aea81d6 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 09177e97-5848-4d1d-a998-438bfaddb73c {{(pid=72239) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 31 15:31:26 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-c7acdaad-a46d-4e0b-9d98-2a7a8aea81d6 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Successfully detached device vdb from instance 09177e97-5848-4d1d-a998-438bfaddb73c from the live domain config.
Jul 31 15:31:26 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7acdaad-a46d-4e0b-9d98-2a7a8aea81d6 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] calling os-brick to detach iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7acdaad-a46d-4e0b-9d98-2a7a8aea81d6 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f4120163430>, {'target_iqns': ['iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mwKodaQh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 31 15:31:26 user nova-compute[72239]: WARNING os_brick.initiator.connectors.base [None req-c7acdaad-a46d-4e0b-9d98-2a7a8aea81d6 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 31 15:31:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-c7acdaad-a46d-4e0b-9d98-2a7a8aea81d6 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-c7acdaad-a46d-4e0b-9d98-2a7a8aea81d6 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7acdaad-a46d-4e0b-9d98-2a7a8aea81d6 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39', 0)] {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbbb690-6c87-49df-80e8-8aada9c35ab0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[94683a39-ec61-4b98-bc31-a0e891171615]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39 (non-flash)\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7acdaad-a46d-4e0b-9d98-2a7a8aea81d6 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39 (non-flash)
Jul 31 15:31:26 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7acdaad-a46d-4e0b-9d98-2a7a8aea81d6 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39 (non-flash)
Jul 31 15:31:26 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7acdaad-a46d-4e0b-9d98-2a7a8aea81d6 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f4120157130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39'): ({'sdb'}, set())}) {{(pid=72239) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-c7acdaad-a46d-4e0b-9d98-2a7a8aea81d6 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Removing single pathed devices sdb {{(pid=72239) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45c0743-2b33-43d1-b728-e7eebf46b643]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[5efa5f7e-79d4-4290-ba8e-3ed8ca937e0c]: (4, ('ok\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-c7acdaad-a46d-4e0b-9d98-2a7a8aea81d6 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Flushing IO for device /dev/sdb {{(pid=72239) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc02cb5-1f66-450b-86cd-21c72e9bdc54]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-c7acdaad-a46d-4e0b-9d98-2a7a8aea81d6 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=72239) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4937521-7cf3-4d77-91cb-ab5f59c18a2b]: (4, ('1', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-c7acdaad-a46d-4e0b-9d98-2a7a8aea81d6 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG os_brick.initiator.linuxscsi [None req-c7acdaad-a46d-4e0b-9d98-2a7a8aea81d6 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] SCSI volumes sdb have been removed. {{(pid=72239) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7acdaad-a46d-4e0b-9d98-2a7a8aea81d6 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39')] {{(pid=72239) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[468839c4-9ae7-4a42-abbf-33d21b29178e]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7acdaad-a46d-4e0b-9d98-2a7a8aea81d6 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39 -p 172.16.0.220:3260 --logout {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[82826a3d-d5a2-4c38-b9ed-74a4d91f10e8]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7acdaad-a46d-4e0b-9d98-2a7a8aea81d6 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39, portal: 172.16.0.220,3260]
Jul 31 15:31:26 user nova-compute[72239]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39, portal: 172.16.0.220,3260] successful.
Jul 31 15:31:26 user nova-compute[72239]:  stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:31:26 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39 -p 172.16.0.220:3260 --op delete {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:31:27 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9e02ab81-1efb-47cd-9be6-6e71b5759c39 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=83493) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:31:27 user nova-compute[72239]: DEBUG oslo.privsep.daemon [-] privsep: reply[9173bbb3-0ee9-4148-9567-54ab58e2d924]: (4, ('', '')) {{(pid=83493) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 31 15:31:27 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7acdaad-a46d-4e0b-9d98-2a7a8aea81d6 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=72239) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 31 15:31:27 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.base [None req-c7acdaad-a46d-4e0b-9d98-2a7a8aea81d6 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.265s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 31 15:31:27 user nova-compute[72239]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7acdaad-a46d-4e0b-9d98-2a7a8aea81d6 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] <== disconnect_volume: return (266ms) None {{(pid=72239) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 31 15:31:27 user nova-compute[72239]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7acdaad-a46d-4e0b-9d98-2a7a8aea81d6 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Disconnected iSCSI Volume {{(pid=72239) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 31 15:31:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:31:27 user nova-compute[72239]: DEBUG nova.objects.instance [None req-c7acdaad-a46d-4e0b-9d98-2a7a8aea81d6 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lazy-loading 'flavor' on Instance uuid 09177e97-5848-4d1d-a998-438bfaddb73c {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:31:27 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-c7acdaad-a46d-4e0b-9d98-2a7a8aea81d6 tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "09177e97-5848-4d1d-a998-438bfaddb73c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.581s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:31:30 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:31:32 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:31:32 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:31:36 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:31:37 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:31:37 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 15:31:37 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Rebuilding the list of instances to heal {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 15:31:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:31:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:31:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:31:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:31:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:31:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:31:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-09177e97-5848-4d1d-a998-438bfaddb73c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:31:37 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-09177e97-5848-4d1d-a998-438bfaddb73c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:31:37 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 15:31:37 user nova-compute[72239]: DEBUG nova.objects.instance [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lazy-loading 'info_cache' on Instance uuid 09177e97-5848-4d1d-a998-438bfaddb73c {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:31:38 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Updating instance_info_cache with network_info: [{"id": "bd765857-52dd-419a-84e4-611a7bdbb0db", "address": "fa:16:3e:28:7e:24", "network": {"id": "83f220fa-06f9-40dd-8cc8-329ec73063ec", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1755302406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b66f633b14b48ada4e1d8b20da967df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd765857-52", "ovs_interfaceid": "bd765857-52dd-419a-84e4-611a7bdbb0db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:31:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-09177e97-5848-4d1d-a998-438bfaddb73c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:31:38 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 15:31:38 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:31:39 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:31:40 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:31:42 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:31:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:31:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:31:42 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:31:42 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 15:31:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:31:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:31:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:31:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:31:42 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:31:43 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:31:43 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:31:43 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=8803MB free_disk=25.085784912109375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 15:31:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:31:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:31:43 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 09177e97-5848-4d1d-a998-438bfaddb73c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:31:43 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 15:31:43 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 15:31:43 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:31:43 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:31:43 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 15:31:43 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.171s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:31:44 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:31:44 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:31:44 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 15:31:47 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:31:52 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:31:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:31:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:31:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:31:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:31:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:31:57 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:32:02 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:32:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:32:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:32:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:32:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:32:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:32:07 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:32:12 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:32:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:32:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:32:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:32:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:32:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:32:17 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:32:22 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:32:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:32:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:32:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:32:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:32:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:32:27 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:32:32 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:32:32 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:32:32 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:32:32 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:32:32 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:32:32 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:32:32 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:32:37 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:32:37 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:32:38 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:32:38 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 15:32:38 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Rebuilding the list of instances to heal {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 15:32:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "refresh_cache-09177e97-5848-4d1d-a998-438bfaddb73c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 31 15:32:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquired lock "refresh_cache-09177e97-5848-4d1d-a998-438bfaddb73c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 31 15:32:38 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Forcefully refreshing network info cache for instance {{(pid=72239) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 31 15:32:38 user nova-compute[72239]: DEBUG nova.objects.instance [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lazy-loading 'info_cache' on Instance uuid 09177e97-5848-4d1d-a998-438bfaddb73c {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:32:38 user nova-compute[72239]: DEBUG nova.network.neutron [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Updating instance_info_cache with network_info: [{"id": "bd765857-52dd-419a-84e4-611a7bdbb0db", "address": "fa:16:3e:28:7e:24", "network": {"id": "83f220fa-06f9-40dd-8cc8-329ec73063ec", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1755302406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b66f633b14b48ada4e1d8b20da967df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd765857-52", "ovs_interfaceid": "bd765857-52dd-419a-84e4-611a7bdbb0db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:32:38 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Releasing lock "refresh_cache-09177e97-5848-4d1d-a998-438bfaddb73c" {{(pid=72239) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 31 15:32:38 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Updated the network info_cache for instance {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 31 15:32:39 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:32:39 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:32:42 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:32:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:32:44 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:32:44 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:32:44 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 15:32:44 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:32:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:32:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:32:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:32:44 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 15:32:44 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:32:44 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:32:44 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c/disk --force-share --output=json {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 31 15:32:44 user nova-compute[72239]: DEBUG oslo_concurrency.processutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=72239) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 31 15:32:45 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:32:45 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:32:45 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=8807MB free_disk=25.084835052490234GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 15:32:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:32:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:32:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-517171ad-6174-4d76-8899-d51908424d7f tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Acquiring lock "09177e97-5848-4d1d-a998-438bfaddb73c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:32:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-517171ad-6174-4d76-8899-d51908424d7f tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "09177e97-5848-4d1d-a998-438bfaddb73c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:32:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-517171ad-6174-4d76-8899-d51908424d7f tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Acquiring lock "09177e97-5848-4d1d-a998-438bfaddb73c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:32:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-517171ad-6174-4d76-8899-d51908424d7f tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "09177e97-5848-4d1d-a998-438bfaddb73c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:32:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-517171ad-6174-4d76-8899-d51908424d7f tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "09177e97-5848-4d1d-a998-438bfaddb73c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:32:45 user nova-compute[72239]: INFO nova.compute.manager [None req-517171ad-6174-4d76-8899-d51908424d7f tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Terminating instance
Jul 31 15:32:45 user nova-compute[72239]: DEBUG nova.compute.manager [None req-517171ad-6174-4d76-8899-d51908424d7f tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Start destroying the instance on the hypervisor. {{(pid=72239) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 31 15:32:45 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Instance 09177e97-5848-4d1d-a998-438bfaddb73c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=72239) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 31 15:32:45 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 15:32:45 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 15:32:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:32:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:32:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:32:45 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:32:45 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:32:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:32:45 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 15:32:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.285s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:32:45 user nova-compute[72239]: DEBUG nova.compute.manager [req-70055ae5-28ae-46d8-908c-ddd0de225961 req-01f24aa9-0a04-461f-9a8f-c926a70ded41 service nova] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Received event network-vif-unplugged-bd765857-52dd-419a-84e4-611a7bdbb0db {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:32:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-70055ae5-28ae-46d8-908c-ddd0de225961 req-01f24aa9-0a04-461f-9a8f-c926a70ded41 service nova] Acquiring lock "09177e97-5848-4d1d-a998-438bfaddb73c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:32:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-70055ae5-28ae-46d8-908c-ddd0de225961 req-01f24aa9-0a04-461f-9a8f-c926a70ded41 service nova] Lock "09177e97-5848-4d1d-a998-438bfaddb73c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:32:45 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-70055ae5-28ae-46d8-908c-ddd0de225961 req-01f24aa9-0a04-461f-9a8f-c926a70ded41 service nova] Lock "09177e97-5848-4d1d-a998-438bfaddb73c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:32:45 user nova-compute[72239]: DEBUG nova.compute.manager [req-70055ae5-28ae-46d8-908c-ddd0de225961 req-01f24aa9-0a04-461f-9a8f-c926a70ded41 service nova] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] No waiting events found dispatching network-vif-unplugged-bd765857-52dd-419a-84e4-611a7bdbb0db {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:32:45 user nova-compute[72239]: DEBUG nova.compute.manager [req-70055ae5-28ae-46d8-908c-ddd0de225961 req-01f24aa9-0a04-461f-9a8f-c926a70ded41 service nova] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Received event network-vif-unplugged-bd765857-52dd-419a-84e4-611a7bdbb0db for instance with task_state deleting. {{(pid=72239) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 31 15:32:45 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:32:45 user nova-compute[72239]: INFO nova.virt.libvirt.driver [-] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Instance destroyed successfully.
Jul 31 15:32:45 user nova-compute[72239]: DEBUG nova.objects.instance [None req-517171ad-6174-4d76-8899-d51908424d7f tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lazy-loading 'resources' on Instance uuid 09177e97-5848-4d1d-a998-438bfaddb73c {{(pid=72239) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 31 15:32:46 user nova-compute[72239]: DEBUG nova.virt.libvirt.vif [None req-517171ad-6174-4d76-8899-d51908424d7f tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-31T15:25:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1393909406',display_name='tempest-SnapshotDataIntegrityTests-server-1393909406',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1393909406',id=52,image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMddw161/Fe9E1fIvi2fKuwWlaAvMZfGBzbPaMGMnSJJaQ9yq4fnMmto5BJYS+ODbdqEXqqkY/9IeG0y4HyXAhuScdzvnfpwZVOH+6DV1XFlLTXfErBFM7iXlVKfDpE8fQ==',key_name='tempest-keypair-1472732451',keypairs=<?>,launch_index=0,launched_at=2023-07-31T15:25:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8b66f633b14b48ada4e1d8b20da967df',ramdisk_id='',reservation_id='r-gwfgvm2w',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c6afbfe5-0fbc-464d-978f-d1243b0a6ba8',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1913476977',owner_user_name='tempest-SnapshotDataIntegrityTests-1913476977-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-31T15:25:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='72fca748cce041cf81dd0d876b05d0d1',uuid=09177e97-5848-4d1d-a998-438bfaddb73c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd765857-52dd-419a-84e4-611a7bdbb0db", "address": "fa:16:3e:28:7e:24", "network": {"id": "83f220fa-06f9-40dd-8cc8-329ec73063ec", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1755302406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b66f633b14b48ada4e1d8b20da967df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd765857-52", "ovs_interfaceid": "bd765857-52dd-419a-84e4-611a7bdbb0db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 31 15:32:46 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-517171ad-6174-4d76-8899-d51908424d7f tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Converting VIF {"id": "bd765857-52dd-419a-84e4-611a7bdbb0db", "address": "fa:16:3e:28:7e:24", "network": {"id": "83f220fa-06f9-40dd-8cc8-329ec73063ec", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1755302406-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b66f633b14b48ada4e1d8b20da967df", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd765857-52", "ovs_interfaceid": "bd765857-52dd-419a-84e4-611a7bdbb0db", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 31 15:32:46 user nova-compute[72239]: DEBUG nova.network.os_vif_util [None req-517171ad-6174-4d76-8899-d51908424d7f tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:28:7e:24,bridge_name='br-int',has_traffic_filtering=True,id=bd765857-52dd-419a-84e4-611a7bdbb0db,network=Network(83f220fa-06f9-40dd-8cc8-329ec73063ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd765857-52') {{(pid=72239) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 31 15:32:46 user nova-compute[72239]: DEBUG os_vif [None req-517171ad-6174-4d76-8899-d51908424d7f tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:7e:24,bridge_name='br-int',has_traffic_filtering=True,id=bd765857-52dd-419a-84e4-611a7bdbb0db,network=Network(83f220fa-06f9-40dd-8cc8-329ec73063ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd765857-52') {{(pid=72239) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 31 15:32:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 22 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:32:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd765857-52, bridge=br-int, if_exists=True) {{(pid=72239) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 31 15:32:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:32:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:32:46 user nova-compute[72239]: INFO os_vif [None req-517171ad-6174-4d76-8899-d51908424d7f tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:28:7e:24,bridge_name='br-int',has_traffic_filtering=True,id=bd765857-52dd-419a-84e4-611a7bdbb0db,network=Network(83f220fa-06f9-40dd-8cc8-329ec73063ec),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd765857-52')
Jul 31 15:32:46 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-517171ad-6174-4d76-8899-d51908424d7f tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Deleting instance files /opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c_del
Jul 31 15:32:46 user nova-compute[72239]: INFO nova.virt.libvirt.driver [None req-517171ad-6174-4d76-8899-d51908424d7f tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Deletion of /opt/stack/data/nova/instances/09177e97-5848-4d1d-a998-438bfaddb73c_del complete
Jul 31 15:32:46 user nova-compute[72239]: INFO nova.compute.manager [None req-517171ad-6174-4d76-8899-d51908424d7f tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Took 0.89 seconds to destroy the instance on the hypervisor.
Jul 31 15:32:46 user nova-compute[72239]: DEBUG oslo.service.loopingcall [None req-517171ad-6174-4d76-8899-d51908424d7f tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=72239) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 31 15:32:46 user nova-compute[72239]: DEBUG nova.compute.manager [-] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Deallocating network for instance {{(pid=72239) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 31 15:32:46 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] deallocate_for_instance() {{(pid=72239) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 31 15:32:47 user nova-compute[72239]: DEBUG nova.network.neutron [-] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Updating instance_info_cache with network_info: [] {{(pid=72239) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 31 15:32:47 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Took 1.00 seconds to deallocate network for instance.
Jul 31 15:32:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-517171ad-6174-4d76-8899-d51908424d7f tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:32:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-517171ad-6174-4d76-8899-d51908424d7f tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:32:47 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-517171ad-6174-4d76-8899-d51908424d7f tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:32:47 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-517171ad-6174-4d76-8899-d51908424d7f tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:32:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-517171ad-6174-4d76-8899-d51908424d7f tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.109s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:32:47 user nova-compute[72239]: INFO nova.scheduler.client.report [None req-517171ad-6174-4d76-8899-d51908424d7f tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Deleted allocations for instance 09177e97-5848-4d1d-a998-438bfaddb73c
Jul 31 15:32:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-517171ad-6174-4d76-8899-d51908424d7f tempest-SnapshotDataIntegrityTests-1913476977 tempest-SnapshotDataIntegrityTests-1913476977-project-member] Lock "09177e97-5848-4d1d-a998-438bfaddb73c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.190s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:32:47 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:32:47 user nova-compute[72239]: DEBUG nova.compute.manager [req-27910f01-801d-4e45-86fb-4145297da45d req-17991ff3-0c28-4cdc-a8a7-78d869e20b06 service nova] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Received event network-vif-plugged-bd765857-52dd-419a-84e4-611a7bdbb0db {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:32:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-27910f01-801d-4e45-86fb-4145297da45d req-17991ff3-0c28-4cdc-a8a7-78d869e20b06 service nova] Acquiring lock "09177e97-5848-4d1d-a998-438bfaddb73c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:32:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-27910f01-801d-4e45-86fb-4145297da45d req-17991ff3-0c28-4cdc-a8a7-78d869e20b06 service nova] Lock "09177e97-5848-4d1d-a998-438bfaddb73c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:32:47 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [req-27910f01-801d-4e45-86fb-4145297da45d req-17991ff3-0c28-4cdc-a8a7-78d869e20b06 service nova] Lock "09177e97-5848-4d1d-a998-438bfaddb73c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:32:47 user nova-compute[72239]: DEBUG nova.compute.manager [req-27910f01-801d-4e45-86fb-4145297da45d req-17991ff3-0c28-4cdc-a8a7-78d869e20b06 service nova] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] No waiting events found dispatching network-vif-plugged-bd765857-52dd-419a-84e4-611a7bdbb0db {{(pid=72239) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 31 15:32:47 user nova-compute[72239]: WARNING nova.compute.manager [req-27910f01-801d-4e45-86fb-4145297da45d req-17991ff3-0c28-4cdc-a8a7-78d869e20b06 service nova] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Received unexpected event network-vif-plugged-bd765857-52dd-419a-84e4-611a7bdbb0db for instance with vm_state deleted and task_state None.
Jul 31 15:32:47 user nova-compute[72239]: DEBUG nova.compute.manager [req-27910f01-801d-4e45-86fb-4145297da45d req-17991ff3-0c28-4cdc-a8a7-78d869e20b06 service nova] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Received event network-vif-deleted-bd765857-52dd-419a-84e4-611a7bdbb0db {{(pid=72239) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 31 15:32:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:32:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:33:00 user nova-compute[72239]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690817565.9928997, 09177e97-5848-4d1d-a998-438bfaddb73c => Stopped> {{(pid=72239) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 31 15:33:00 user nova-compute[72239]: INFO nova.compute.manager [-] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] VM Stopped (Lifecycle Event)
Jul 31 15:33:01 user nova-compute[72239]: DEBUG nova.compute.manager [None req-37c0c531-525c-4d17-a5e4-360f4a79494f None None] [instance: 09177e97-5848-4d1d-a998-438bfaddb73c] Checking state {{(pid=72239) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 31 15:33:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:33:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:33:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:33:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:33:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:33:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:33:06 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:33:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:33:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:33:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:33:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:33:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:33:11 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:33:16 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:33:21 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:33:21 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:33:21 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:33:21 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:33:21 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:33:21 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:33:26 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:33:31 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:33:32 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:33:36 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:33:36 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:33:38 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:33:38 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Starting heal instance info cache {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 31 15:33:38 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Rebuilding the list of instances to heal {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 31 15:33:38 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Didn't find any instances for network info cache update. {{(pid=72239) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 31 15:33:38 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:33:39 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:33:40 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:33:40 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:33:41 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:33:42 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:33:42 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:33:44 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager.update_available_resource {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:33:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:33:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:33:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:33:44 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Auditing locally available compute resources for user (node: user) {{(pid=72239) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 31 15:33:44 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:33:44 user nova-compute[72239]: WARNING nova.virt.libvirt.driver [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 31 15:33:44 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Hypervisor/Node resource view: name=user free_ram=8943MB free_disk=25.111488342285156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=72239) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 31 15:33:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 31 15:33:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 31 15:33:44 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 31 15:33:44 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=72239) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 31 15:33:44 user nova-compute[72239]: DEBUG nova.compute.provider_tree [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed in ProviderTree for provider: 98aeb34d-09d0-4a3a-9216-4d8197134e8e {{(pid=72239) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 31 15:33:44 user nova-compute[72239]: DEBUG nova.scheduler.client.report [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Inventory has not changed for provider 98aeb34d-09d0-4a3a-9216-4d8197134e8e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=72239) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 31 15:33:44 user nova-compute[72239]: DEBUG nova.compute.resource_tracker [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Compute_service record updated for user:user {{(pid=72239) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 31 15:33:44 user nova-compute[72239]: DEBUG oslo_concurrency.lockutils [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.149s {{(pid=72239) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 31 15:33:45 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:33:45 user nova-compute[72239]: DEBUG oslo_service.periodic_task [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=72239) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 31 15:33:45 user nova-compute[72239]: DEBUG nova.compute.manager [None req-777c690a-34b1-4b3a-918a-1f9d30e6d47e None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=72239) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 31 15:33:46 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:33:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:33:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:33:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:33:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:33:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:33:51 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:33:56 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:34:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 31 15:34:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 31 15:34:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=72239) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 31 15:34:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:34:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=72239) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 31 15:34:01 user nova-compute[72239]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=72239) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}